2023-12-14T18:05:43.817 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T18:05:43.818 DEBUG:teuthology.run:Teuthology command: teuthology --name choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi --verbose --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/misc}} --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436 -- /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/orig.config.yaml 2023-12-14T18:05:43.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T18:05:43.978 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436 branch: wip-choffman-62793 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/misc}} email: null first_in_suite: false job_id: '7491436' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-choffman-62793 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62793-testing sha1: bf026da9d69000f3d4a9d16360156095d6612a2d owner: scheduled_choffman@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4289 sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed sleep_before_teardown: 0 suite: fs suite_branch: wip-62793-testing suite_path: /home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa suite_relpath: qa suite_repo: https://github.com/chrisphoffman/ceph.git suite_sha1: bf026da9d69000f3d4a9d16360156095d6612a2d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEDuntAOkRfdezS+Lgz8MUDu8Eyivsq1jlYEs6Xy80JdTORtdWi9GR8cn7NyvSg1iYSRfTyJMe7SjVd4luQSli4= smithi091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRqiZBczV6cpnvgPffu94DpNWh/51zux1wzi6iqxVWsfauj6SLqXrBVQm7/aeB1fCeQxi2dIehzGnU+XJUFxO8= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwLVmvB4u8BUKCkE6IVAT9j6fNlLkfparHpzIdVJt6ztQrYvqkSi6vsqQYBfW28yrjtqHpja8zMZOnib1Xxlss= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - fs/misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-14_17:59:30 tube: smithi user: choffman verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-14T18:05:43.979 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa; will attempt to use it 2023-12-14T18:05:44.041 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks 2023-12-14T18:05:44.041 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-14T18:05:44.042 INFO:teuthology.task.internal:Checking packages... 2023-12-14T18:05:44.139 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '1faa353368ad4f5aeb56d7107b638336f58659ed' 2023-12-14T18:05:44.139 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-14T18:05:44.139 INFO:teuthology.packaging:ref: None 2023-12-14T18:05:44.139 INFO:teuthology.packaging:tag: None 2023-12-14T18:05:44.139 INFO:teuthology.packaging:branch: wip-choffman-62793 2023-12-14T18:05:44.140 INFO:teuthology.packaging:sha1: 1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:05:44.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-choffman-62793 2023-12-14T18:05:44.360 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3905.g1faa3533 2023-12-14T18:05:44.361 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-14T18:05:44.373 INFO:teuthology.task.internal:no buildpackages task found 2023-12-14T18:05:44.373 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-14T18:05:44.448 INFO:teuthology.task.internal:Saving configuration 2023-12-14T18:05:44.467 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-14T18:05:44.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T18:05:44.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.864567', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEDuntAOkRfdezS+Lgz8MUDu8Eyivsq1jlYEs6Xy80JdTORtdWi9GR8cn7NyvSg1iYSRfTyJMe7SjVd4luQSli4='} 2023-12-14T18:05:44.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.865977', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRqiZBczV6cpnvgPffu94DpNWh/51zux1wzi6iqxVWsfauj6SLqXrBVQm7/aeB1fCeQxi2dIehzGnU+XJUFxO8='} 2023-12-14T18:05:44.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.867113', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwLVmvB4u8BUKCkE6IVAT9j6fNlLkfparHpzIdVJt6ztQrYvqkSi6vsqQYBfW28yrjtqHpja8zMZOnib1Xxlss='} 2023-12-14T18:05:44.546 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-14T18:05:44.559 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-12-14T18:05:44.559 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-12-14T18:05:44.559 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-12-14T18:05:44.559 INFO:teuthology.run_tasks:Running task console_log... 2023-12-14T18:05:44.655 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee3cf45dc0>, signals=[15]) 2023-12-14T18:05:44.655 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-14T18:05:44.668 INFO:teuthology.task.internal:Opening connections... 2023-12-14T18:05:44.668 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T18:05:44.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T18:05:44.740 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2023-12-14T18:05:44.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T18:05:44.806 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-12-14T18:05:44.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T18:05:44.874 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-14T18:05:44.882 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-12-14T18:05:44.902 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-12-14T18:05:44.903 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-14T18:05:44.961 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T18:05:44.962 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:44.963 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T18:05:44.963 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T18:05:44.963 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T18:05:44.963 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T18:05:44.963 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-14T18:05:44.984 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2023-12-14T18:05:45.005 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2023-12-14T18:05:45.005 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:ID="rhel" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE="fedora" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="8.6" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:PLATFORM_ID="platform:el8" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:ANSI_COLOR="0;31" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T18:05:45.065 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T18:05:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T18:05:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T18:05:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T18:05:45.066 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-12-14T18:05:45.100 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-12-14T18:05:45.120 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-12-14T18:05:45.121 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T18:05:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T18:05:45.181 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T18:05:45.181 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-12-14T18:05:45.217 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-14T18:05:45.229 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-14T18:05:45.239 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-14T18:05:45.239 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-12-14T18:05:45.242 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2023-12-14T18:05:45.244 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-12-14T18:05:45.263 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-14T18:05:45.272 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-14T18:05:45.272 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-12-14T18:05:45.301 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2023-12-14T18:05:45.304 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-12-14T18:05:45.332 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-14T18:05:45.415 INFO:teuthology.run_tasks:Running task kernel... 2023-12-14T18:05:45.469 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-14T18:05:45.469 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-14T18:05:45.469 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-14T18:05:45.470 DEBUG:teuthology.orchestra.run.smithi091:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-14T18:05:45.470 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-14T18:05:45.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:05:45.490 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-12-14T18:05:45.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:05:45.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:05:45.491 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-12-14T18:05:45.491 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-12-14T18:05:45.549 INFO:teuthology.orchestra.run.smithi069.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:45.550 INFO:teuthology.task.kernel:Running kernel on smithi069: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:45.550 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2023-12-14T18:05:45.551 INFO:teuthology.orchestra.run.smithi091.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:45.551 INFO:teuthology.orchestra.run.smithi119.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:45.551 INFO:teuthology.task.kernel:Running kernel on smithi091: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:45.552 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum install -y kernel 2023-12-14T18:05:45.552 INFO:teuthology.task.kernel:Running kernel on smithi119: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:45.552 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2023-12-14T18:05:47.293 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:47.293 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-12-14T18:05:47.296 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:47.302 INFO:teuthology.orchestra.run.smithi091.stdout:Unable to read consumer identity 2023-12-14T18:05:47.309 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:47.315 INFO:teuthology.orchestra.run.smithi119.stdout:Unable to read consumer identity 2023-12-14T18:05:47.428 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:47.429 INFO:teuthology.orchestra.run.smithi119.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:47.429 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:47.468 INFO:teuthology.orchestra.run.smithi069.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:47.489 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:47.489 INFO:teuthology.orchestra.run.smithi091.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:47.489 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:49.204 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-12-14T18:05:49.207 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-12-14T18:05:49.213 INFO:teuthology.orchestra.run.smithi091.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-12-14T18:05:49.991 INFO:teuthology.orchestra.run.smithi091.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-12-14T18:05:49.996 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-12-14T18:05:51.125 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-12-14T18:05:53.563 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 238 kB/s | 24 kB 00:00 2023-12-14T18:05:53.597 INFO:teuthology.orchestra.run.smithi091.stdout:lab-extras 399 kB/s | 24 kB 00:00 2023-12-14T18:05:54.291 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2023-12-14T18:05:54.291 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-14T18:05:54.324 INFO:teuthology.orchestra.run.smithi091.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2023-12-14T18:05:54.324 INFO:teuthology.orchestra.run.smithi091.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-14T18:05:54.373 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T18:05:54.374 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-12-14T18:05:54.374 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T18:05:54.402 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-12-14T18:05:54.404 INFO:teuthology.orchestra.run.smithi091.stdout:Nothing to do. 2023-12-14T18:05:54.404 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-12-14T18:05:54.520 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2023-12-14T18:05:54.528 DEBUG:teuthology.orchestra.run.smithi091:> echo no | sudo yum reinstall kernel || true 2023-12-14T18:05:54.666 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 360 kB/s | 24 kB 00:00 2023-12-14T18:05:54.856 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:54.857 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-12-14T18:05:54.867 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:54.867 INFO:teuthology.orchestra.run.smithi091.stdout:Unable to read consumer identity 2023-12-14T18:05:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:54.915 INFO:teuthology.orchestra.run.smithi069.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:54.915 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:54.923 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:54.923 INFO:teuthology.orchestra.run.smithi091.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:54.923 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:55.218 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:02 ago on Thu 14 Dec 2023 06:05:53 PM UTC. 2023-12-14T18:05:55.226 INFO:teuthology.orchestra.run.smithi091.stdout:Last metadata expiration check: 0:00:02 ago on Thu 14 Dec 2023 06:05:53 PM UTC. 2023-12-14T18:05:55.292 INFO:teuthology.orchestra.run.smithi091.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T18:05:55.300 INFO:teuthology.orchestra.run.smithi091.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T18:05:55.311 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T18:05:55.311 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T18:05:55.345 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-12-14T18:05:55.347 INFO:teuthology.orchestra.run.smithi091.stderr:Error: No packages marked for reinstall. 2023-12-14T18:05:55.391 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2023-12-14T18:05:55.393 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum reinstall -y kernel || true 2023-12-14T18:05:55.394 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2023-12-14T18:05:55.395 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-14T18:05:55.479 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T18:05:55.480 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-14T18:05:55.480 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T18:05:55.630 DEBUG:teuthology.orchestra.run.smithi119:> echo no | sudo yum reinstall kernel || true 2023-12-14T18:05:55.722 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:55.722 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-12-14T18:05:55.729 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:55.729 INFO:teuthology.orchestra.run.smithi091.stdout:Unable to read consumer identity 2023-12-14T18:05:55.781 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:55.781 INFO:teuthology.orchestra.run.smithi069.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:05:55.789 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:55.789 INFO:teuthology.orchestra.run.smithi091.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:55.790 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:05:55.968 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:55.968 INFO:teuthology.orchestra.run.smithi119.stdout:Unable to read consumer identity 2023-12-14T18:05:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:56.023 INFO:teuthology.orchestra.run.smithi119.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:56.079 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Thu 14 Dec 2023 06:05:53 PM UTC. 2023-12-14T18:05:56.088 INFO:teuthology.orchestra.run.smithi091.stdout:Last metadata expiration check: 0:00:03 ago on Thu 14 Dec 2023 06:05:53 PM UTC. 2023-12-14T18:05:56.141 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T18:05:56.141 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T18:05:56.156 INFO:teuthology.orchestra.run.smithi091.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T18:05:56.156 INFO:teuthology.orchestra.run.smithi091.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T18:05:56.172 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-12-14T18:05:56.193 INFO:teuthology.orchestra.run.smithi091.stderr:Error: No packages marked for reinstall. 2023-12-14T18:05:56.218 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2023-12-14T18:05:56.243 DEBUG:teuthology.orchestra.run.smithi091:> rpm -q kernel | sort -rV | head -n 1 2023-12-14T18:05:56.335 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:02 ago on Thu 14 Dec 2023 06:05:54 PM UTC. 2023-12-14T18:05:56.370 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:56.371 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:56.371 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-14T18:05:56.371 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-14T18:05:56.371 DEBUG:teuthology.orchestra.run.smithi069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-14T18:05:56.394 INFO:teuthology.orchestra.run.smithi091.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:56.394 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:56.394 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-14T18:05:56.394 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-14T18:05:56.394 DEBUG:teuthology.orchestra.run.smithi091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-14T18:05:56.405 INFO:teuthology.orchestra.run.smithi069.stdout:ttyS1 2023-12-14T18:05:56.417 DEBUG:teuthology.parallel:result is None 2023-12-14T18:05:56.429 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T18:05:56.430 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T18:05:56.432 INFO:teuthology.orchestra.run.smithi091.stdout:ttyS1 2023-12-14T18:05:56.445 DEBUG:teuthology.parallel:result is None 2023-12-14T18:05:56.473 INFO:teuthology.orchestra.run.smithi119.stderr:Error: No packages marked for reinstall. 2023-12-14T18:05:56.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum reinstall -y kernel || true 2023-12-14T18:05:56.852 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:05:56.852 INFO:teuthology.orchestra.run.smithi119.stdout:Unable to read consumer identity 2023-12-14T18:05:56.915 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:56.915 INFO:teuthology.orchestra.run.smithi119.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-14T18:05:56.915 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:05:57.214 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:03 ago on Thu 14 Dec 2023 06:05:54 PM UTC. 2023-12-14T18:05:57.281 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-14T18:05:57.281 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-14T18:05:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:Error: No packages marked for reinstall. 2023-12-14T18:05:57.371 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2023-12-14T18:05:57.525 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:57.525 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2023-12-14T18:05:57.525 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-14T18:05:57.525 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-12-14T18:05:57.525 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-14T18:05:57.556 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-12-14T18:05:57.571 DEBUG:teuthology.parallel:result is None 2023-12-14T18:05:57.571 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-14T18:05:57.578 INFO:teuthology.task.internal:Creating test directory... 2023-12-14T18:05:57.578 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-14T18:05:57.581 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-14T18:05:57.584 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-14T18:05:57.628 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-14T18:05:57.638 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-14T18:05:57.652 INFO:teuthology.task.internal:Creating archive directory... 2023-12-14T18:05:57.652 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-14T18:05:57.655 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-14T18:05:57.658 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-14T18:05:57.705 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-14T18:05:57.715 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-14T18:05:57.715 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-14T18:05:57.726 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-14T18:05:57.740 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-14T18:05:57.763 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T18:05:57.770 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T18:05:57.775 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T18:05:57.775 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T18:05:57.783 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T18:05:57.785 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-14T18:05:57.786 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-14T18:05:57.794 INFO:teuthology.task.internal:Configuring sudo... 2023-12-14T18:05:57.794 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-14T18:05:57.820 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-14T18:05:57.827 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-14T18:05:57.854 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-14T18:05:57.864 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-14T18:05:57.864 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-14T18:05:57.890 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-14T18:05:57.897 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-14T18:05:57.913 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T18:05:57.989 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T18:05:58.041 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T18:05:58.125 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T18:05:58.168 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:05:58.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-14T18:05:58.235 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T18:05:58.282 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T18:05:58.340 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T18:05:58.425 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T18:05:58.469 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:05:58.469 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-14T18:05:58.537 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T18:05:58.580 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T18:05:58.647 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T18:05:58.691 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T18:05:58.734 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:05:58.734 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-14T18:05:58.801 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-12-14T18:05:58.804 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2023-12-14T18:05:58.807 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-12-14T18:05:58.862 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T18:05:58.883 INFO:teuthology.orchestra.run.smithi091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T18:05:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T18:05:59.222 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-14T18:05:59.233 INFO:teuthology.task.internal:Starting timer... 2023-12-14T18:05:59.233 INFO:teuthology.run_tasks:Running task pcp... 2023-12-14T18:05:59.297 INFO:teuthology.run_tasks:Running task selinux... 2023-12-14T18:05:59.383 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-14T18:05:59.384 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2023-12-14T18:05:59.468 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2023-12-14T18:05:59.470 DEBUG:teuthology.orchestra.run.smithi091:> sudo service auditd rotate 2023-12-14T18:05:59.557 INFO:teuthology.orchestra.run.smithi091.stdout:Rotating logs: 2023-12-14T18:05:59.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2023-12-14T18:05:59.633 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2023-12-14T18:05:59.635 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-14T18:05:59.636 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2023-12-14T18:05:59.661 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2023-12-14T18:05:59.662 DEBUG:teuthology.orchestra.run.smithi091:> /usr/sbin/getenforce 2023-12-14T18:05:59.684 INFO:teuthology.orchestra.run.smithi091.stdout:Permissive 2023-12-14T18:05:59.685 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2023-12-14T18:05:59.713 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2023-12-14T18:05:59.713 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi091.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2023-12-14T18:05:59.713 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T18:05:59.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:05:59.744 DEBUG:teuthology.orchestra.run.smithi091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T18:05:59.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:05:59.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T18:05:59.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:05:59.802 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-14T18:05:59.803 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2023-12-14T18:05:59.832 DEBUG:teuthology.orchestra.run.smithi091:> sudo /usr/sbin/setenforce permissive 2023-12-14T18:05:59.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2023-12-14T18:05:59.888 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-14T18:06:00.081 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-14T18:06:00.431 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-14T18:06:06.561 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-14T18:06:08.277 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-14T18:06:08.393 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi091.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-14T18:12:48.265 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi091.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-12-14T18:12:48.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-14T18:12:48.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T18:12:48.338 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-12-14T18:12:48.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-14T18:12:48.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-14T18:12:48.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T18:12:48.483 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-12-14T18:12:48.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-14T18:12:48.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-14T18:12:48.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T18:12:48.624 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-14T18:12:48.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-14T18:12:48.693 INFO:teuthology.run_tasks:Running task clock... 2023-12-14T18:12:48.702 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-14T18:12:48.702 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-14T18:12:48.703 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T18:12:48.705 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-14T18:12:48.706 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T18:12:48.708 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-14T18:12:48.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T18:12:48.738 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-14T18:12:48.743 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-14T18:12:48.753 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-14T18:12:48.759 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-14T18:12:48.767 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-14T18:12:48.783 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-14T18:12:48.826 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: ntpd: command not found 2023-12-14T18:12:48.831 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2023-12-14T18:12:48.839 INFO:teuthology.orchestra.run.smithi091.stdout:506 Cannot talk to daemon 2023-12-14T18:12:48.843 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2023-12-14T18:12:48.854 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-14T18:12:48.860 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2023-12-14T18:12:48.860 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-14T18:12:48.868 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-14T18:12:48.871 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2023-12-14T18:12:48.873 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-14T18:12:48.886 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-14T18:12:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-14T18:12:48.941 INFO:teuthology.orchestra.run.smithi091.stderr:bash: ntpq: command not found 2023-12-14T18:12:48.941 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-12-14T18:12:48.944 INFO:teuthology.orchestra.run.smithi091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T18:12:48.944 INFO:teuthology.orchestra.run.smithi091.stdout:=============================================================================== 2023-12-14T18:12:48.944 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.944 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.944 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.944 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.946 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T18:12:48.946 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-14T18:12:48.946 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.946 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.946 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.946 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.990 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-12-14T18:12:48.993 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T18:12:48.993 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-12-14T18:12:48.993 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.993 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.993 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.993 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:12:48.994 INFO:teuthology.run_tasks:Running task pexec... 2023-12-14T18:12:49.006 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-14T18:12:49.006 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T18:12:49.006 DEBUG:teuthology.orchestra.run.smithi069:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-14T18:12:49.006 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi091.front.sepia.ceph.com 2023-12-14T18:12:49.007 DEBUG:teuthology.orchestra.run.smithi091:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-14T18:12:49.007 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi119.front.sepia.ceph.com 2023-12-14T18:12:49.007 DEBUG:teuthology.orchestra.run.smithi119:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-14T18:12:49.384 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:12:49.387 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:12:49.409 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:12:51.082 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 kB/s | 4.5 kB 00:00 2023-12-14T18:12:51.486 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2023-12-14T18:12:51.533 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2023-12-14T18:12:51.674 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 kB/s | 4.1 kB 00:00 2023-12-14T18:12:51.803 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 kB/s | 4.5 kB 00:00 2023-12-14T18:12:51.901 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2023-12-14T18:12:54.424 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout:Resetting modules: 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout: container-tools 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-12-14T18:12:54.425 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:12:54.613 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout: Package Architecture Version Repository Size 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout:Resetting modules: 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout: container-tools 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-12-14T18:12:54.614 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:12:54.918 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout:Resetting modules: 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-14T18:12:54.919 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:13:04.873 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T18:13:05.332 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:07.073 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 kB/s | 4.5 kB 00:00 2023-12-14T18:13:07.362 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-12-14T18:13:07.672 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 4.1 kB 00:00 2023-12-14T18:13:07.825 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:09.075 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T18:13:09.540 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:09.784 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 35 kB/s | 4.1 kB 00:00 2023-12-14T18:13:10.104 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 kB/s | 4.5 kB 00:00 2023-12-14T18:13:10.393 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T18:13:10.543 INFO:teuthology.orchestra.run.smithi069.stdout:========================================================================================================== 2023-12-14T18:13:10.543 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-12-14T18:13:10.543 INFO:teuthology.orchestra.run.smithi069.stdout:========================================================================================================== 2023-12-14T18:13:10.543 INFO:teuthology.orchestra.run.smithi069.stdout:Installing group/module packages: 2023-12-14T18:13:10.543 INFO:teuthology.orchestra.run.smithi069.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2023-12-14T18:13:10.544 INFO:teuthology.orchestra.run.smithi069.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout:Installing module profiles: 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout: container-tools/common 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling module streams: 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout: container-tools rhel8 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout:========================================================================================================== 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout:Install 13 Packages 2023-12-14T18:13:10.545 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:13:10.546 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 26 M 2023-12-14T18:13:10.546 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 87 M 2023-12-14T18:13:10.546 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-12-14T18:13:10.747 INFO:teuthology.orchestra.run.smithi069.stdout:(1/13): yajl-2.1.0-12.el8.x86_64.rpm 204 kB/s | 41 kB 00:00 2023-12-14T18:13:10.772 INFO:teuthology.orchestra.run.smithi069.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 109 kB/s | 25 kB 00:00 2023-12-14T18:13:10.814 INFO:teuthology.orchestra.run.smithi069.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 350 kB/s | 94 kB 00:00 2023-12-14T18:13:10.915 INFO:teuthology.orchestra.run.smithi069.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 6.0 MB/s | 1.0 MB 00:00 2023-12-14T18:13:10.998 INFO:teuthology.orchestra.run.smithi069.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 3.9 MB/s | 739 kB 00:00 2023-12-14T18:13:11.040 INFO:teuthology.orchestra.run.smithi069.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 314 kB/s | 39 kB 00:00 2023-12-14T18:13:11.149 INFO:teuthology.orchestra.run.smithi069.stdout:(7/13): buildah-1.31.3-1.module+el8.9.0+20326+3 23 MB/s | 8.8 MB 00:00 2023-12-14T18:13:11.174 INFO:teuthology.orchestra.run.smithi069.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.3 MB/s | 239 kB 00:00 2023-12-14T18:13:11.258 INFO:teuthology.orchestra.run.smithi069.stdout:(9/13): netavark-1.7.0-1.module+el8.9.0+20326+3 17 MB/s | 3.7 MB 00:00 2023-12-14T18:13:11.275 INFO:teuthology.orchestra.run.smithi069.stdout:(10/13): python3-podman-4.6.0-1.module+el8.9.0+ 1.2 MB/s | 153 kB 00:00 2023-12-14T18:13:11.424 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2023-12-14T18:13:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:(11/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 28 MB/s | 8.1 MB 00:00 2023-12-14T18:13:11.492 INFO:teuthology.orchestra.run.smithi069.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 228 kB/s | 49 kB 00:00 2023-12-14T18:13:11.550 INFO:teuthology.orchestra.run.smithi069.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 8.7 MB/s | 2.5 MB 00:00 2023-12-14T18:13:11.550 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:13:11.551 INFO:teuthology.orchestra.run.smithi069.stdout:Total 25 MB/s | 26 MB 00:01 2023-12-14T18:13:11.807 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 27 kB/s | 4.5 kB 00:00 2023-12-14T18:13:11.829 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-12-14T18:13:11.851 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-12-14T18:13:11.851 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-12-14T18:13:12.557 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-12-14T18:13:12.566 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-12-14T18:13:12.880 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout:========================================================================================================== 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout: Package Arch Version Repository Size 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout:========================================================================================================== 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout:Installing group/module packages: 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-14T18:13:13.033 INFO:teuthology.orchestra.run.smithi091.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout:Installing dependencies: 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout:Installing weak dependencies: 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout:Installing module profiles: 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: container-tools/common 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:13:13.034 INFO:teuthology.orchestra.run.smithi091.stdout:Enabling module streams: 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout: container-tools rhel8 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout:========================================================================================================== 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout:Install 13 Packages 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:13:13.035 INFO:teuthology.orchestra.run.smithi091.stdout:Total download size: 26 M 2023-12-14T18:13:13.036 INFO:teuthology.orchestra.run.smithi091.stdout:Installed size: 87 M 2023-12-14T18:13:13.036 INFO:teuthology.orchestra.run.smithi091.stdout:Downloading Packages: 2023-12-14T18:13:13.185 INFO:teuthology.orchestra.run.smithi091.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 629 kB/s | 94 kB 00:00 2023-12-14T18:13:13.219 INFO:teuthology.orchestra.run.smithi091.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 136 kB/s | 25 kB 00:00 2023-12-14T18:13:13.238 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-12-14T18:13:13.244 INFO:teuthology.orchestra.run.smithi091.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 197 kB/s | 41 kB 00:00 2023-12-14T18:13:13.403 INFO:teuthology.orchestra.run.smithi091.stdout:(4/13): cockpit-podman-75-1.module+el8.9.0+2032 4.6 MB/s | 739 kB 00:00 2023-12-14T18:13:13.467 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-14T18:13:13.490 INFO:teuthology.orchestra.run.smithi091.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 3.3 MB/s | 1.0 MB 00:00 2023-12-14T18:13:13.545 INFO:teuthology.orchestra.run.smithi091.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 277 kB/s | 39 kB 00:00 2023-12-14T18:13:13.653 INFO:teuthology.orchestra.run.smithi091.stdout:(7/13): buildah-1.31.3-1.module+el8.9.0+20326+3 20 MB/s | 8.8 MB 00:00 2023-12-14T18:13:13.679 INFO:teuthology.orchestra.run.smithi091.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.2 MB/s | 239 kB 00:00 2023-12-14T18:13:13.771 INFO:teuthology.orchestra.run.smithi091.stdout:(9/13): netavark-1.7.0-1.module+el8.9.0+20326+3 16 MB/s | 3.7 MB 00:00 2023-12-14T18:13:13.821 INFO:teuthology.orchestra.run.smithi091.stdout:(10/13): python3-podman-4.6.0-1.module+el8.9.0+ 919 kB/s | 153 kB 00:00 2023-12-14T18:13:13.871 INFO:teuthology.orchestra.run.smithi091.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+20326+38 988 kB/s | 49 kB 00:00 2023-12-14T18:13:13.988 INFO:teuthology.orchestra.run.smithi091.stdout:(12/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 12 MB/s | 2.5 MB 00:00 2023-12-14T18:13:14.020 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-14T18:13:14.096 INFO:teuthology.orchestra.run.smithi091.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 20 MB/s | 8.1 MB 00:00 2023-12-14T18:13:14.097 INFO:teuthology.orchestra.run.smithi091.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:13:14.097 INFO:teuthology.orchestra.run.smithi091.stdout:Total 24 MB/s | 26 MB 00:01 2023-12-14T18:13:14.257 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-14T18:13:14.373 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction check 2023-12-14T18:13:14.394 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction check succeeded. 2023-12-14T18:13:14.394 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction test 2023-12-14T18:13:14.469 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-14T18:13:14.609 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T18:13:14.681 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout:Installing group/module packages: 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-14T18:13:14.758 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout:Installing module profiles: 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools/common 2023-12-14T18:13:14.759 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools rhel8 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:13:14.760 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 26 M 2023-12-14T18:13:14.761 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 87 M 2023-12-14T18:13:14.761 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-14T18:13:14.944 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-14T18:13:14.959 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 125 kB/s | 25 kB 00:00 2023-12-14T18:13:14.984 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 421 kB/s | 94 kB 00:00 2023-12-14T18:13:15.017 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction test succeeded. 2023-12-14T18:13:15.018 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 160 kB/s | 41 kB 00:00 2023-12-14T18:13:15.026 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction 2023-12-14T18:13:15.093 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 7.6 MB/s | 1.0 MB 00:00 2023-12-14T18:13:15.135 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 6.2 MB/s | 739 kB 00:00 2023-12-14T18:13:15.209 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-14T18:13:15.343 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): buildah-1.31.3-1.module+el8.9.0+20326+3 25 MB/s | 8.8 MB 00:00 2023-12-14T18:13:15.360 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): criu-libs-3.18-4.module+el8.9.0+20326+3 147 kB/s | 39 kB 00:00 2023-12-14T18:13:15.378 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+20326+38708 987 kB/s | 239 kB 00:00 2023-12-14T18:13:15.486 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 1.2 MB/s | 153 kB 00:00 2023-12-14T18:13:15.545 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 18 MB/s | 3.7 MB 00:00 2023-12-14T18:13:15.645 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+20326+38 494 kB/s | 49 kB 00:00 2023-12-14T18:13:15.675 INFO:teuthology.orchestra.run.smithi091.stdout: Preparing : 1/1 2023-12-14T18:13:15.712 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 11 MB/s | 2.5 MB 00:00 2023-12-14T18:13:15.846 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 17 MB/s | 8.1 MB 00:00 2023-12-14T18:13:15.846 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:13:15.846 INFO:teuthology.orchestra.run.smithi119.stdout:Total 24 MB/s | 26 MB 00:01 2023-12-14T18:13:15.958 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-14T18:13:16.123 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-14T18:13:16.132 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T18:13:16.144 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-14T18:13:16.144 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-14T18:13:16.388 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T18:13:16.481 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-14T18:13:16.662 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-14T18:13:16.758 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-14T18:13:16.766 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-14T18:13:16.806 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-14T18:13:16.865 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-14T18:13:17.036 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-14T18:13:17.287 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-14T18:13:17.418 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-14T18:13:17.507 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-14T18:13:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-14T18:13:17.696 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-14T18:13:17.931 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-14T18:13:18.133 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T18:13:18.208 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-14T18:13:18.421 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T18:13:18.430 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-14T18:13:18.542 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-14T18:13:18.543 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-14T18:13:18.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-14T18:13:18.684 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T18:13:18.813 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-14T18:13:19.013 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-14T18:13:19.117 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-14T18:13:19.258 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-14T18:13:20.013 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-14T18:13:20.148 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T18:13:20.260 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-14T18:13:20.367 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T18:13:20.459 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T18:13:20.781 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-14T18:13:20.857 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T18:13:20.857 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-14T18:13:20.857 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-14T18:13:20.857 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-14T18:13:20.857 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-14T18:13:20.858 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-14T18:13:21.706 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-14T18:13:21.949 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-14T18:13:22.136 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-14T18:13:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-14T18:13:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-14T18:13:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-14T18:13:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-14T18:13:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-14T18:13:32.593 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-14T18:13:32.593 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:33.162 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:13:33.163 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T18:13:33.341 DEBUG:teuthology.parallel:result is None 2023-12-14T18:13:35.169 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-14T18:13:35.169 INFO:teuthology.orchestra.run.smithi091.stdout:Installed products updated. 2023-12-14T18:13:35.737 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:13:35.737 INFO:teuthology.orchestra.run.smithi091.stdout:Installed: 2023-12-14T18:13:35.737 INFO:teuthology.orchestra.run.smithi091.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.737 INFO:teuthology.orchestra.run.smithi091.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.737 INFO:teuthology.orchestra.run.smithi091.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:35.737 INFO:teuthology.orchestra.run.smithi091.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:13:35.738 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-12-14T18:13:35.964 DEBUG:teuthology.parallel:result is None 2023-12-14T18:13:37.256 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-14T18:13:37.256 INFO:teuthology.orchestra.run.smithi119.stdout:Installed products updated. 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:37.786 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:13:37.787 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T18:13:37.953 DEBUG:teuthology.parallel:result is None 2023-12-14T18:13:37.953 INFO:teuthology.run_tasks:Running task install... 2023-12-14T18:13:37.969 DEBUG:teuthology.task.install:project ceph 2023-12-14T18:13:37.969 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed'}} 2023-12-14T18:13:37.969 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed'} 2023-12-14T18:13:37.969 INFO:teuthology.task.install:Using flavor: default 2023-12-14T18:13:37.976 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-14T18:13:37.976 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-14T18:13:37.977 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'tag': None, 'wait_for_package': False} 2023-12-14T18:13:37.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:13:37.979 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'tag': None, 'wait_for_package': False} 2023-12-14T18:13:37.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:13:37.980 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'tag': None, 'wait_for_package': False} 2023-12-14T18:13:37.980 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:13:38.195 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/ 2023-12-14T18:13:38.196 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3905.g1faa3533 2023-12-14T18:13:38.207 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/ 2023-12-14T18:13:38.207 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3905.g1faa3533 2023-12-14T18:13:38.213 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/ 2023-12-14T18:13:38.214 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3905.g1faa3533 2023-12-14T18:13:38.378 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-14T18:13:38.378 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:13:38.378 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-14T18:13:38.388 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-14T18:13:38.388 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:13:38.388 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-14T18:13:38.390 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-14T18:13:38.391 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:13:38.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-14T18:13:38.412 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-14T18:13:38.412 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1faa353368ad4f5aeb56d7107b638336f58659ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-14T18:13:38.419 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-14T18:13:38.420 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1faa353368ad4f5aeb56d7107b638336f58659ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-14T18:13:38.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-14T18:13:38.423 DEBUG:teuthology.orchestra.run.smithi091:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1faa353368ad4f5aeb56d7107b638336f58659ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-14T18:13:38.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-14T18:13:38.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-14T18:13:38.496 DEBUG:teuthology.orchestra.run.smithi091:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-14T18:13:38.564 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-14T18:13:38.566 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-14T18:13:38.577 DEBUG:teuthology.orchestra.run.smithi091:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-14T18:13:38.630 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2023-12-14T18:13:38.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2023-12-14T18:13:38.635 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2023-12-14T18:13:38.637 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2023-12-14T18:13:38.646 INFO:teuthology.orchestra.run.smithi091.stdout:check_obsoletes = 1 2023-12-14T18:13:38.647 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum clean all 2023-12-14T18:13:39.004 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:39.017 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:39.026 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:41.429 INFO:teuthology.orchestra.run.smithi069.stdout:52 files removed 2023-12-14T18:13:41.480 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-14T18:13:41.814 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:41.997 INFO:teuthology.orchestra.run.smithi119.stdout:52 files removed 2023-12-14T18:13:42.054 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-14T18:13:42.076 INFO:teuthology.orchestra.run.smithi091.stdout:52 files removed 2023-12-14T18:13:42.128 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-14T18:13:42.391 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:42.465 INFO:teuthology.orchestra.run.smithi091.stdout:Updating Subscription Management repositories. 2023-12-14T18:13:43.748 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 250 kB/s | 80 kB 00:00 2023-12-14T18:13:44.115 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-12-14T18:13:44.267 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 263 kB/s | 80 kB 00:00 2023-12-14T18:13:44.416 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 5.4 kB/s | 1.5 kB 00:00 2023-12-14T18:13:44.498 INFO:teuthology.orchestra.run.smithi091.stdout:ceph packages for x86_64 209 kB/s | 80 kB 00:00 2023-12-14T18:13:44.550 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-12-14T18:13:44.593 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-12-14T18:13:44.807 INFO:teuthology.orchestra.run.smithi091.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-12-14T18:13:44.885 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-12-14T18:13:45.027 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-12-14T18:13:45.149 INFO:teuthology.orchestra.run.smithi091.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-12-14T18:13:45.292 INFO:teuthology.orchestra.run.smithi091.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-12-14T18:13:45.995 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-14T18:13:46.709 INFO:teuthology.orchestra.run.smithi091.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-14T18:13:46.937 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-12-14T18:13:49.535 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 449 kB/s | 24 kB 00:00 2023-12-14T18:13:50.284 INFO:teuthology.orchestra.run.smithi091.stdout:lab-extras 406 kB/s | 24 kB 00:00 2023-12-14T18:13:50.803 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 58 MB 00:01 2023-12-14T18:13:50.888 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 56 kB/s | 24 kB 00:00 2023-12-14T18:13:51.094 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 12 MB/s | 8.8 MB 00:00 2023-12-14T18:13:51.589 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2023-12-14T18:13:53.971 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 64 MB 00:01 2023-12-14T18:13:54.598 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 64 MB 00:01 2023-12-14T18:14:01.757 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 54 MB/s | 64 MB 00:01 2023-12-14T18:14:04.445 INFO:teuthology.orchestra.run.smithi091.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 58 MB 00:01 2023-12-14T18:14:05.174 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 58 MB 00:01 2023-12-14T18:14:11.912 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2023-12-14T18:14:19.175 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T18:14:19.176 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T18:14:19.194 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-14T18:14:19.196 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-14T18:14:19.197 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-14T18:14:19.199 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-14T18:14:19.202 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-14T18:14:19.206 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-14T18:14:19.207 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-14T18:14:19.266 INFO:teuthology.orchestra.run.smithi091.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T18:14:19.267 INFO:teuthology.orchestra.run.smithi091.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T18:14:19.285 INFO:teuthology.orchestra.run.smithi091.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-14T18:14:19.287 INFO:teuthology.orchestra.run.smithi091.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-14T18:14:19.288 INFO:teuthology.orchestra.run.smithi091.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-14T18:14:19.289 INFO:teuthology.orchestra.run.smithi091.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-14T18:14:19.292 INFO:teuthology.orchestra.run.smithi091.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-14T18:14:19.296 INFO:teuthology.orchestra.run.smithi091.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-14T18:14:19.297 INFO:teuthology.orchestra.run.smithi091.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-14T18:14:19.412 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-14T18:14:19.426 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================================================== 2023-12-14T18:14:19.426 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-12-14T18:14:19.426 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================================================== 2023-12-14T18:14:19.426 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-12-14T18:14:19.426 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.4 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 5.3 M 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 847 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 165 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 1.5 M 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 127 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 1.7 M 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 7.4 M 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 47 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 13 M 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 41 M 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 265 k 2023-12-14T18:14:19.427 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 83 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 258 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 18 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 31 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 771 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 139 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-14T18:14:19.428 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 197 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 370 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 364 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 107 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 94 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.4 M 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 179 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T18:14:19.429 INFO:teuthology.orchestra.run.smithi069.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.7 M 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.6 M 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-14T18:14:19.430 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 22 M 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 23 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 2.3 M 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 240 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 4.6 M 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 18 M 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 15 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 24 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 137 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-14T18:14:19.431 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 473 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.5 M 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-14T18:14:19.432 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 45 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 119 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-14T18:14:19.433 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T18:14:19.434 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T18:14:19.435 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-14T18:14:19.436 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling module streams: 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql 10 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================================================== 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout:Install 129 Packages 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 16 Packages 2023-12-14T18:14:19.437 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:14:19.438 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 205 M 2023-12-14T18:14:19.438 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-12-14T18:14:19.501 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-12-14T18:14:19.515 INFO:teuthology.orchestra.run.smithi091.stdout:=========================================================================================================================== 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: Package Arch Version Repository Size 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout:=========================================================================================================================== 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout:Installing: 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.4 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 5.3 M 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 847 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 165 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 1.5 M 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 127 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 1.7 M 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 7.4 M 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-rook noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 47 k 2023-12-14T18:14:19.516 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-radosgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 13 M 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-test x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 41 M 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 265 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 83 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 258 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-top noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 18 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 31 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 771 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: librados-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 139 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-14T18:14:19.517 INFO:teuthology.orchestra.run.smithi091.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-contrib x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-server x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cephfs x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 197 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 370 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 364 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 107 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 94 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.4 M 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 179 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrading: 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-14T18:14:19.518 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: librados2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.7 M 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.6 M 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout:Installing dependencies: 2023-12-14T18:14:19.519 INFO:teuthology.orchestra.run.smithi091.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 22 M 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 23 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 2.3 M 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 240 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 4.6 M 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-osd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 18 M 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 15 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-selinux x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 24 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: libcephsqlite x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 137 k 2023-12-14T18:14:19.520 INFO:teuthology.orchestra.run.smithi091.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 473 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: librgw2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.5 M 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-14T18:14:19.521 INFO:teuthology.orchestra.run.smithi091.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 45 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 119 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-14T18:14:19.522 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T18:14:19.523 INFO:teuthology.orchestra.run.smithi091.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T18:14:19.524 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-14T18:14:19.525 INFO:teuthology.orchestra.run.smithi091.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout:Enabling module streams: 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql 10 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout:=========================================================================================================================== 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout:Install 129 Packages 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrade 16 Packages 2023-12-14T18:14:19.526 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:14:19.527 INFO:teuthology.orchestra.run.smithi091.stdout:Total download size: 205 M 2023-12-14T18:14:19.527 INFO:teuthology.orchestra.run.smithi091.stdout:Downloading Packages: 2023-12-14T18:14:19.963 INFO:teuthology.orchestra.run.smithi069.stdout:(1/145): ceph-18.0.0-3905.g1faa3533.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-12-14T18:14:19.994 INFO:teuthology.orchestra.run.smithi091.stdout:(1/145): ceph-18.0.0-3905.g1faa3533.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-12-14T18:14:20.119 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T18:14:20.121 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-14T18:14:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-14T18:14:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-14T18:14:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-14T18:14:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-14T18:14:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-14T18:14:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-14T18:14:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-14T18:14:20.236 INFO:teuthology.orchestra.run.smithi091.stdout:(2/145): ceph-fuse-18.0.0-3905.g1faa3533.el8.x8 3.4 MB/s | 847 kB 00:00 2023-12-14T18:14:20.313 INFO:teuthology.orchestra.run.smithi069.stdout:(2/145): ceph-fuse-18.0.0-3905.g1faa3533.el8.x8 2.4 MB/s | 847 kB 00:00 2023-12-14T18:14:20.336 INFO:teuthology.orchestra.run.smithi091.stdout:(3/145): ceph-immutable-object-cache-18.0.0-390 1.6 MB/s | 165 kB 00:00 2023-12-14T18:14:20.357 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================================================== 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================================================== 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.4 k 2023-12-14T18:14:20.371 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 5.3 M 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 847 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 165 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 1.5 M 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 127 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 1.7 M 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 7.4 M 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 47 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 13 M 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 41 M 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 265 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 83 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 258 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 18 k 2023-12-14T18:14:20.372 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 31 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 771 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 139 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 10.23-2.module+el8.8.0+19493+5804baf6 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 197 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 370 k 2023-12-14T18:14:20.373 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 364 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 107 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 94 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.4 M 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 179 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.7 M 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 3.6 M 2023-12-14T18:14:20.374 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 22 M 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 23 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 2.3 M 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 240 k 2023-12-14T18:14:20.375 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 4.6 M 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 18 M 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3905.g1faa3533.el8 ceph-noarch 15 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 24 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 137 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-14T18:14:20.376 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 473 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 6.5 M 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-14T18:14:20.377 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 45 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:18.0.0-3905.g1faa3533.el8 ceph 119 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-14T18:14:20.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-14T18:14:20.379 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-14T18:14:20.380 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2023-12-14T18:14:20.381 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql 10 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================================================== 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout:Install 129 Packages 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 16 Packages 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 205 M 2023-12-14T18:14:20.382 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-14T18:14:20.389 INFO:teuthology.orchestra.run.smithi069.stdout:(3/145): ceph-immutable-object-cache-18.0.0-390 2.2 MB/s | 165 kB 00:00 2023-12-14T18:14:20.890 INFO:teuthology.orchestra.run.smithi119.stdout:(1/145): ceph-18.0.0-3905.g1faa3533.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-12-14T18:14:20.978 INFO:teuthology.orchestra.run.smithi091.stdout:(4/145): ceph-mds-18.0.0-3905.g1faa3533.el8.x86 3.6 MB/s | 2.3 MB 00:00 2023-12-14T18:14:21.056 INFO:teuthology.orchestra.run.smithi069.stdout:(4/145): ceph-base-18.0.0-3905.g1faa3533.el8.x8 4.2 MB/s | 5.3 MB 00:01 2023-12-14T18:14:21.106 INFO:teuthology.orchestra.run.smithi069.stdout:(5/145): ceph-mds-18.0.0-3905.g1faa3533.el8.x86 3.2 MB/s | 2.3 MB 00:00 2023-12-14T18:14:21.365 INFO:teuthology.orchestra.run.smithi069.stdout:(6/145): ceph-mgr-18.0.0-3905.g1faa3533.el8.x86 5.0 MB/s | 1.5 MB 00:00 2023-12-14T18:14:21.437 INFO:teuthology.orchestra.run.smithi091.stdout:(5/145): ceph-mgr-18.0.0-3905.g1faa3533.el8.x86 3.4 MB/s | 1.5 MB 00:00 2023-12-14T18:14:21.920 INFO:teuthology.orchestra.run.smithi091.stdout:(6/145): ceph-base-18.0.0-3905.g1faa3533.el8.x8 2.6 MB/s | 5.3 MB 00:02 2023-12-14T18:14:21.999 INFO:teuthology.orchestra.run.smithi119.stdout:(2/145): ceph-fuse-18.0.0-3905.g1faa3533.el8.x8 764 kB/s | 847 kB 00:01 2023-12-14T18:14:22.334 INFO:teuthology.orchestra.run.smithi119.stdout:(3/145): ceph-immutable-object-cache-18.0.0-390 493 kB/s | 165 kB 00:00 2023-12-14T18:14:22.407 INFO:teuthology.orchestra.run.smithi119.stdout:(4/145): ceph-base-18.0.0-3905.g1faa3533.el8.x8 2.8 MB/s | 5.3 MB 00:01 2023-12-14T18:14:22.487 INFO:teuthology.orchestra.run.smithi091.stdout:(7/145): ceph-mon-18.0.0-3905.g1faa3533.el8.x86 4.4 MB/s | 4.6 MB 00:01 2023-12-14T18:14:22.916 INFO:teuthology.orchestra.run.smithi119.stdout:(5/145): ceph-mgr-18.0.0-3905.g1faa3533.el8.x86 3.0 MB/s | 1.5 MB 00:00 2023-12-14T18:14:24.058 INFO:teuthology.orchestra.run.smithi119.stdout:(6/145): ceph-mds-18.0.0-3905.g1faa3533.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-12-14T18:14:24.256 INFO:teuthology.orchestra.run.smithi069.stdout:(7/145): ceph-osd-18.0.0-3905.g1faa3533.el8.x86 6.1 MB/s | 18 MB 00:02 2023-12-14T18:14:24.358 INFO:teuthology.orchestra.run.smithi119.stdout:(7/145): ceph-mon-18.0.0-3905.g1faa3533.el8.x86 3.2 MB/s | 4.6 MB 00:01 2023-12-14T18:14:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:(8/145): ceph-common-18.0.0-3905.g1faa3533.el8. 4.7 MB/s | 22 MB 00:04 2023-12-14T18:14:24.604 INFO:teuthology.orchestra.run.smithi091.stdout:(9/145): ceph-selinux-18.0.0-3905.g1faa3533.el8 266 kB/s | 24 kB 00:00 2023-12-14T18:14:25.340 INFO:teuthology.orchestra.run.smithi069.stdout:(8/145): ceph-mon-18.0.0-3905.g1faa3533.el8.x86 1.1 MB/s | 4.6 MB 00:04 2023-12-14T18:14:25.448 INFO:teuthology.orchestra.run.smithi069.stdout:(9/145): ceph-selinux-18.0.0-3905.g1faa3533.el8 225 kB/s | 24 kB 00:00 2023-12-14T18:14:25.755 INFO:teuthology.orchestra.run.smithi091.stdout:(10/145): ceph-radosgw-18.0.0-3905.g1faa3533.el 4.0 MB/s | 13 MB 00:03 2023-12-14T18:14:25.930 INFO:teuthology.orchestra.run.smithi091.stdout:(11/145): cephfs-mirror-18.0.0-3905.g1faa3533.e 1.4 MB/s | 258 kB 00:00 2023-12-14T18:14:26.030 INFO:teuthology.orchestra.run.smithi091.stdout:(12/145): libcephfs-devel-18.0.0-3905.g1faa3533 310 kB/s | 31 kB 00:00 2023-12-14T18:14:26.330 INFO:teuthology.orchestra.run.smithi091.stdout:(13/145): libcephfs2-18.0.0-3905.g1faa3533.el8. 2.5 MB/s | 771 kB 00:00 2023-12-14T18:14:26.348 INFO:teuthology.orchestra.run.smithi069.stdout:(10/145): ceph-radosgw-18.0.0-3905.g1faa3533.el 6.2 MB/s | 13 MB 00:02 2023-12-14T18:14:26.422 INFO:teuthology.orchestra.run.smithi091.stdout:(14/145): libcephsqlite-18.0.0-3905.g1faa3533.e 1.5 MB/s | 137 kB 00:00 2023-12-14T18:14:26.465 INFO:teuthology.orchestra.run.smithi069.stdout:(11/145): cephfs-mirror-18.0.0-3905.g1faa3533.e 2.2 MB/s | 258 kB 00:00 2023-12-14T18:14:26.505 INFO:teuthology.orchestra.run.smithi091.stdout:(15/145): librados-devel-18.0.0-3905.g1faa3533. 1.6 MB/s | 139 kB 00:00 2023-12-14T18:14:26.566 INFO:teuthology.orchestra.run.smithi069.stdout:(12/145): libcephfs-devel-18.0.0-3905.g1faa3533 310 kB/s | 31 kB 00:00 2023-12-14T18:14:26.906 INFO:teuthology.orchestra.run.smithi091.stdout:(16/145): libradosstriper1-18.0.0-3905.g1faa353 1.2 MB/s | 473 kB 00:00 2023-12-14T18:14:26.958 INFO:teuthology.orchestra.run.smithi069.stdout:(13/145): libcephfs2-18.0.0-3905.g1faa3533.el8. 1.9 MB/s | 771 kB 00:00 2023-12-14T18:14:27.058 INFO:teuthology.orchestra.run.smithi069.stdout:(14/145): libcephsqlite-18.0.0-3905.g1faa3533.e 1.3 MB/s | 137 kB 00:00 2023-12-14T18:14:27.158 INFO:teuthology.orchestra.run.smithi069.stdout:(15/145): librados-devel-18.0.0-3905.g1faa3533. 1.4 MB/s | 139 kB 00:00 2023-12-14T18:14:27.358 INFO:teuthology.orchestra.run.smithi069.stdout:(16/145): libradosstriper1-18.0.0-3905.g1faa353 2.3 MB/s | 473 kB 00:00 2023-12-14T18:14:29.158 INFO:teuthology.orchestra.run.smithi119.stdout:(8/145): ceph-radosgw-18.0.0-3905.g1faa3533.el8 2.7 MB/s | 13 MB 00:04 2023-12-14T18:14:29.250 INFO:teuthology.orchestra.run.smithi119.stdout:(9/145): ceph-selinux-18.0.0-3905.g1faa3533.el8 266 kB/s | 24 kB 00:00 2023-12-14T18:14:29.633 INFO:teuthology.orchestra.run.smithi069.stdout:(17/145): librgw2-18.0.0-3905.g1faa3533.el8.x86 2.9 MB/s | 6.5 MB 00:02 2023-12-14T18:14:29.697 INFO:teuthology.orchestra.run.smithi091.stdout:(17/145): librgw2-18.0.0-3905.g1faa3533.el8.x86 2.3 MB/s | 6.5 MB 00:02 2023-12-14T18:14:29.798 INFO:teuthology.orchestra.run.smithi091.stdout:(18/145): python3-ceph-argparse-18.0.0-3905.g1f 448 kB/s | 45 kB 00:00 2023-12-14T18:14:29.873 INFO:teuthology.orchestra.run.smithi091.stdout:(19/145): python3-ceph-common-18.0.0-3905.g1faa 1.6 MB/s | 119 kB 00:00 2023-12-14T18:14:29.892 INFO:teuthology.orchestra.run.smithi069.stdout:(18/145): python3-ceph-argparse-18.0.0-3905.g1f 173 kB/s | 45 kB 00:00 2023-12-14T18:14:30.040 INFO:teuthology.orchestra.run.smithi091.stdout:(20/145): python3-cephfs-18.0.0-3905.g1faa3533. 1.2 MB/s | 197 kB 00:00 2023-12-14T18:14:30.176 INFO:teuthology.orchestra.run.smithi069.stdout:(19/145): ceph-common-18.0.0-3905.g1faa3533.el8 2.1 MB/s | 22 MB 00:10 2023-12-14T18:14:30.193 INFO:teuthology.orchestra.run.smithi069.stdout:(20/145): python3-ceph-common-18.0.0-3905.g1faa 395 kB/s | 119 kB 00:00 2023-12-14T18:14:30.206 INFO:teuthology.orchestra.run.smithi091.stdout:(21/145): python3-rados-18.0.0-3905.g1faa3533.e 2.2 MB/s | 370 kB 00:00 2023-12-14T18:14:30.390 INFO:teuthology.orchestra.run.smithi091.stdout:(22/145): python3-rbd-18.0.0-3905.g1faa3533.el8 1.9 MB/s | 364 kB 00:00 2023-12-14T18:14:30.393 INFO:teuthology.orchestra.run.smithi069.stdout:(21/145): python3-rados-18.0.0-3905.g1faa3533.e 1.8 MB/s | 370 kB 00:00 2023-12-14T18:14:30.468 INFO:teuthology.orchestra.run.smithi069.stdout:(22/145): python3-cephfs-18.0.0-3905.g1faa3533. 675 kB/s | 197 kB 00:00 2023-12-14T18:14:30.482 INFO:teuthology.orchestra.run.smithi091.stdout:(23/145): python3-rgw-18.0.0-3905.g1faa3533.el8 1.1 MB/s | 107 kB 00:00 2023-12-14T18:14:30.582 INFO:teuthology.orchestra.run.smithi091.stdout:(24/145): rbd-fuse-18.0.0-3905.g1faa3533.el8.x8 943 kB/s | 94 kB 00:00 2023-12-14T18:14:30.585 INFO:teuthology.orchestra.run.smithi069.stdout:(23/145): python3-rgw-18.0.0-3905.g1faa3533.el8 914 kB/s | 107 kB 00:00 2023-12-14T18:14:30.610 INFO:teuthology.orchestra.run.smithi069.stdout:(24/145): python3-rbd-18.0.0-3905.g1faa3533.el8 1.6 MB/s | 364 kB 00:00 2023-12-14T18:14:30.727 INFO:teuthology.orchestra.run.smithi069.stdout:(25/145): rbd-fuse-18.0.0-3905.g1faa3533.el8.x8 666 kB/s | 94 kB 00:00 2023-12-14T18:14:30.919 INFO:teuthology.orchestra.run.smithi069.stdout:(26/145): rbd-nbd-18.0.0-3905.g1faa3533.el8.x86 937 kB/s | 179 kB 00:00 2023-12-14T18:14:31.028 INFO:teuthology.orchestra.run.smithi069.stdout:(27/145): ceph-grafana-dashboards-18.0.0-3905.g 213 kB/s | 23 kB 00:00 2023-12-14T18:14:31.145 INFO:teuthology.orchestra.run.smithi069.stdout:(28/145): ceph-mgr-cephadm-18.0.0-3905.g1faa353 1.1 MB/s | 127 kB 00:00 2023-12-14T18:14:31.949 INFO:teuthology.orchestra.run.smithi091.stdout:(25/145): rbd-mirror-18.0.0-3905.g1faa3533.el8. 2.5 MB/s | 3.4 MB 00:01 2023-12-14T18:14:32.024 INFO:teuthology.orchestra.run.smithi091.stdout:(26/145): rbd-nbd-18.0.0-3905.g1faa3533.el8.x86 2.3 MB/s | 179 kB 00:00 2023-12-14T18:14:32.087 INFO:teuthology.orchestra.run.smithi069.stdout:(29/145): rbd-mirror-18.0.0-3905.g1faa3533.el8. 2.3 MB/s | 3.4 MB 00:01 2023-12-14T18:14:32.091 INFO:teuthology.orchestra.run.smithi091.stdout:(27/145): ceph-grafana-dashboards-18.0.0-3905.g 346 kB/s | 23 kB 00:00 2023-12-14T18:14:32.183 INFO:teuthology.orchestra.run.smithi091.stdout:(28/145): ceph-mgr-cephadm-18.0.0-3905.g1faa353 1.4 MB/s | 127 kB 00:00 2023-12-14T18:14:32.354 INFO:teuthology.orchestra.run.smithi069.stdout:(30/145): ceph-mgr-dashboard-18.0.0-3905.g1faa3 1.4 MB/s | 1.7 MB 00:01 2023-12-14T18:14:32.579 INFO:teuthology.orchestra.run.smithi069.stdout:(31/145): ceph-mgr-modules-core-18.0.0-3905.g1f 1.0 MB/s | 240 kB 00:00 2023-12-14T18:14:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:(32/145): ceph-mgr-rook-18.0.0-3905.g1faa3533.e 474 kB/s | 47 kB 00:00 2023-12-14T18:14:32.758 INFO:teuthology.orchestra.run.smithi119.stdout:(10/145): ceph-common-18.0.0-3905.g1faa3533.el8 1.8 MB/s | 22 MB 00:12 2023-12-14T18:14:32.779 INFO:teuthology.orchestra.run.smithi069.stdout:(33/145): ceph-prometheus-alerts-18.0.0-3905.g1 145 kB/s | 15 kB 00:00 2023-12-14T18:14:32.933 INFO:teuthology.orchestra.run.smithi091.stdout:(29/145): ceph-mgr-dashboard-18.0.0-3905.g1faa3 2.3 MB/s | 1.7 MB 00:00 2023-12-14T18:14:32.971 INFO:teuthology.orchestra.run.smithi069.stdout:(34/145): ceph-volume-18.0.0-3905.g1faa3533.el8 1.3 MB/s | 265 kB 00:00 2023-12-14T18:14:33.098 INFO:teuthology.orchestra.run.smithi069.stdout:(35/145): cephadm-18.0.0-3905.g1faa3533.el8.noa 663 kB/s | 83 kB 00:00 2023-12-14T18:14:33.100 INFO:teuthology.orchestra.run.smithi119.stdout:(11/145): cephfs-mirror-18.0.0-3905.g1faa3533.e 757 kB/s | 258 kB 00:00 2023-12-14T18:14:33.197 INFO:teuthology.orchestra.run.smithi069.stdout:(36/145): cephfs-top-18.0.0-3905.g1faa3533.el8. 182 kB/s | 18 kB 00:00 2023-12-14T18:14:33.200 INFO:teuthology.orchestra.run.smithi119.stdout:(12/145): libcephfs-devel-18.0.0-3905.g1faa3533 310 kB/s | 31 kB 00:00 2023-12-14T18:14:33.481 INFO:teuthology.orchestra.run.smithi069.stdout:(37/145): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-12-14T18:14:33.564 INFO:teuthology.orchestra.run.smithi069.stdout:(38/145): liboath-2.6.2-3.el8.x86_64.rpm 706 kB/s | 59 kB 00:00 2023-12-14T18:14:33.642 INFO:teuthology.orchestra.run.smithi091.stdout:(30/145): ceph-osd-18.0.0-3905.g1faa3533.el8.x8 1.5 MB/s | 18 MB 00:11 2023-12-14T18:14:33.656 INFO:teuthology.orchestra.run.smithi069.stdout:(39/145): libunwind-1.3.1-3.el8.x86_64.rpm 819 kB/s | 75 kB 00:00 2023-12-14T18:14:33.765 INFO:teuthology.orchestra.run.smithi069.stdout:(40/145): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-12-14T18:14:33.808 INFO:teuthology.orchestra.run.smithi119.stdout:(13/145): libcephfs2-18.0.0-3905.g1faa3533.el8. 1.2 MB/s | 771 kB 00:00 2023-12-14T18:14:33.823 INFO:teuthology.orchestra.run.smithi069.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 750 kB/s | 44 kB 00:00 2023-12-14T18:14:33.909 INFO:teuthology.orchestra.run.smithi091.stdout:(31/145): ceph-mgr-modules-core-18.0.0-3905.g1f 902 kB/s | 240 kB 00:00 2023-12-14T18:14:33.915 INFO:teuthology.orchestra.run.smithi069.stdout:(42/145): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-12-14T18:14:33.974 INFO:teuthology.orchestra.run.smithi069.stdout:(43/145): python3-cachetools-3.1.1-4.el8.noarch 567 kB/s | 33 kB 00:00 2023-12-14T18:14:34.000 INFO:teuthology.orchestra.run.smithi119.stdout:(14/145): libcephsqlite-18.0.0-3905.g1faa3533.e 717 kB/s | 137 kB 00:00 2023-12-14T18:14:34.017 INFO:teuthology.orchestra.run.smithi091.stdout:(32/145): ceph-mgr-rook-18.0.0-3905.g1faa3533.e 438 kB/s | 47 kB 00:00 2023-12-14T18:14:34.049 INFO:teuthology.orchestra.run.smithi069.stdout:(44/145): python3-certifi-2018.10.15-7.el8.noar 218 kB/s | 16 kB 00:00 2023-12-14T18:14:34.108 INFO:teuthology.orchestra.run.smithi069.stdout:(45/145): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-12-14T18:14:34.151 INFO:teuthology.orchestra.run.smithi091.stdout:(33/145): ceph-prometheus-alerts-18.0.0-3905.g1 109 kB/s | 15 kB 00:00 2023-12-14T18:14:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:(46/145): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-12-14T18:14:34.209 INFO:teuthology.orchestra.run.smithi119.stdout:(15/145): librados-devel-18.0.0-3905.g1faa3533. 667 kB/s | 139 kB 00:00 2023-12-14T18:14:34.267 INFO:teuthology.orchestra.run.smithi069.stdout:(47/145): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-12-14T18:14:34.334 INFO:teuthology.orchestra.run.smithi069.stdout:(48/145): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-12-14T18:14:34.442 INFO:teuthology.orchestra.run.smithi069.stdout:(49/145): python3-jaraco-functools-2.0-4.el8.no 163 kB/s | 18 kB 00:00 2023-12-14T18:14:34.568 INFO:teuthology.orchestra.run.smithi069.stdout:(50/145): python3-kubernetes-11.0.0-6.el8.noarc 9.3 MB/s | 1.2 MB 00:00 2023-12-14T18:14:34.626 INFO:teuthology.orchestra.run.smithi119.stdout:(16/145): libradosstriper1-18.0.0-3905.g1faa353 1.1 MB/s | 473 kB 00:00 2023-12-14T18:14:34.635 INFO:teuthology.orchestra.run.smithi069.stdout:(51/145): python3-logutils-0.3.5-11.el8.noarch. 732 kB/s | 49 kB 00:00 2023-12-14T18:14:34.680 INFO:teuthology.orchestra.run.smithi091.stdout:(34/145): ceph-volume-18.0.0-3905.g1faa3533.el8 501 kB/s | 265 kB 00:00 2023-12-14T18:14:34.769 INFO:teuthology.orchestra.run.smithi069.stdout:(52/145): ceph-mgr-diskprediction-local-18.0.0- 2.8 MB/s | 7.4 MB 00:02 2023-12-14T18:14:34.794 INFO:teuthology.orchestra.run.smithi069.stdout:(53/145): python3-more-itertools-7.2.0-3.el8.no 370 kB/s | 59 kB 00:00 2023-12-14T18:14:34.878 INFO:teuthology.orchestra.run.smithi069.stdout:(54/145): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-12-14T18:14:34.893 INFO:teuthology.orchestra.run.smithi091.stdout:(35/145): cephadm-18.0.0-3905.g1faa3533.el8.noa 392 kB/s | 83 kB 00:00 2023-12-14T18:14:34.936 INFO:teuthology.orchestra.run.smithi069.stdout:(55/145): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-12-14T18:14:34.986 INFO:teuthology.orchestra.run.smithi069.stdout:(56/145): python3-natsort-7.1.1-2.el8.noarch.rp 277 kB/s | 60 kB 00:00 2023-12-14T18:14:35.012 INFO:teuthology.orchestra.run.smithi069.stdout:(57/145): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-12-14T18:14:35.019 INFO:teuthology.orchestra.run.smithi091.stdout:(36/145): cephfs-top-18.0.0-3905.g1faa3533.el8. 144 kB/s | 18 kB 00:00 2023-12-14T18:14:35.070 INFO:teuthology.orchestra.run.smithi069.stdout:(58/145): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-12-14T18:14:35.104 INFO:teuthology.orchestra.run.smithi069.stdout:(59/145): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-12-14T18:14:35.138 INFO:teuthology.orchestra.run.smithi069.stdout:(60/145): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-12-14T18:14:35.163 INFO:teuthology.orchestra.run.smithi069.stdout:(61/145): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-12-14T18:14:35.251 INFO:teuthology.orchestra.run.smithi069.stdout:(62/145): python3-tempora-1.14.1-5.el8.noarch.r 259 kB/s | 29 kB 00:00 2023-12-14T18:14:35.277 INFO:teuthology.orchestra.run.smithi091.stdout:(37/145): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-12-14T18:14:35.280 INFO:teuthology.orchestra.run.smithi069.stdout:(63/145): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-12-14T18:14:35.324 INFO:teuthology.orchestra.run.smithi069.stdout:(64/145): python3-waitress-1.4.3-1.el8.noarch.r 3.5 MB/s | 255 kB 00:00 2023-12-14T18:14:35.336 INFO:teuthology.orchestra.run.smithi091.stdout:(38/145): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-12-14T18:14:35.372 INFO:teuthology.orchestra.run.smithi069.stdout:(65/145): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-12-14T18:14:35.395 INFO:teuthology.orchestra.run.smithi091.stdout:(39/145): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-12-14T18:14:35.398 INFO:teuthology.orchestra.run.smithi069.stdout:(66/145): python3-websocket-client-0.56.0-5.el8 812 kB/s | 61 kB 00:00 2023-12-14T18:14:35.440 INFO:teuthology.orchestra.run.smithi069.stdout:(67/145): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-12-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi069.stdout:(68/145): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-12-14T18:14:35.503 INFO:teuthology.orchestra.run.smithi091.stdout:(40/145): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-12-14T18:14:35.549 INFO:teuthology.orchestra.run.smithi069.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 928 kB/s | 70 kB 00:00 2023-12-14T18:14:35.562 INFO:teuthology.orchestra.run.smithi091.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 749 kB/s | 44 kB 00:00 2023-12-14T18:14:35.632 INFO:teuthology.orchestra.run.smithi069.stdout:(70/145): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2023-12-14T18:14:35.708 INFO:teuthology.orchestra.run.smithi069.stdout:(71/145): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-12-14T18:14:35.791 INFO:teuthology.orchestra.run.smithi069.stdout:(72/145): python3-prettytable-0.7.2-14.el8.noar 279 kB/s | 44 kB 00:00 2023-12-14T18:14:35.834 INFO:teuthology.orchestra.run.smithi069.stdout:(73/145): python3-pyasn1-modules-0.3.7-6.el8.no 877 kB/s | 110 kB 00:00 2023-12-14T18:14:35.909 INFO:teuthology.orchestra.run.smithi069.stdout:(74/145): python3-jsonpatch-1.21-2.el8.noarch.r 225 kB/s | 27 kB 00:00 2023-12-14T18:14:35.921 INFO:teuthology.orchestra.run.smithi091.stdout:(42/145): ceph-mgr-diskprediction-local-18.0.0- 2.5 MB/s | 7.4 MB 00:02 2023-12-14T18:14:35.946 INFO:teuthology.orchestra.run.smithi091.stdout:(43/145): python3-beautifulsoup4-4.6.3-2.el8.1. 483 kB/s | 185 kB 00:00 2023-12-14T18:14:35.984 INFO:teuthology.orchestra.run.smithi069.stdout:(75/145): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2023-12-14T18:14:36.004 INFO:teuthology.orchestra.run.smithi091.stdout:(44/145): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-12-14T18:14:36.009 INFO:teuthology.orchestra.run.smithi069.stdout:(76/145): python3-pyasn1-0.3.7-6.el8.noarch.rpm 721 kB/s | 126 kB 00:00 2023-12-14T18:14:36.071 INFO:teuthology.orchestra.run.smithi091.stdout:(45/145): python3-cachetools-3.1.1-4.el8.noarch 219 kB/s | 33 kB 00:00 2023-12-14T18:14:36.096 INFO:teuthology.orchestra.run.smithi091.stdout:(46/145): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-12-14T18:14:36.134 INFO:teuthology.orchestra.run.smithi069.stdout:(77/145): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2023-12-14T18:14:36.155 INFO:teuthology.orchestra.run.smithi091.stdout:(47/145): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-12-14T18:14:36.160 INFO:teuthology.orchestra.run.smithi069.stdout:(78/145): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2023-12-14T18:14:36.293 INFO:teuthology.orchestra.run.smithi069.stdout:(79/145): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-12-14T18:14:36.344 INFO:teuthology.orchestra.run.smithi069.stdout:(80/145): python3-markupsafe-0.23-19.el8.x86_64 212 kB/s | 39 kB 00:00 2023-12-14T18:14:36.427 INFO:teuthology.orchestra.run.smithi069.stdout:(81/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-12-14T18:14:36.453 INFO:teuthology.orchestra.run.smithi069.stdout:(82/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-12-14T18:14:36.553 INFO:teuthology.orchestra.run.smithi069.stdout:(83/145): uuid-1.6.2-43.el8.x86_64.rpm 511 kB/s | 64 kB 00:00 2023-12-14T18:14:36.564 INFO:teuthology.orchestra.run.smithi091.stdout:(48/145): python3-cherrypy-18.4.0-1.el8.noarch. 782 kB/s | 384 kB 00:00 2023-12-14T18:14:36.614 INFO:teuthology.orchestra.run.smithi091.stdout:(49/145): python3-jaraco-6.2-6.el8.noarch.rpm 24 kB/s | 11 kB 00:00 2023-12-14T18:14:36.636 INFO:teuthology.orchestra.run.smithi069.stdout:(84/145): python3-pyOpenSSL-19.0.0-1.el8.noarch 564 kB/s | 103 kB 00:00 2023-12-14T18:14:36.903 INFO:teuthology.orchestra.run.smithi069.stdout:(85/145): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-12-14T18:14:37.062 INFO:teuthology.orchestra.run.smithi069.stdout:(86/145): python3-scipy-1.0.0-21.module+el8.5.0 27 MB/s | 14 MB 00:00 2023-12-14T18:14:37.096 INFO:teuthology.orchestra.run.smithi069.stdout:(87/145): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2023-12-14T18:14:37.156 INFO:teuthology.orchestra.run.smithi091.stdout:(50/145): python3-kubernetes-11.0.0-6.el8.noarc 2.2 MB/s | 1.2 MB 00:00 2023-12-14T18:14:37.223 INFO:teuthology.orchestra.run.smithi091.stdout:(51/145): python3-logutils-0.3.5-11.el8.noarch. 732 kB/s | 49 kB 00:00 2023-12-14T18:14:37.246 INFO:teuthology.orchestra.run.smithi069.stdout:(88/145): python3-numpy-1.14.3-10.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-12-14T18:14:37.271 INFO:teuthology.orchestra.run.smithi069.stdout:(89/145): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2023-12-14T18:14:37.290 INFO:teuthology.orchestra.run.smithi091.stdout:(52/145): python3-more-itertools-7.2.0-3.el8.no 883 kB/s | 59 kB 00:00 2023-12-14T18:14:37.357 INFO:teuthology.orchestra.run.smithi091.stdout:(53/145): python3-natsort-7.1.1-2.el8.noarch.rp 906 kB/s | 60 kB 00:00 2023-12-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi069.stdout:(90/145): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2023-12-14T18:14:37.447 INFO:teuthology.orchestra.run.smithi069.stdout:(91/145): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-12-14T18:14:37.465 INFO:teuthology.orchestra.run.smithi091.stdout:(54/145): python3-jaraco-functools-2.0-4.el8.no 19 kB/s | 18 kB 00:00 2023-12-14T18:14:37.491 INFO:teuthology.orchestra.run.smithi091.stdout:(55/145): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-12-14T18:14:37.516 INFO:teuthology.orchestra.run.smithi091.stdout:(56/145): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-12-14T18:14:37.550 INFO:teuthology.orchestra.run.smithi091.stdout:(57/145): python3-repoze-lru-0.7-6.el8.noarch.r 574 kB/s | 34 kB 00:00 2023-12-14T18:14:37.583 INFO:teuthology.orchestra.run.smithi091.stdout:(58/145): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-12-14T18:14:37.614 INFO:teuthology.orchestra.run.smithi069.stdout:(92/145): python3-mako-1.0.6-14.el8.noarch.rpm 941 kB/s | 157 kB 00:00 2023-12-14T18:14:37.617 INFO:teuthology.orchestra.run.smithi091.stdout:(59/145): python3-rsa-4.9-2.el8.noarch.rpm 960 kB/s | 64 kB 00:00 2023-12-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi091.stdout:(60/145): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-12-14T18:14:37.667 INFO:teuthology.orchestra.run.smithi091.stdout:(61/145): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-12-14T18:14:37.693 INFO:teuthology.orchestra.run.smithi091.stdout:(62/145): python3-tempora-1.14.1-5.el8.noarch.r 497 kB/s | 29 kB 00:00 2023-12-14T18:14:37.714 INFO:teuthology.orchestra.run.smithi069.stdout:(93/145): openblas-threads-0.3.15-6.el8.x86_64. 18 MB/s | 5.2 MB 00:00 2023-12-14T18:14:37.718 INFO:teuthology.orchestra.run.smithi091.stdout:(63/145): python3-trustme-0.6.0-4.el8.noarch.rp 546 kB/s | 27 kB 00:00 2023-12-14T18:14:37.760 INFO:teuthology.orchestra.run.smithi091.stdout:(64/145): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-12-14T18:14:37.819 INFO:teuthology.orchestra.run.smithi091.stdout:(65/145): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-12-14T18:14:37.856 INFO:teuthology.orchestra.run.smithi069.stdout:(94/145): openblas-0.3.15-6.el8.x86_64.rpm 21 MB/s | 5.0 MB 00:00 2023-12-14T18:14:37.877 INFO:teuthology.orchestra.run.smithi091.stdout:(66/145): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-12-14T18:14:37.903 INFO:teuthology.orchestra.run.smithi091.stdout:(67/145): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-12-14T18:14:37.932 INFO:teuthology.orchestra.run.smithi069.stdout:(95/145): postgresql-10.23-2.module+el8.8.0+194 6.9 MB/s | 1.5 MB 00:00 2023-12-14T18:14:37.936 INFO:teuthology.orchestra.run.smithi091.stdout:(68/145): python3-zc-lockfile-2.0-2.el8.noarch. 393 kB/s | 23 kB 00:00 2023-12-14T18:14:37.962 INFO:teuthology.orchestra.run.smithi091.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-12-14T18:14:37.990 INFO:teuthology.orchestra.run.smithi069.stdout:(96/145): postgresql-contrib-10.23-2.module+el8 5.9 MB/s | 811 kB 00:00 2023-12-14T18:14:38.070 INFO:teuthology.orchestra.run.smithi091.stdout:(70/145): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-12-14T18:14:38.095 INFO:teuthology.orchestra.run.smithi091.stdout:(71/145): libverto-devel-0.3.0-5.el8.x86_64.rpm 134 kB/s | 18 kB 00:00 2023-12-14T18:14:38.173 INFO:teuthology.orchestra.run.smithi069.stdout:(97/145): postgresql-server-10.23-2.module+el8. 21 MB/s | 5.1 MB 00:00 2023-12-14T18:14:38.232 INFO:teuthology.orchestra.run.smithi069.stdout:(98/145): automake-1.16.1-8.el8.noarch.rpm 2.9 MB/s | 714 kB 00:00 2023-12-14T18:14:38.271 INFO:teuthology.orchestra.run.smithi091.stdout:(72/145): python3-jwt-1.6.1-2.el8.noarch.rpm 213 kB/s | 43 kB 00:00 2023-12-14T18:14:38.321 INFO:teuthology.orchestra.run.smithi091.stdout:(73/145): python3-oauthlib-2.1.0-1.el8.noarch.r 705 kB/s | 155 kB 00:00 2023-12-14T18:14:38.357 INFO:teuthology.orchestra.run.smithi069.stdout:(99/145): jq-1.6-7.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-12-14T18:14:38.391 INFO:teuthology.orchestra.run.smithi069.stdout:(100/145): libpq-13.11-1.el8.x86_64.rpm 912 kB/s | 198 kB 00:00 2023-12-14T18:14:38.396 INFO:teuthology.orchestra.run.smithi091.stdout:(74/145): python3-pycparser-2.14-14.el8.noarch. 871 kB/s | 109 kB 00:00 2023-12-14T18:14:38.463 INFO:teuthology.orchestra.run.smithi091.stdout:(75/145): python3-requests-oauthlib-1.0.0-1.el8 301 kB/s | 43 kB 00:00 2023-12-14T18:14:38.500 INFO:teuthology.orchestra.run.smithi069.stdout:(101/145): python3-pytz-2017.2-11.el8.noarch.rp 381 kB/s | 54 kB 00:00 2023-12-14T18:14:38.547 INFO:teuthology.orchestra.run.smithi091.stdout:(76/145): libaio-devel-0.3.112-1.el8.x86_64.rpm 124 kB/s | 19 kB 00:00 2023-12-14T18:14:38.550 INFO:teuthology.orchestra.run.smithi069.stdout:(102/145): libverto-devel-0.3.0-5.el8.x86_64.rp 112 kB/s | 18 kB 00:00 2023-12-14T18:14:38.617 INFO:teuthology.orchestra.run.smithi069.stdout:(103/145): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2023-12-14T18:14:38.622 INFO:teuthology.orchestra.run.smithi091.stdout:(77/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2023-12-14T18:14:38.667 INFO:teuthology.orchestra.run.smithi069.stdout:(104/145): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-12-14T18:14:38.705 INFO:teuthology.orchestra.run.smithi091.stdout:(78/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-12-14T18:14:38.781 INFO:teuthology.orchestra.run.smithi091.stdout:(79/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-12-14T18:14:38.784 INFO:teuthology.orchestra.run.smithi069.stdout:(105/145): python3-pycparser-2.14-14.el8.noarch 654 kB/s | 109 kB 00:00 2023-12-14T18:14:38.806 INFO:teuthology.orchestra.run.smithi091.stdout:(80/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.1 MB/s | 220 kB 00:00 2023-12-14T18:14:38.810 INFO:teuthology.orchestra.run.smithi069.stdout:(106/145): python3-requests-oauthlib-1.0.0-1.el 300 kB/s | 43 kB 00:00 2023-12-14T18:14:38.910 INFO:teuthology.orchestra.run.smithi069.stdout:(107/145): libaio-devel-0.3.112-1.el8.x86_64.rp 149 kB/s | 19 kB 00:00 2023-12-14T18:14:38.927 INFO:teuthology.orchestra.run.smithi069.stdout:(108/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 375 kB/s | 44 kB 00:00 2023-12-14T18:14:38.948 INFO:teuthology.orchestra.run.smithi091.stdout:(81/145): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-12-14T18:14:38.959 INFO:teuthology.orchestra.run.smithi119.stdout:(17/145): ceph-osd-18.0.0-3905.g1faa3533.el8.x8 1.2 MB/s | 18 MB 00:14 2023-12-14T18:14:38.990 INFO:teuthology.orchestra.run.smithi091.stdout:(82/145): keyutils-libs-devel-1.5.10-9.el8.x86_ 262 kB/s | 48 kB 00:00 2023-12-14T18:14:39.044 INFO:teuthology.orchestra.run.smithi069.stdout:(109/145): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-12-14T18:14:39.060 INFO:teuthology.orchestra.run.smithi119.stdout:(18/145): python3-ceph-argparse-18.0.0-3905.g1f 449 kB/s | 45 kB 00:00 2023-12-14T18:14:39.082 INFO:teuthology.orchestra.run.smithi091.stdout:(83/145): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 630 kB/s | 58 kB 00:00 2023-12-14T18:14:39.086 INFO:teuthology.orchestra.run.smithi069.stdout:(110/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-12-14T18:14:39.107 INFO:teuthology.orchestra.run.smithi091.stdout:(84/145): libsepol-devel-2.9-3.el8.x86_64.rpm 548 kB/s | 87 kB 00:00 2023-12-14T18:14:39.161 INFO:teuthology.orchestra.run.smithi069.stdout:(111/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-12-14T18:14:39.186 INFO:teuthology.orchestra.run.smithi069.stdout:(112/145): libselinux-devel-2.9-5.el8.x86_64.rp 2.0 MB/s | 200 kB 00:00 2023-12-14T18:14:39.224 INFO:teuthology.orchestra.run.smithi091.stdout:(85/145): libcom_err-devel-1.45.6-4.el8.x86_64. 272 kB/s | 39 kB 00:00 2023-12-14T18:14:39.291 INFO:teuthology.orchestra.run.smithi091.stdout:(86/145): openssl-devel-1.1.1k-9.el8_7.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-12-14T18:14:39.320 INFO:teuthology.orchestra.run.smithi069.stdout:(113/145): libsepol-devel-2.9-3.el8.x86_64.rpm 652 kB/s | 87 kB 00:00 2023-12-14T18:14:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:(19/145): python3-ceph-common-18.0.0-3905.g1faa 432 kB/s | 119 kB 00:00 2023-12-14T18:14:39.345 INFO:teuthology.orchestra.run.smithi069.stdout:(114/145): keyutils-libs-devel-1.5.10-9.el8.x86 262 kB/s | 48 kB 00:00 2023-12-14T18:14:39.383 INFO:teuthology.orchestra.run.smithi091.stdout:(87/145): fuse-2.9.7-17.el8.x86_64.rpm 524 kB/s | 83 kB 00:00 2023-12-14T18:14:39.425 INFO:teuthology.orchestra.run.smithi091.stdout:(88/145): libgfortran-8.5.0-20.el8.x86_64.rpm 4.7 MB/s | 645 kB 00:00 2023-12-14T18:14:39.445 INFO:teuthology.orchestra.run.smithi069.stdout:(115/145): libcom_err-devel-1.45.6-4.el8.x86_64 386 kB/s | 39 kB 00:00 2023-12-14T18:14:39.479 INFO:teuthology.orchestra.run.smithi069.stdout:(116/145): zlib-devel-1.2.11-18.el8_5.x86_64.rp 363 kB/s | 58 kB 00:00 2023-12-14T18:14:39.509 INFO:teuthology.orchestra.run.smithi091.stdout:(89/145): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-12-14T18:14:39.561 INFO:teuthology.orchestra.run.smithi091.stdout:(90/145): libuuid-devel-2.32.1-43.el8.x86_64.rp 735 kB/s | 100 kB 00:00 2023-12-14T18:14:39.671 INFO:teuthology.orchestra.run.smithi069.stdout:(117/145): openssl-devel-1.1.1k-9.el8_7.x86_64. 10 MB/s | 2.3 MB 00:00 2023-12-14T18:14:39.703 INFO:teuthology.orchestra.run.smithi091.stdout:(91/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 238 kB 00:00 2023-12-14T18:14:39.713 INFO:teuthology.orchestra.run.smithi069.stdout:(118/145): fuse-2.9.7-17.el8.x86_64.rpm 356 kB/s | 83 kB 00:00 2023-12-14T18:14:39.762 INFO:teuthology.orchestra.run.smithi091.stdout:(92/145): python3-cryptography-3.2.1-6.el8.x86_ 2.7 MB/s | 559 kB 00:00 2023-12-14T18:14:39.813 INFO:teuthology.orchestra.run.smithi069.stdout:(119/145): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-12-14T18:14:39.816 INFO:teuthology.orchestra.run.smithi119.stdout:(20/145): python3-cephfs-18.0.0-3905.g1faa3533. 410 kB/s | 197 kB 00:00 2023-12-14T18:14:39.829 INFO:teuthology.orchestra.run.smithi091.stdout:(93/145): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 579 kB/s | 73 kB 00:00 2023-12-14T18:14:39.847 INFO:teuthology.orchestra.run.smithi069.stdout:(120/145): libgfortran-8.5.0-20.el8.x86_64.rpm 3.6 MB/s | 645 kB 00:00 2023-12-14T18:14:39.854 INFO:teuthology.orchestra.run.smithi091.stdout:(94/145): NetworkManager-initscripts-updown-1.4 1.5 MB/s | 143 kB 00:00 2023-12-14T18:14:39.972 INFO:teuthology.orchestra.run.smithi069.stdout:(121/145): libuuid-devel-2.32.1-43.el8.x86_64.r 629 kB/s | 100 kB 00:00 2023-12-14T18:14:39.997 INFO:teuthology.orchestra.run.smithi069.stdout:(122/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2023-12-14T18:14:40.090 INFO:teuthology.orchestra.run.smithi069.stdout:(123/145): python3-cryptography-3.2.1-6.el8.x86 4.7 MB/s | 559 kB 00:00 2023-12-14T18:14:40.104 INFO:teuthology.orchestra.run.smithi091.stdout:(95/145): elfutils-libelf-devel-0.189-3.el8.x86 224 kB/s | 62 kB 00:00 2023-12-14T18:14:40.106 INFO:teuthology.orchestra.run.smithi069.stdout:(124/145): xfsprogs-devel-5.0.0-12.el8.x86_64.r 668 kB/s | 73 kB 00:00 2023-12-14T18:14:40.165 INFO:teuthology.orchestra.run.smithi069.stdout:(125/145): NetworkManager-initscripts-updown-1. 1.9 MB/s | 143 kB 00:00 2023-12-14T18:14:40.171 INFO:teuthology.orchestra.run.smithi091.stdout:(96/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 148 kB/s | 47 kB 00:00 2023-12-14T18:14:40.207 INFO:teuthology.orchestra.run.smithi069.stdout:(126/145): elfutils-libelf-devel-0.189-3.el8.x8 616 kB/s | 62 kB 00:00 2023-12-14T18:14:40.230 INFO:teuthology.orchestra.run.smithi091.stdout:(97/145): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 4.4 MB/s | 562 kB 00:00 2023-12-14T18:14:40.249 INFO:teuthology.orchestra.run.smithi069.stdout:(127/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-12-14T18:14:40.288 INFO:teuthology.orchestra.run.smithi091.stdout:(98/145): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2023-12-14T18:14:40.355 INFO:teuthology.orchestra.run.smithi091.stdout:(99/145): python3-prettytable-0.7.2-14.el8.noar 351 kB/s | 44 kB 00:00 2023-12-14T18:14:40.431 INFO:teuthology.orchestra.run.smithi091.stdout:(100/145): python3-pyasn1-modules-0.3.7-6.el8.n 775 kB/s | 110 kB 00:00 2023-12-14T18:14:40.481 INFO:teuthology.orchestra.run.smithi091.stdout:(101/145): python3-jsonpatch-1.21-2.el8.noarch. 212 kB/s | 27 kB 00:00 2023-12-14T18:14:40.539 INFO:teuthology.orchestra.run.smithi091.stdout:(102/145): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2023-12-14T18:14:40.588 INFO:teuthology.orchestra.run.smithi069.stdout:(128/145): krb5-devel-1.18.2-26.el8_9.x86_64.rp 1.4 MB/s | 562 kB 00:00 2023-12-14T18:14:40.618 INFO:teuthology.orchestra.run.smithi119.stdout:(21/145): python3-rados-18.0.0-3905.g1faa3533.e 461 kB/s | 370 kB 00:00 2023-12-14T18:14:40.648 INFO:teuthology.orchestra.run.smithi091.stdout:(103/145): python3-werkzeug-0.12.2-4.el8.noarch 2.7 MB/s | 457 kB 00:00 2023-12-14T18:14:40.682 INFO:teuthology.orchestra.run.smithi091.stdout:(104/145): bison-3.0.4-10.el8.x86_64.rpm 4.7 MB/s | 688 kB 00:00 2023-12-14T18:14:40.790 INFO:teuthology.orchestra.run.smithi091.stdout:(105/145): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-12-14T18:14:40.899 INFO:teuthology.orchestra.run.smithi091.stdout:(106/145): libtool-2.4.6-25.el8.x86_64.rpm 3.2 MB/s | 709 kB 00:00 2023-12-14T18:14:40.924 INFO:teuthology.orchestra.run.smithi091.stdout:(107/145): python3-markupsafe-0.23-19.el8.x86_6 291 kB/s | 39 kB 00:00 2023-12-14T18:14:40.991 INFO:teuthology.orchestra.run.smithi091.stdout:(108/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-12-14T18:14:41.034 INFO:teuthology.orchestra.run.smithi091.stdout:(109/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-12-14T18:14:41.142 INFO:teuthology.orchestra.run.smithi091.stdout:(110/145): uuid-1.6.2-43.el8.x86_64.rpm 426 kB/s | 64 kB 00:00 2023-12-14T18:14:41.167 INFO:teuthology.orchestra.run.smithi091.stdout:(111/145): python3-pyOpenSSL-19.0.0-1.el8.noarc 783 kB/s | 103 kB 00:00 2023-12-14T18:14:41.343 INFO:teuthology.orchestra.run.smithi119.stdout:(22/145): python3-rbd-18.0.0-3905.g1faa3533.el8 503 kB/s | 364 kB 00:00 2023-12-14T18:14:41.400 INFO:teuthology.orchestra.run.smithi091.stdout:(112/145): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-12-14T18:14:41.444 INFO:teuthology.orchestra.run.smithi119.stdout:(23/145): librgw2-18.0.0-3905.g1faa3533.el8.x86 979 kB/s | 6.5 MB 00:06 2023-12-14T18:14:41.617 INFO:teuthology.orchestra.run.smithi091.stdout:(113/145): python3-scipy-1.0.0-21.module+el8.5. 29 MB/s | 14 MB 00:00 2023-12-14T18:14:41.644 INFO:teuthology.orchestra.run.smithi119.stdout:(24/145): python3-rgw-18.0.0-3905.g1faa3533.el8 355 kB/s | 107 kB 00:00 2023-12-14T18:14:41.651 INFO:teuthology.orchestra.run.smithi091.stdout:(114/145): python3-jinja2-2.10.1-3.el8.noarch.r 2.1 MB/s | 538 kB 00:00 2023-12-14T18:14:41.661 INFO:teuthology.orchestra.run.smithi119.stdout:(25/145): rbd-fuse-18.0.0-3905.g1faa3533.el8.x8 436 kB/s | 94 kB 00:00 2023-12-14T18:14:41.760 INFO:teuthology.orchestra.run.smithi091.stdout:(115/145): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-12-14T18:14:41.860 INFO:teuthology.orchestra.run.smithi091.stdout:(116/145): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-12-14T18:14:41.885 INFO:teuthology.orchestra.run.smithi091.stdout:(117/145): python3-numpy-f2py-1.14.3-10.el8.x86 1.8 MB/s | 225 kB 00:00 2023-12-14T18:14:41.961 INFO:teuthology.orchestra.run.smithi119.stdout:(26/145): rbd-nbd-18.0.0-3905.g1faa3533.el8.x86 599 kB/s | 179 kB 00:00 2023-12-14T18:14:42.002 INFO:teuthology.orchestra.run.smithi091.stdout:(118/145): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-12-14T18:14:42.087 INFO:teuthology.orchestra.run.smithi119.stdout:(27/145): ceph-grafana-dashboards-18.0.0-3905.g 184 kB/s | 23 kB 00:00 2023-12-14T18:14:42.119 INFO:teuthology.orchestra.run.smithi091.stdout:(119/145): openblas-threads-0.3.15-6.el8.x86_64 22 MB/s | 5.2 MB 00:00 2023-12-14T18:14:42.162 INFO:teuthology.orchestra.run.smithi091.stdout:(120/145): python3-mako-1.0.6-14.el8.noarch.rpm 990 kB/s | 157 kB 00:00 2023-12-14T18:14:42.304 INFO:teuthology.orchestra.run.smithi091.stdout:(121/145): openblas-0.3.15-6.el8.x86_64.rpm 27 MB/s | 5.0 MB 00:00 2023-12-14T18:14:42.312 INFO:teuthology.orchestra.run.smithi119.stdout:(28/145): ceph-mgr-cephadm-18.0.0-3905.g1faa353 566 kB/s | 127 kB 00:00 2023-12-14T18:14:42.353 INFO:teuthology.orchestra.run.smithi091.stdout:(122/145): postgresql-10.23-2.module+el8.8.0+19 7.8 MB/s | 1.5 MB 00:00 2023-12-14T18:14:42.483 INFO:teuthology.orchestra.run.smithi069.stdout:(129/145): librados2-18.0.0-3905.g1faa3533.el8. 1.6 MB/s | 3.7 MB 00:02 2023-12-14T18:14:42.487 INFO:teuthology.orchestra.run.smithi091.stdout:(123/145): postgresql-contrib-10.23-2.module+el 4.3 MB/s | 811 kB 00:00 2023-12-14T18:14:42.596 INFO:teuthology.orchestra.run.smithi091.stdout:(124/145): postgresql-server-10.23-2.module+el8 21 MB/s | 5.1 MB 00:00 2023-12-14T18:14:42.600 INFO:teuthology.orchestra.run.smithi069.stdout:(130/145): openssl-1.1.1k-9.el8_7.x86_64.rpm 6.0 MB/s | 710 kB 00:00 2023-12-14T18:14:42.630 INFO:teuthology.orchestra.run.smithi091.stdout:(125/145): automake-1.16.1-8.el8.noarch.rpm 4.9 MB/s | 714 kB 00:00 2023-12-14T18:14:42.696 INFO:teuthology.orchestra.run.smithi091.stdout:(126/145): libpq-13.11-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-12-14T18:14:42.755 INFO:teuthology.orchestra.run.smithi091.stdout:(127/145): jq-1.6-7.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-12-14T18:14:42.812 INFO:teuthology.orchestra.run.smithi069.stdout:(131/145): openssl-libs-1.1.1k-9.el8_7.x86_64.r 6.9 MB/s | 1.5 MB 00:00 2023-12-14T18:14:42.855 INFO:teuthology.orchestra.run.smithi091.stdout:(128/145): python3-pytz-2017.2-11.el8.noarch.rp 342 kB/s | 54 kB 00:00 2023-12-14T18:14:42.950 INFO:teuthology.orchestra.run.smithi069.stdout:(132/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-12-14T18:14:43.109 INFO:teuthology.orchestra.run.smithi069.stdout:(133/145): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2023-12-14T18:14:43.217 INFO:teuthology.orchestra.run.smithi069.stdout:(134/145): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 237 kB 00:00 2023-12-14T18:14:43.377 INFO:teuthology.orchestra.run.smithi069.stdout:(135/145): libsmartcols-2.32.1-43.el8.x86_64.rp 1.1 MB/s | 179 kB 00:00 2023-12-14T18:14:43.527 INFO:teuthology.orchestra.run.smithi069.stdout:(136/145): libuuid-2.32.1-43.el8.x86_64.rpm 661 kB/s | 99 kB 00:00 2023-12-14T18:14:43.752 INFO:teuthology.orchestra.run.smithi069.stdout:(137/145): librbd1-18.0.0-3905.g1faa3533.el8.x8 1.1 MB/s | 3.6 MB 00:03 2023-12-14T18:14:43.796 INFO:teuthology.orchestra.run.smithi119.stdout:(29/145): ceph-test-18.0.0-3905.g1faa3533.el8.x 2.8 MB/s | 41 MB 00:14 2023-12-14T18:14:43.827 INFO:teuthology.orchestra.run.smithi069.stdout:(138/145): util-linux-2.32.1-43.el8.x86_64.rpm 8.3 MB/s | 2.5 MB 00:00 2023-12-14T18:14:43.855 INFO:teuthology.orchestra.run.smithi091.stdout:(129/145): librados2-18.0.0-3905.g1faa3533.el8. 3.3 MB/s | 3.7 MB 00:01 2023-12-14T18:14:43.911 INFO:teuthology.orchestra.run.smithi069.stdout:(139/145): util-linux-user-2.32.1-43.el8.x86_64 648 kB/s | 103 kB 00:00 2023-12-14T18:14:43.945 INFO:teuthology.orchestra.run.smithi069.stdout:(140/145): xfsdump-3.1.8-6.el8.x86_64.rpm 2.8 MB/s | 333 kB 00:00 2023-12-14T18:14:44.056 INFO:teuthology.orchestra.run.smithi091.stdout:(130/145): openssl-1.1.1k-9.el8_7.x86_64.rpm 3.5 MB/s | 710 kB 00:00 2023-12-14T18:14:44.061 INFO:teuthology.orchestra.run.smithi069.stdout:(141/145): iproute-6.2.0-5.el8_9.x86_64.rpm 5.6 MB/s | 854 kB 00:00 2023-12-14T18:14:44.087 INFO:teuthology.orchestra.run.smithi069.stdout:(142/145): libblkid-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-12-14T18:14:44.195 INFO:teuthology.orchestra.run.smithi069.stdout:(143/145): libfdisk-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 254 kB 00:00 2023-12-14T18:14:44.231 INFO:teuthology.orchestra.run.smithi091.stdout:(131/145): openssl-libs-1.1.1k-9.el8_7.x86_64.r 8.4 MB/s | 1.5 MB 00:00 2023-12-14T18:14:44.254 INFO:teuthology.orchestra.run.smithi069.stdout:(144/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2023-12-14T18:14:44.373 INFO:teuthology.orchestra.run.smithi091.stdout:(132/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-12-14T18:14:44.531 INFO:teuthology.orchestra.run.smithi091.stdout:(133/145): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2023-12-14T18:14:44.949 INFO:teuthology.orchestra.run.smithi091.stdout:(134/145): ceph-test-18.0.0-3905.g1faa3533.el8. 2.0 MB/s | 41 MB 00:20 2023-12-14T18:14:44.982 INFO:teuthology.orchestra.run.smithi091.stdout:(135/145): libmount-2.32.1-43.el8.x86_64.rpm 525 kB/s | 237 kB 00:00 2023-12-14T18:14:45.057 INFO:teuthology.orchestra.run.smithi091.stdout:(136/145): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-12-14T18:14:45.187 INFO:teuthology.orchestra.run.smithi119.stdout:(30/145): ceph-mgr-diskprediction-local-18.0.0- 5.3 MB/s | 7.4 MB 00:01 2023-12-14T18:14:45.221 INFO:teuthology.orchestra.run.smithi119.stdout:(31/145): ceph-mgr-dashboard-18.0.0-3905.g1faa3 601 kB/s | 1.7 MB 00:02 2023-12-14T18:14:45.271 INFO:teuthology.orchestra.run.smithi119.stdout:(32/145): ceph-mgr-modules-core-18.0.0-3905.g1f 2.8 MB/s | 240 kB 00:00 2023-12-14T18:14:45.288 INFO:teuthology.orchestra.run.smithi119.stdout:(33/145): ceph-mgr-rook-18.0.0-3905.g1faa3533.e 712 kB/s | 47 kB 00:00 2023-12-14T18:14:45.305 INFO:teuthology.orchestra.run.smithi119.stdout:(34/145): ceph-prometheus-alerts-18.0.0-3905.g1 436 kB/s | 15 kB 00:00 2023-12-14T18:14:45.341 INFO:teuthology.orchestra.run.smithi091.stdout:(137/145): libuuid-2.32.1-43.el8.x86_64.rpm 276 kB/s | 99 kB 00:00 2023-12-14T18:14:45.355 INFO:teuthology.orchestra.run.smithi119.stdout:(35/145): cephadm-18.0.0-3905.g1faa3533.el8.noa 1.6 MB/s | 83 kB 00:00 2023-12-14T18:14:45.389 INFO:teuthology.orchestra.run.smithi119.stdout:(36/145): cephfs-top-18.0.0-3905.g1faa3533.el8. 541 kB/s | 18 kB 00:00 2023-12-14T18:14:45.506 INFO:teuthology.orchestra.run.smithi119.stdout:(37/145): ceph-volume-18.0.0-3905.g1faa3533.el8 1.2 MB/s | 265 kB 00:00 2023-12-14T18:14:45.677 INFO:teuthology.orchestra.run.smithi091.stdout:(138/145): librbd1-18.0.0-3905.g1faa3533.el8.x8 1.3 MB/s | 3.6 MB 00:02 2023-12-14T18:14:45.708 INFO:teuthology.orchestra.run.smithi091.stdout:(139/145): util-linux-user-2.32.1-43.el8.x86_64 280 kB/s | 103 kB 00:00 2023-12-14T18:14:45.775 INFO:teuthology.orchestra.run.smithi091.stdout:(140/145): util-linux-2.32.1-43.el8.x86_64.rpm 3.5 MB/s | 2.5 MB 00:00 2023-12-14T18:14:45.822 INFO:teuthology.orchestra.run.smithi119.stdout:(38/145): rbd-mirror-18.0.0-3905.g1faa3533.el8. 845 kB/s | 3.4 MB 00:04 2023-12-14T18:14:45.867 INFO:teuthology.orchestra.run.smithi091.stdout:(141/145): xfsdump-3.1.8-6.el8.x86_64.rpm 1.7 MB/s | 333 kB 00:00 2023-12-14T18:14:45.873 INFO:teuthology.orchestra.run.smithi119.stdout:(39/145): liboath-2.6.2-3.el8.x86_64.rpm 160 kB/s | 59 kB 00:00 2023-12-14T18:14:45.900 INFO:teuthology.orchestra.run.smithi091.stdout:(142/145): iproute-6.2.0-5.el8_9.x86_64.rpm 4.5 MB/s | 854 kB 00:00 2023-12-14T18:14:45.951 INFO:teuthology.orchestra.run.smithi091.stdout:(143/145): libblkid-2.32.1-43.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-12-14T18:14:45.973 INFO:teuthology.orchestra.run.smithi119.stdout:(40/145): gperftools-libs-2.7-9.el8.x86_64.rpm 524 kB/s | 306 kB 00:00 2023-12-14T18:14:46.051 INFO:teuthology.orchestra.run.smithi091.stdout:(144/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.1 MB/s | 1.1 MB 00:00 2023-12-14T18:14:46.090 INFO:teuthology.orchestra.run.smithi119.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-12-14T18:14:46.096 INFO:teuthology.orchestra.run.smithi091.stdout:(145/145): libfdisk-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 254 kB 00:00 2023-12-14T18:14:46.101 INFO:teuthology.orchestra.run.smithi091.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:14:46.101 INFO:teuthology.orchestra.run.smithi091.stdout:Total 7.7 MB/s | 205 MB 00:26 2023-12-14T18:14:46.224 INFO:teuthology.orchestra.run.smithi119.stdout:(42/145): libunwind-1.3.1-3.el8.x86_64.rpm 187 kB/s | 75 kB 00:00 2023-12-14T18:14:46.240 INFO:teuthology.orchestra.run.smithi119.stdout:(43/145): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-12-14T18:14:46.282 INFO:teuthology.orchestra.run.smithi119.stdout:(44/145): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-12-14T18:14:46.383 INFO:teuthology.orchestra.run.smithi119.stdout:(45/145): python3-certifi-2018.10.15-7.el8.noar 115 kB/s | 16 kB 00:00 2023-12-14T18:14:46.408 INFO:teuthology.orchestra.run.smithi119.stdout:(46/145): python3-cachetools-3.1.1-4.el8.noarch 179 kB/s | 33 kB 00:00 2023-12-14T18:14:46.442 INFO:teuthology.orchestra.run.smithi119.stdout:(47/145): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-12-14T18:14:46.623 INFO:teuthology.orchestra.run.smithi119.stdout:(48/145): python3-jaraco-6.2-6.el8.noarch.rpm 61 kB/s | 11 kB 00:00 2023-12-14T18:14:46.726 INFO:teuthology.orchestra.run.smithi119.stdout:(49/145): python3-jaraco-functools-2.0-4.el8.no 172 kB/s | 18 kB 00:00 2023-12-14T18:14:46.751 INFO:teuthology.orchestra.run.smithi119.stdout:(50/145): python3-google-auth-1.1.1-10.el8.noar 237 kB/s | 81 kB 00:00 2023-12-14T18:14:46.776 INFO:teuthology.orchestra.run.smithi119.stdout:(51/145): python3-cherrypy-18.4.0-1.el8.noarch. 979 kB/s | 384 kB 00:00 2023-12-14T18:14:46.868 INFO:teuthology.orchestra.run.smithi119.stdout:(52/145): python3-logutils-0.3.5-11.el8.noarch. 416 kB/s | 49 kB 00:00 2023-12-14T18:14:46.935 INFO:teuthology.orchestra.run.smithi119.stdout:(53/145): python3-more-itertools-7.2.0-3.el8.no 370 kB/s | 59 kB 00:00 2023-12-14T18:14:46.985 INFO:teuthology.orchestra.run.smithi119.stdout:(54/145): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-12-14T18:14:47.043 INFO:teuthology.orchestra.run.smithi119.stdout:(55/145): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2023-12-14T18:14:47.094 INFO:teuthology.orchestra.run.smithi119.stdout:(56/145): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-12-14T18:14:47.145 INFO:teuthology.orchestra.run.smithi119.stdout:(57/145): python3-repoze-lru-0.7-6.el8.noarch.r 333 kB/s | 34 kB 00:00 2023-12-14T18:14:47.156 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction check 2023-12-14T18:14:47.245 INFO:teuthology.orchestra.run.smithi119.stdout:(58/145): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-12-14T18:14:47.270 INFO:teuthology.orchestra.run.smithi119.stdout:(59/145): python3-pecan-1.3.2-9.el8.noarch.rpm 845 kB/s | 283 kB 00:00 2023-12-14T18:14:47.295 INFO:teuthology.orchestra.run.smithi119.stdout:(60/145): python3-rsa-4.9-2.el8.noarch.rpm 427 kB/s | 64 kB 00:00 2023-12-14T18:14:47.346 INFO:teuthology.orchestra.run.smithi119.stdout:(61/145): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-12-14T18:14:47.379 INFO:teuthology.orchestra.run.smithi119.stdout:(62/145): python3-singledispatch-3.4.0.3-18.el8 219 kB/s | 24 kB 00:00 2023-12-14T18:14:47.404 INFO:teuthology.orchestra.run.smithi119.stdout:(63/145): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-12-14T18:14:47.476 INFO:teuthology.orchestra.run.smithi119.stdout:(64/145): python3-trustme-0.6.0-4.el8.noarch.rp 212 kB/s | 27 kB 00:00 2023-12-14T18:14:47.530 INFO:teuthology.orchestra.run.smithi119.stdout:(65/145): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-12-14T18:14:47.549 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction check succeeded. 2023-12-14T18:14:47.549 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction test 2023-12-14T18:14:47.563 INFO:teuthology.orchestra.run.smithi119.stdout:(66/145): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-12-14T18:14:47.589 INFO:teuthology.orchestra.run.smithi119.stdout:(67/145): python3-websocket-client-0.56.0-5.el8 542 kB/s | 61 kB 00:00 2023-12-14T18:14:47.639 INFO:teuthology.orchestra.run.smithi119.stdout:(68/145): python3-webtest-2.0.33-1.el8.noarch.r 785 kB/s | 85 kB 00:00 2023-12-14T18:14:47.664 INFO:teuthology.orchestra.run.smithi119.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-12-14T18:14:47.681 INFO:teuthology.orchestra.run.smithi119.stdout:(70/145): python3-zc-lockfile-2.0-2.el8.noarch. 195 kB/s | 23 kB 00:00 2023-12-14T18:14:47.912 INFO:teuthology.orchestra.run.smithi119.stdout:(71/145): python3-jwt-1.6.1-2.el8.noarch.rpm 185 kB/s | 43 kB 00:00 2023-12-14T18:14:47.948 INFO:teuthology.orchestra.run.smithi119.stdout:(72/145): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2023-12-14T18:14:47.998 INFO:teuthology.orchestra.run.smithi119.stdout:(73/145): libverto-devel-0.3.0-5.el8.x86_64.rpm 54 kB/s | 18 kB 00:00 2023-12-14T18:14:48.066 INFO:teuthology.orchestra.run.smithi119.stdout:(74/145): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-12-14T18:14:48.083 INFO:teuthology.orchestra.run.smithi119.stdout:(75/145): python3-pycparser-2.14-14.el8.noarch. 814 kB/s | 109 kB 00:00 2023-12-14T18:14:48.125 INFO:teuthology.orchestra.run.smithi119.stdout:(76/145): python3-requests-oauthlib-1.0.0-1.el8 339 kB/s | 43 kB 00:00 2023-12-14T18:14:48.225 INFO:teuthology.orchestra.run.smithi119.stdout:(77/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 309 kB/s | 44 kB 00:00 2023-12-14T18:14:48.292 INFO:teuthology.orchestra.run.smithi119.stdout:(78/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2023-12-14T18:14:48.350 INFO:teuthology.orchestra.run.smithi119.stdout:(79/145): libaio-devel-0.3.112-1.el8.x86_64.rpm 66 kB/s | 19 kB 00:00 2023-12-14T18:14:48.376 INFO:teuthology.orchestra.run.smithi119.stdout:(80/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-12-14T18:14:48.635 INFO:teuthology.orchestra.run.smithi119.stdout:(81/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 644 kB/s | 220 kB 00:00 2023-12-14T18:14:48.685 INFO:teuthology.orchestra.run.smithi119.stdout:(82/145): libselinux-devel-2.9-5.el8.x86_64.rpm 599 kB/s | 200 kB 00:00 2023-12-14T18:14:48.776 INFO:teuthology.orchestra.run.smithi119.stdout:(83/145): keyutils-libs-devel-1.5.10-9.el8.x86_ 120 kB/s | 48 kB 00:00 2023-12-14T18:14:48.793 INFO:teuthology.orchestra.run.smithi119.stdout:(84/145): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 531 kB/s | 58 kB 00:00 2023-12-14T18:14:48.810 INFO:teuthology.orchestra.run.smithi119.stdout:(85/145): libsepol-devel-2.9-3.el8.x86_64.rpm 495 kB/s | 87 kB 00:00 2023-12-14T18:14:48.860 INFO:teuthology.orchestra.run.smithi119.stdout:(86/145): libcom_err-devel-1.45.6-4.el8.x86_64. 461 kB/s | 39 kB 00:00 2023-12-14T18:14:48.927 INFO:teuthology.orchestra.run.smithi119.stdout:(87/145): openssl-devel-1.1.1k-9.el8_7.x86_64.r 17 MB/s | 2.3 MB 00:00 2023-12-14T18:14:49.012 INFO:teuthology.orchestra.run.smithi119.stdout:(88/145): libgfortran-8.5.0-20.el8.x86_64.rpm 4.2 MB/s | 645 kB 00:00 2023-12-14T18:14:49.045 INFO:teuthology.orchestra.run.smithi119.stdout:(89/145): fuse-2.9.7-17.el8.x86_64.rpm 355 kB/s | 83 kB 00:00 2023-12-14T18:14:49.061 INFO:teuthology.orchestra.run.smithi119.stdout:(90/145): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-12-14T18:14:49.068 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction test succeeded. 2023-12-14T18:14:49.079 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction 2023-12-14T18:14:49.262 INFO:teuthology.orchestra.run.smithi119.stdout:(91/145): python3-cryptography-3.2.1-6.el8.x86_ 2.7 MB/s | 559 kB 00:00 2023-12-14T18:14:49.287 INFO:teuthology.orchestra.run.smithi119.stdout:(92/145): libuuid-devel-2.32.1-43.el8.x86_64.rp 361 kB/s | 100 kB 00:00 2023-12-14T18:14:49.363 INFO:teuthology.orchestra.run.smithi119.stdout:(93/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 750 kB/s | 238 kB 00:00 2023-12-14T18:14:49.379 INFO:teuthology.orchestra.run.smithi119.stdout:(94/145): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 620 kB/s | 73 kB 00:00 2023-12-14T18:14:49.396 INFO:teuthology.orchestra.run.smithi119.stdout:(95/145): NetworkManager-initscripts-updown-1.4 1.3 MB/s | 143 kB 00:00 2023-12-14T18:14:49.555 INFO:teuthology.orchestra.run.smithi119.stdout:(96/145): elfutils-libelf-devel-0.189-3.el8.x86 321 kB/s | 62 kB 00:00 2023-12-14T18:14:49.580 INFO:teuthology.orchestra.run.smithi119.stdout:(97/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 234 kB/s | 47 kB 00:00 2023-12-14T18:14:49.647 INFO:teuthology.orchestra.run.smithi119.stdout:(98/145): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.2 MB/s | 562 kB 00:00 2023-12-14T18:14:49.672 INFO:teuthology.orchestra.run.smithi119.stdout:(99/145): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2023-12-14T18:14:49.714 INFO:teuthology.orchestra.run.smithi119.stdout:(100/145): python3-pyasn1-modules-0.3.7-6.el8.n 1.6 MB/s | 110 kB 00:00 2023-12-14T18:14:49.781 INFO:teuthology.orchestra.run.smithi119.stdout:(101/145): python3-prettytable-0.7.2-14.el8.noa 219 kB/s | 44 kB 00:00 2023-12-14T18:14:49.806 INFO:teuthology.orchestra.run.smithi119.stdout:(102/145): python3-jsonpatch-1.21-2.el8.noarch. 198 kB/s | 27 kB 00:00 2023-12-14T18:14:49.873 INFO:teuthology.orchestra.run.smithi119.stdout:(103/145): python3-pyasn1-0.3.7-6.el8.noarch.rp 796 kB/s | 126 kB 00:00 2023-12-14T18:14:49.949 INFO:teuthology.orchestra.run.smithi119.stdout:(104/145): python3-werkzeug-0.12.2-4.el8.noarch 2.7 MB/s | 457 kB 00:00 2023-12-14T18:14:50.039 INFO:teuthology.orchestra.run.smithi119.stdout:(105/145): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2023-12-14T18:14:50.083 INFO:teuthology.orchestra.run.smithi119.stdout:(106/145): flex-2.6.1-9.el8.x86_64.rpm 1.5 MB/s | 320 kB 00:00 2023-12-14T18:14:50.133 INFO:teuthology.orchestra.run.smithi119.stdout:(107/145): libtool-2.4.6-25.el8.x86_64.rpm 3.8 MB/s | 709 kB 00:00 2023-12-14T18:14:50.184 INFO:teuthology.orchestra.run.smithi119.stdout:(108/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-12-14T18:14:50.217 INFO:teuthology.orchestra.run.smithi119.stdout:(109/145): python3-markupsafe-0.23-19.el8.x86_6 218 kB/s | 39 kB 00:00 2023-12-14T18:14:50.267 INFO:teuthology.orchestra.run.smithi119.stdout:(110/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-12-14T18:14:50.351 INFO:teuthology.orchestra.run.smithi119.stdout:(111/145): python3-pyOpenSSL-19.0.0-1.el8.noarc 774 kB/s | 103 kB 00:00 2023-12-14T18:14:50.385 INFO:teuthology.orchestra.run.smithi119.stdout:(112/145): uuid-1.6.2-43.el8.x86_64.rpm 318 kB/s | 64 kB 00:00 2023-12-14T18:14:50.660 INFO:teuthology.orchestra.run.smithi119.stdout:(113/145): python3-scipy-1.0.0-21.module+el8.5. 35 MB/s | 14 MB 00:00 2023-12-14T18:14:50.785 INFO:teuthology.orchestra.run.smithi119.stdout:(114/145): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-12-14T18:14:50.835 INFO:teuthology.orchestra.run.smithi119.stdout:(115/145): python3-jinja2-2.10.1-3.el8.noarch.r 1.2 MB/s | 538 kB 00:00 2023-12-14T18:14:50.944 INFO:teuthology.orchestra.run.smithi119.stdout:(116/145): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2023-12-14T18:14:51.127 INFO:teuthology.orchestra.run.smithi119.stdout:(117/145): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-12-14T18:14:51.144 INFO:teuthology.orchestra.run.smithi119.stdout:(118/145): python3-numpy-f2py-1.14.3-10.el8.x86 729 kB/s | 225 kB 00:00 2023-12-14T18:14:51.228 INFO:teuthology.orchestra.run.smithi119.stdout:(119/145): socat-1.7.4.1-1.el8.x86_64.rpm 730 kB/s | 323 kB 00:00 2023-12-14T18:14:51.411 INFO:teuthology.orchestra.run.smithi119.stdout:(120/145): openblas-threads-0.3.15-6.el8.x86_64 18 MB/s | 5.2 MB 00:00 2023-12-14T18:14:51.437 INFO:teuthology.orchestra.run.smithi119.stdout:(121/145): python3-mako-1.0.6-14.el8.noarch.rpm 537 kB/s | 157 kB 00:00 2023-12-14T18:14:51.529 INFO:teuthology.orchestra.run.smithi119.stdout:(122/145): openblas-0.3.15-6.el8.x86_64.rpm 17 MB/s | 5.0 MB 00:00 2023-12-14T18:14:51.579 INFO:teuthology.orchestra.run.smithi119.stdout:(123/145): postgresql-10.23-2.module+el8.8.0+19 9.0 MB/s | 1.5 MB 00:00 2023-12-14T18:14:51.612 INFO:teuthology.orchestra.run.smithi119.stdout:(124/145): postgresql-contrib-10.23-2.module+el 4.5 MB/s | 811 kB 00:00 2023-12-14T18:14:51.751 INFO:teuthology.orchestra.run.smithi119.stdout:(125/145): libpq-13.11-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-12-14T18:14:51.796 INFO:teuthology.orchestra.run.smithi119.stdout:(126/145): automake-1.16.1-8.el8.noarch.rpm 3.2 MB/s | 714 kB 00:00 2023-12-14T18:14:51.864 INFO:teuthology.orchestra.run.smithi119.stdout:(127/145): postgresql-server-10.23-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-12-14T18:14:51.888 INFO:teuthology.orchestra.run.smithi119.stdout:(128/145): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-12-14T18:14:51.931 INFO:teuthology.orchestra.run.smithi119.stdout:(129/145): python3-pytz-2017.2-11.el8.noarch.rp 405 kB/s | 54 kB 00:00 2023-12-14T18:14:52.089 INFO:teuthology.orchestra.run.smithi119.stdout:(130/145): openssl-1.1.1k-9.el8_7.x86_64.rpm 4.4 MB/s | 710 kB 00:00 2023-12-14T18:14:52.348 INFO:teuthology.orchestra.run.smithi119.stdout:(131/145): librbd1-18.0.0-3905.g1faa3533.el8.x8 7.8 MB/s | 3.6 MB 00:00 2023-12-14T18:14:52.406 INFO:teuthology.orchestra.run.smithi119.stdout:(132/145): openssl-libs-1.1.1k-9.el8_7.x86_64.r 4.6 MB/s | 1.5 MB 00:00 2023-12-14T18:14:52.515 INFO:teuthology.orchestra.run.smithi119.stdout:(133/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2023-12-14T18:14:52.540 INFO:teuthology.orchestra.run.smithi119.stdout:(134/145): elfutils-libs-0.189-3.el8.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2023-12-14T18:14:52.623 INFO:teuthology.orchestra.run.smithi119.stdout:(135/145): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 237 kB 00:00 2023-12-14T18:14:52.674 INFO:teuthology.orchestra.run.smithi119.stdout:(136/145): libsmartcols-2.32.1-43.el8.x86_64.rp 1.3 MB/s | 179 kB 00:00 2023-12-14T18:14:52.774 INFO:teuthology.orchestra.run.smithi119.stdout:(137/145): libuuid-2.32.1-43.el8.x86_64.rpm 658 kB/s | 99 kB 00:00 2023-12-14T18:14:52.858 INFO:teuthology.orchestra.run.smithi119.stdout:(138/145): util-linux-2.32.1-43.el8.x86_64.rpm 13 MB/s | 2.5 MB 00:00 2023-12-14T18:14:52.908 INFO:teuthology.orchestra.run.smithi119.stdout:(139/145): util-linux-user-2.32.1-43.el8.x86_64 769 kB/s | 103 kB 00:00 2023-12-14T18:14:53.037 INFO:teuthology.orchestra.run.smithi069.stdout:(145/145): ceph-test-18.0.0-3905.g1faa3533.el8. 1.5 MB/s | 41 MB 00:27 2023-12-14T18:14:53.040 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:14:53.040 INFO:teuthology.orchestra.run.smithi069.stdout:Total 6.1 MB/s | 205 MB 00:33 2023-12-14T18:14:53.042 INFO:teuthology.orchestra.run.smithi119.stdout:(140/145): xfsdump-3.1.8-6.el8.x86_64.rpm 1.8 MB/s | 333 kB 00:00 2023-12-14T18:14:53.084 INFO:teuthology.orchestra.run.smithi119.stdout:(141/145): iproute-6.2.0-5.el8_9.x86_64.rpm 4.8 MB/s | 854 kB 00:00 2023-12-14T18:14:53.167 INFO:teuthology.orchestra.run.smithi119.stdout:(142/145): libblkid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-12-14T18:14:53.209 INFO:teuthology.orchestra.run.smithi119.stdout:(143/145): libfdisk-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 254 kB 00:00 2023-12-14T18:14:53.326 INFO:teuthology.orchestra.run.smithi119.stdout:(144/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.7 MB/s | 1.1 MB 00:00 2023-12-14T18:14:53.852 INFO:teuthology.orchestra.run.smithi119.stdout:(145/145): librados2-18.0.0-3905.g1faa3533.el8. 1.8 MB/s | 3.7 MB 00:01 2023-12-14T18:14:53.855 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:14:53.855 INFO:teuthology.orchestra.run.smithi119.stdout:Total 6.1 MB/s | 205 MB 00:33 2023-12-14T18:14:54.103 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-12-14T18:14:54.495 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-12-14T18:14:54.495 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-12-14T18:14:54.591 INFO:teuthology.orchestra.run.smithi091.stdout: Preparing : 1/1 2023-12-14T18:14:54.797 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-14T18:14:54.882 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-14T18:14:55.034 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T18:14:55.277 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-14T18:14:55.277 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-14T18:14:55.278 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T18:14:55.471 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2023-12-14T18:14:55.631 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T18:14:55.737 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T18:14:55.898 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T18:14:55.964 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T18:14:56.016 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-12-14T18:14:56.027 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-12-14T18:14:56.178 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2023-12-14T18:14:56.380 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/161 2023-12-14T18:14:56.640 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/161 2023-12-14T18:14:56.728 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/161 2023-12-14T18:14:56.807 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-14T18:14:56.818 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-14T18:14:56.923 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T18:14:57.329 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T18:14:57.548 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:14:57.946 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:14:58.131 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:14:58.254 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:14:58.489 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:14:58.586 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:14:58.920 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T18:14:59.172 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T18:14:59.245 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T18:14:59.482 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2023-12-14T18:14:59.726 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2023-12-14T18:14:59.926 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2023-12-14T18:15:00.284 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2023-12-14T18:15:00.526 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 18/161 2023-12-14T18:15:00.714 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:15:00.826 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:15:00.991 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T18:15:01.065 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T18:15:01.259 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/161 2023-12-14T18:15:01.514 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/161 2023-12-14T18:15:01.745 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/161 2023-12-14T18:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-12-14T18:15:01.888 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/161 2023-12-14T18:15:02.027 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-14T18:15:02.028 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/161 2023-12-14T18:15:02.172 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/161 2023-12-14T18:15:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T18:15:02.345 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-14T18:15:02.547 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-14T18:15:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T18:15:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2023-12-14T18:15:02.780 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T18:15:02.793 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/161 2023-12-14T18:15:02.980 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/161 2023-12-14T18:15:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T18:15:03.009 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/161 2023-12-14T18:15:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T18:15:03.197 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2023-12-14T18:15:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T18:15:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T18:15:03.413 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T18:15:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2023-12-14T18:15:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2023-12-14T18:15:03.583 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/161 2023-12-14T18:15:03.680 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T18:15:03.747 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/161 2023-12-14T18:15:03.771 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2023-12-14T18:15:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/161 2023-12-14T18:15:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/161 2023-12-14T18:15:03.967 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2023-12-14T18:15:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/161 2023-12-14T18:15:04.161 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/161 2023-12-14T18:15:04.321 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T18:15:04.388 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/161 2023-12-14T18:15:04.443 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/161 2023-12-14T18:15:04.478 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/161 2023-12-14T18:15:04.669 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/161 2023-12-14T18:15:04.696 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T18:15:04.744 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T18:15:04.876 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/161 2023-12-14T18:15:04.988 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:15:05.095 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2023-12-14T18:15:05.121 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2023-12-14T18:15:05.303 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 31/161 2023-12-14T18:15:05.329 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:15:05.365 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:15:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 32/161 2023-12-14T18:15:05.538 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:15:05.648 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:15:05.691 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 33/161 2023-12-14T18:15:05.732 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:15:05.830 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:15:05.871 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2023-12-14T18:15:05.963 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:15:05.963 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:15:06.089 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:15:06.279 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:15:06.325 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T18:15:06.403 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:15:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T18:15:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T18:15:06.745 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T18:15:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2023-12-14T18:15:07.004 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T18:15:07.093 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2023-12-14T18:15:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2023-12-14T18:15:07.337 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2023-12-14T18:15:07.408 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2023-12-14T18:15:07.608 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2023-12-14T18:15:07.620 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2023-12-14T18:15:07.807 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2023-12-14T18:15:07.813 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2023-12-14T18:15:07.965 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 35/161 2023-12-14T18:15:08.062 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 18/161 2023-12-14T18:15:08.171 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2023-12-14T18:15:08.237 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:15:08.346 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:15:08.412 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 18/161 2023-12-14T18:15:08.503 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T18:15:08.570 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T18:15:08.579 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:15:08.685 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:15:08.737 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/161 2023-12-14T18:15:08.826 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T18:15:08.887 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/161 2023-12-14T18:15:08.919 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/161 2023-12-14T18:15:08.925 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 20/161 2023-12-14T18:15:09.029 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/161 2023-12-14T18:15:09.098 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/161 2023-12-14T18:15:09.242 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/161 2023-12-14T18:15:09.344 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/161 2023-12-14T18:15:09.471 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/161 2023-12-14T18:15:09.575 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/161 2023-12-14T18:15:09.642 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/161 2023-12-14T18:15:09.698 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2023-12-14T18:15:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/161 2023-12-14T18:15:09.846 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/161 2023-12-14T18:15:09.903 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/161 2023-12-14T18:15:09.965 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2023-12-14T18:15:10.062 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/161 2023-12-14T18:15:10.186 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 41/161 2023-12-14T18:15:10.384 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 42/161 2023-12-14T18:15:10.433 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/161 2023-12-14T18:15:10.562 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T18:15:10.642 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T18:15:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/161 2023-12-14T18:15:10.713 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/161 2023-12-14T18:15:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/161 2023-12-14T18:15:10.870 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T18:15:10.924 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T18:15:11.116 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2023-12-14T18:15:11.354 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/161 2023-12-14T18:15:11.358 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2023-12-14T18:15:11.466 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/161 2023-12-14T18:15:11.528 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T18:15:11.627 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/161 2023-12-14T18:15:11.628 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/161 2023-12-14T18:15:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/161 2023-12-14T18:15:11.957 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/161 2023-12-14T18:15:12.036 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T18:15:12.238 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/161 2023-12-14T18:15:12.330 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/161 2023-12-14T18:15:12.362 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T18:15:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T18:15:12.527 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/161 2023-12-14T18:15:12.601 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/161 2023-12-14T18:15:12.662 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : automake-1.16.1-8.el8.noarch 49/161 2023-12-14T18:15:12.797 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2023-12-14T18:15:12.818 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/161 2023-12-14T18:15:12.820 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : uuid-1.6.2-43.el8.x86_64 50/161 2023-12-14T18:15:12.899 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 50/161 2023-12-14T18:15:13.002 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 31/161 2023-12-14T18:15:13.070 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 51/161 2023-12-14T18:15:13.087 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2023-12-14T18:15:13.140 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 32/161 2023-12-14T18:15:13.140 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 51/161 2023-12-14T18:15:13.276 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 31/161 2023-12-14T18:15:13.320 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : jq-1.6-7.el8.x86_64 52/161 2023-12-14T18:15:13.381 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 33/161 2023-12-14T18:15:13.406 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 32/161 2023-12-14T18:15:13.527 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/161 2023-12-14T18:15:13.675 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 33/161 2023-12-14T18:15:13.702 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/161 2023-12-14T18:15:13.853 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2023-12-14T18:15:13.922 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/161 2023-12-14T18:15:14.141 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/161 2023-12-14T18:15:14.334 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/161 2023-12-14T18:15:14.365 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/161 2023-12-14T18:15:14.525 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/161 2023-12-14T18:15:14.711 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/161 2023-12-14T18:15:14.714 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/161 2023-12-14T18:15:14.923 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/161 2023-12-14T18:15:15.009 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/161 2023-12-14T18:15:15.195 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/161 2023-12-14T18:15:15.207 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/161 2023-12-14T18:15:15.515 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/161 2023-12-14T18:15:15.615 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2023-12-14T18:15:15.741 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/161 2023-12-14T18:15:15.907 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/161 2023-12-14T18:15:15.947 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 35/161 2023-12-14T18:15:16.096 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/161 2023-12-14T18:15:16.459 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/161 2023-12-14T18:15:16.952 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/161 2023-12-14T18:15:16.968 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/161 2023-12-14T18:15:16.987 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 67/161 2023-12-14T18:15:17.206 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/161 2023-12-14T18:15:17.295 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 38/161 2023-12-14T18:15:17.300 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/161 2023-12-14T18:15:17.450 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/161 2023-12-14T18:15:17.548 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2023-12-14T18:15:17.561 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/161 2023-12-14T18:15:17.724 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/161 2023-12-14T18:15:17.759 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2023-12-14T18:15:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2023-12-14T18:15:17.923 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 41/161 2023-12-14T18:15:18.004 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2023-12-14T18:15:18.044 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/161 2023-12-14T18:15:18.115 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 42/161 2023-12-14T18:15:18.195 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 41/161 2023-12-14T18:15:18.285 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/161 2023-12-14T18:15:18.303 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T18:15:18.362 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T18:15:18.401 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 42/161 2023-12-14T18:15:18.468 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/161 2023-12-14T18:15:18.586 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T18:15:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T18:15:18.653 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T18:15:18.659 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2023-12-14T18:15:18.696 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/161 2023-12-14T18:15:18.894 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/161 2023-12-14T18:15:18.899 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2023-12-14T18:15:18.919 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T18:15:18.993 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2023-12-14T18:15:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2023-12-14T18:15:19.145 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/161 2023-12-14T18:15:19.233 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2023-12-14T18:15:19.302 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2023-12-14T18:15:19.319 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T18:15:19.431 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2023-12-14T18:15:19.490 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2023-12-14T18:15:19.652 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T18:15:19.782 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2023-12-14T18:15:19.861 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T18:15:20.019 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2023-12-14T18:15:20.175 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2023-12-14T18:15:20.186 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T18:15:20.204 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T18:15:20.214 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2023-12-14T18:15:20.379 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2023-12-14T18:15:20.406 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/161 2023-12-14T18:15:20.477 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T18:15:20.570 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2023-12-14T18:15:20.611 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2023-12-14T18:15:20.640 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/161 2023-12-14T18:15:20.770 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.1-8.el8.noarch 49/161 2023-12-14T18:15:20.839 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/161 2023-12-14T18:15:20.840 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2023-12-14T18:15:20.968 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-43.el8.x86_64 50/161 2023-12-14T18:15:20.996 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/161 2023-12-14T18:15:21.037 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2023-12-14T18:15:21.050 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 50/161 2023-12-14T18:15:21.197 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/161 2023-12-14T18:15:21.210 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 51/161 2023-12-14T18:15:21.213 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2023-12-14T18:15:21.274 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 51/161 2023-12-14T18:15:21.374 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2023-12-14T18:15:21.476 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-7.el8.x86_64 52/161 2023-12-14T18:15:21.490 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/161 2023-12-14T18:15:21.633 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/161 2023-12-14T18:15:21.638 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2023-12-14T18:15:21.782 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/161 2023-12-14T18:15:21.808 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/161 2023-12-14T18:15:21.880 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2023-12-14T18:15:22.011 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/161 2023-12-14T18:15:22.040 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2023-12-14T18:15:22.041 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/161 2023-12-14T18:15:22.232 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/161 2023-12-14T18:15:22.247 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/161 2023-12-14T18:15:22.288 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2023-12-14T18:15:22.440 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/161 2023-12-14T18:15:22.448 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/161 2023-12-14T18:15:22.550 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2023-12-14T18:15:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/161 2023-12-14T18:15:22.724 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2023-12-14T18:15:22.795 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/161 2023-12-14T18:15:22.837 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/161 2023-12-14T18:15:22.966 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2023-12-14T18:15:23.072 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/161 2023-12-14T18:15:23.131 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 60/161 2023-12-14T18:15:23.329 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/161 2023-12-14T18:15:23.353 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/161 2023-12-14T18:15:23.550 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/161 2023-12-14T18:15:23.647 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/161 2023-12-14T18:15:23.824 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/161 2023-12-14T18:15:23.856 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/161 2023-12-14T18:15:24.024 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2023-12-14T18:15:24.047 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/161 2023-12-14T18:15:24.156 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/161 2023-12-14T18:15:24.245 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/161 2023-12-14T18:15:24.346 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2023-12-14T18:15:24.385 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 65/161 2023-12-14T18:15:24.541 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2023-12-14T18:15:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 66/161 2023-12-14T18:15:24.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/161 2023-12-14T18:15:24.804 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/161 2023-12-14T18:15:24.832 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2023-12-14T18:15:24.919 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 67/161 2023-12-14T18:15:25.017 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/161 2023-12-14T18:15:25.110 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2023-12-14T18:15:25.174 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/161 2023-12-14T18:15:25.293 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2023-12-14T18:15:25.346 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/161 2023-12-14T18:15:25.413 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/161 2023-12-14T18:15:25.578 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.1-8.el8.noarch 70/161 2023-12-14T18:15:25.689 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/161 2023-12-14T18:15:25.768 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-43.el8.x86_64 71/161 2023-12-14T18:15:25.848 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 71/161 2023-12-14T18:15:26.007 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/161 2023-12-14T18:15:26.051 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 72/161 2023-12-14T18:15:26.068 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2023-12-14T18:15:26.130 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 72/161 2023-12-14T18:15:26.242 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T18:15:26.267 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/161 2023-12-14T18:15:26.319 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T18:15:26.326 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.6-7.el8.x86_64 73/161 2023-12-14T18:15:26.483 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/161 2023-12-14T18:15:26.495 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/161 2023-12-14T18:15:26.525 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 103/161 2023-12-14T18:15:26.675 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/161 2023-12-14T18:15:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/161 2023-12-14T18:15:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/161 2023-12-14T18:15:27.021 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/161 2023-12-14T18:15:27.161 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/161 2023-12-14T18:15:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2023-12-14T18:15:27.489 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2023-12-14T18:15:27.552 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2023-12-14T18:15:27.755 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2023-12-14T18:15:27.756 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2023-12-14T18:15:27.966 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2023-12-14T18:15:28.057 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2023-12-14T18:15:28.214 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2023-12-14T18:15:28.308 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2023-12-14T18:15:28.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2023-12-14T18:15:28.556 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2023-12-14T18:15:28.585 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2023-12-14T18:15:28.721 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2023-12-14T18:15:28.827 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2023-12-14T18:15:28.952 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2023-12-14T18:15:29.070 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2023-12-14T18:15:29.206 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2023-12-14T18:15:29.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2023-12-14T18:15:29.421 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2023-12-14T18:15:29.423 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2023-12-14T18:15:29.588 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2023-12-14T18:15:29.679 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2023-12-14T18:15:29.774 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2023-12-14T18:15:29.922 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2023-12-14T18:15:29.989 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2023-12-14T18:15:30.081 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2023-12-14T18:15:30.171 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2023-12-14T18:15:30.354 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:30.356 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2023-12-14T18:15:30.600 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:30.621 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2023-12-14T18:15:30.730 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2023-12-14T18:15:30.875 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2023-12-14T18:15:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2023-12-14T18:15:31.083 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2023-12-14T18:15:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2023-12-14T18:15:31.199 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:31.292 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2023-12-14T18:15:31.356 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2023-12-14T18:15:31.468 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T18:15:31.562 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T18:15:31.715 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T18:15:32.424 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2023-12-14T18:15:32.426 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2023-12-14T18:15:32.762 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2023-12-14T18:15:32.830 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2023-12-14T18:15:32.999 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2023-12-14T18:15:33.050 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2023-12-14T18:15:33.308 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2023-12-14T18:15:33.360 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2023-12-14T18:15:33.559 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2023-12-14T18:15:33.648 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2023-12-14T18:15:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2023-12-14T18:15:33.893 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2023-12-14T18:15:34.567 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2023-12-14T18:15:34.684 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2023-12-14T18:15:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T18:15:34.845 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T18:15:34.892 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T18:15:34.968 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 102/161 2023-12-14T18:15:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 103/161 2023-12-14T18:15:35.160 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 103/161 2023-12-14T18:15:39.082 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:39.151 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:39.334 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:39.391 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:39.935 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:39.973 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 104/161 2023-12-14T18:15:40.211 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T18:15:40.274 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T18:15:40.304 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T18:15:40.345 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 105/161 2023-12-14T18:15:40.474 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T18:15:40.482 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T18:15:51.356 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /sys 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /proc 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /dev 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /run 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /mnt 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /var/tmp 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /home 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /tmp 2023-12-14T18:15:51.357 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /dev 2023-12-14T18:15:51.358 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:15:51.712 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T18:15:53.285 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T18:15:53.480 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T18:15:53.698 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T18:15:53.861 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T18:15:54.315 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T18:15:54.495 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T18:15:54.512 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T18:15:56.201 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T18:15:56.365 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T18:15:56.474 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 112/161 2023-12-14T18:15:56.657 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 113/161 2023-12-14T18:15:56.852 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T18:15:57.073 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T18:15:57.387 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T18:15:58.349 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T18:15:58.535 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T18:15:58.626 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T18:15:58.999 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 117/161 2023-12-14T18:15:59.170 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T18:15:59.206 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T18:15:59.343 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T18:15:59.355 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T18:15:59.787 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T18:15:59.787 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /run 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-12-14T18:15:59.788 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:15:59.842 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 106/161 2023-12-14T18:15:59.842 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /run 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-12-14T18:15:59.843 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:16:00.179 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T18:16:00.205 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T18:16:00.624 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 120/161 2023-12-14T18:16:00.862 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T18:16:00.896 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T18:16:01.051 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T18:16:01.094 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T18:16:01.284 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T18:16:01.631 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T18:16:01.752 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T18:16:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 107/161 2023-12-14T18:16:01.818 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T18:16:01.954 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T18:16:01.982 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T18:16:02.173 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T18:16:02.201 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 108/161 2023-12-14T18:16:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T18:16:02.362 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T18:16:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T18:16:02.815 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 109/161 2023-12-14T18:16:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T18:16:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T18:16:02.987 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T18:16:03.004 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 110/161 2023-12-14T18:16:04.852 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T18:16:04.870 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T18:16:04.997 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T18:16:05.009 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 111/161 2023-12-14T18:16:05.109 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 112/161 2023-12-14T18:16:05.177 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 112/161 2023-12-14T18:16:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 113/161 2023-12-14T18:16:05.413 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 113/161 2023-12-14T18:16:05.519 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T18:16:05.637 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T18:16:05.715 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T18:16:05.738 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T18:16:05.856 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 114/161 2023-12-14T18:16:06.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T18:16:06.190 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T18:16:06.671 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 125/161 2023-12-14T18:16:06.962 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 126/161 2023-12-14T18:16:07.030 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T18:16:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 115/161 2023-12-14T18:16:07.236 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T18:16:07.248 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2023-12-14T18:16:07.329 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T18:16:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T18:16:07.457 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 116/161 2023-12-14T18:16:07.643 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 128/161 2023-12-14T18:16:07.714 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 117/161 2023-12-14T18:16:07.867 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 117/161 2023-12-14T18:16:07.869 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T18:16:07.905 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T18:16:07.984 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 129/161 2023-12-14T18:16:08.065 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T18:16:08.077 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T18:16:08.089 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T18:16:08.100 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 118/161 2023-12-14T18:16:08.224 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libtool-2.4.6-25.el8.x86_64 130/161 2023-12-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 130/161 2023-12-14T18:16:08.287 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T18:16:08.298 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 119/161 2023-12-14T18:16:08.443 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2023-12-14T18:16:08.654 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2023-12-14T18:16:08.817 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 133/161 2023-12-14T18:16:09.345 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 120/161 2023-12-14T18:16:09.552 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T18:16:09.553 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 120/161 2023-12-14T18:16:09.587 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T18:16:09.781 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T18:16:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T18:16:09.816 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 121/161 2023-12-14T18:16:09.828 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T18:16:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T18:16:10.012 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T18:16:10.055 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 122/161 2023-12-14T18:16:10.245 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T18:16:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T18:16:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T18:16:10.591 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 123/161 2023-12-14T18:16:10.762 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T18:16:11.084 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:11.391 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:11.438 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:11.908 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2023-12-14T18:16:12.278 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2023-12-14T18:16:12.495 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/161 2023-12-14T18:16:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 138/161 2023-12-14T18:16:12.881 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 139/161 2023-12-14T18:16:13.172 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 140/161 2023-12-14T18:16:13.428 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 141/161 2023-12-14T18:16:13.640 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/161 2023-12-14T18:16:13.726 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/161 2023-12-14T18:16:13.907 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/161 2023-12-14T18:16:13.920 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/161 2023-12-14T18:16:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 144/161 2023-12-14T18:16:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 144/161 2023-12-14T18:16:14.275 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/161 2023-12-14T18:16:14.424 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2023-12-14T18:16:14.445 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T18:16:14.625 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2023-12-14T18:16:14.660 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 124/161 2023-12-14T18:16:14.777 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2023-12-14T18:16:14.777 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T18:16:15.026 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T18:16:15.026 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T18:16:15.110 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 125/161 2023-12-14T18:16:15.244 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T18:16:15.244 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T18:16:15.340 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 125/161 2023-12-14T18:16:15.474 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 126/161 2023-12-14T18:16:15.505 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T18:16:15.631 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 126/161 2023-12-14T18:16:15.699 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2023-12-14T18:16:15.727 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/161 2023-12-14T18:16:15.903 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2023-12-14T18:16:15.907 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2023-12-14T18:16:16.117 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2023-12-14T18:16:16.117 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T18:16:16.338 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 128/161 2023-12-14T18:16:16.350 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T18:16:16.350 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T18:16:16.420 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/161 2023-12-14T18:16:16.559 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T18:16:16.559 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:16.687 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 129/161 2023-12-14T18:16:16.740 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 128/161 2023-12-14T18:16:16.809 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:16.809 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T18:16:16.943 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-25.el8.x86_64 130/161 2023-12-14T18:16:16.956 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 130/161 2023-12-14T18:16:17.025 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T18:16:17.025 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:17.042 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 129/161 2023-12-14T18:16:17.170 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2023-12-14T18:16:17.250 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:17.275 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T18:16:17.375 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2023-12-14T18:16:17.375 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T18:16:17.380 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2023-12-14T18:16:17.530 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2023-12-14T18:16:17.560 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 133/161 2023-12-14T18:16:17.740 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2023-12-14T18:16:17.878 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 133/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 1/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 3/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 4/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 5/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 6/161 2023-12-14T18:16:18.260 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 7/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 8/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 13/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 14/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 15/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 16/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 17/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 18/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:16:18.261 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 20/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 21/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 22/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 23/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 24/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 25/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 26/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 27/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 28/161 2023-12-14T18:16:18.262 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 29/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 30/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 31/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 32/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 33/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 34/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 35/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 36/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 37/161 2023-12-14T18:16:18.274 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 38/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2023-12-14T18:16:18.275 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2023-12-14T18:16:18.276 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/161 2023-12-14T18:16:18.277 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 87/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 91/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 92/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 93/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 94/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 95/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 96/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 97/161 2023-12-14T18:16:18.278 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 98/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 113/161 2023-12-14T18:16:18.279 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 114/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 115/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 116/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 117/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 118/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 119/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 120/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 121/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 122/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 123/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 124/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-server-10.23-2.module+el8.8.0+19493+5 125/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : automake-1.16.1-8.el8.noarch 126/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libpq-13.11-1.el8.x86_64 127/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : jq-1.6-7.el8.x86_64 128/161 2023-12-14T18:16:18.280 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 129/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 132/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 134/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 135/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 136/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 138/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 139/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 140/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 141/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/161 2023-12-14T18:16:18.281 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 143/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 145/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 147/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 149/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 151/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 154/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 155/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 156/161 2023-12-14T18:16:18.282 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:18.283 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 158/161 2023-12-14T18:16:18.283 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:18.283 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 160/161 2023-12-14T18:16:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:20.134 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:20.169 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:20.175 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:20.485 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:20.530 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-10.23-2.module+el8.8.0+19493+5 134/161 2023-12-14T18:16:20.652 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2023-12-14T18:16:21.032 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2023-12-14T18:16:21.033 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2023-12-14T18:16:21.280 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/161 2023-12-14T18:16:21.410 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2023-12-14T18:16:21.442 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 138/161 2023-12-14T18:16:21.667 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 139/161 2023-12-14T18:16:21.672 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/161 2023-12-14T18:16:21.877 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 138/161 2023-12-14T18:16:21.921 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 140/161 2023-12-14T18:16:22.126 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 139/161 2023-12-14T18:16:22.254 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 141/161 2023-12-14T18:16:22.427 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 140/161 2023-12-14T18:16:22.508 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/161 2023-12-14T18:16:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/161 2023-12-14T18:16:22.687 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 141/161 2023-12-14T18:16:22.825 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/161 2023-12-14T18:16:22.826 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 142/161 2023-12-14T18:16:22.836 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 142/161 2023-12-14T18:16:22.839 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/161 2023-12-14T18:16:23.025 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 144/161 2023-12-14T18:16:23.034 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 144/161 2023-12-14T18:16:23.043 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 143/161 2023-12-14T18:16:23.152 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/161 2023-12-14T18:16:23.293 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.1-9.el8.x86_64 144/161 2023-12-14T18:16:23.330 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2023-12-14T18:16:23.383 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 144/161 2023-12-14T18:16:23.535 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2023-12-14T18:16:23.626 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.0.4-10.el8.x86_64 145/161 2023-12-14T18:16:23.641 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 145/161 2023-12-14T18:16:23.713 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2023-12-14T18:16:23.713 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T18:16:23.851 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2023-12-14T18:16:24.003 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T18:16:24.003 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T18:16:24.062 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2023-12-14T18:16:24.196 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T18:16:24.196 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T18:16:24.264 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2023-12-14T18:16:24.264 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T18:16:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T18:16:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2023-12-14T18:16:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T18:16:24.710 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2023-12-14T18:16:24.805 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2023-12-14T18:16:24.805 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T18:16:24.883 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2023-12-14T18:16:25.082 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2023-12-14T18:16:25.135 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2023-12-14T18:16:25.135 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T18:16:25.311 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2023-12-14T18:16:25.369 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T18:16:25.369 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T18:16:25.515 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2023-12-14T18:16:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T18:16:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:25.761 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2023-12-14T18:16:25.761 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T18:16:25.827 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:25.827 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T18:16:26.003 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2023-12-14T18:16:26.003 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T18:16:26.060 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T18:16:26.060 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:26.220 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2023-12-14T18:16:26.220 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:26.294 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:26.470 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:26.470 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T18:16:26.485 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2023-12-14T18:16:26.486 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T18:16:26.728 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2023-12-14T18:16:26.728 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:26.978 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:27.128 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2023-12-14T18:16:27.128 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 1/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 3/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 4/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 5/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 6/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 7/161 2023-12-14T18:16:27.401 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 8/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 13/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 14/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 15/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 16/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 17/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 18/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 20/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 21/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 22/161 2023-12-14T18:16:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 23/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 24/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 25/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 26/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 27/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 28/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 29/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 30/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 31/161 2023-12-14T18:16:27.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 32/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 33/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 34/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 35/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 36/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 37/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 38/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2023-12-14T18:16:27.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2023-12-14T18:16:27.415 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/161 2023-12-14T18:16:27.416 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 87/161 2023-12-14T18:16:27.417 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 91/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 92/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 93/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 94/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 95/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 96/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 97/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 98/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/161 2023-12-14T18:16:27.418 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 113/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 114/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 115/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 116/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 117/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 118/161 2023-12-14T18:16:27.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 119/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 120/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 121/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 122/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 123/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 124/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-10.23-2.module+el8.8.0+19493+5 125/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.1-8.el8.noarch 126/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpq-13.11-1.el8.x86_64 127/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-7.el8.x86_64 128/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 129/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 132/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 134/161 2023-12-14T18:16:27.420 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 135/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 136/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 138/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 139/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 140/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 141/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 143/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 145/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 147/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 149/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/161 2023-12-14T18:16:27.421 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 151/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 154/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 155/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 156/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 158/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:27.422 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 160/161 2023-12-14T18:16:28.070 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2023-12-14T18:16:28.070 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 1/161 2023-12-14T18:16:28.070 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2/161 2023-12-14T18:16:28.070 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 3/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 4/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3905.g1faa3 5/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 6/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 7/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 8/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 9/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 10/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 11/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 12/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 13/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_ 14/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 15/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 16/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_6 17/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86 18/161 2023-12-14T18:16:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 19/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el 20/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:18.0.0-3905.g1faa3533.el8. 21/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_6 22/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 23/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 24/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 25/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 26/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 27/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 28/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533. 29/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noa 30/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.n 31/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3905.g1fa 32/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el 33/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 34/161 2023-12-14T18:16:28.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.e 35/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 36/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 37/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 38/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2023-12-14T18:16:28.073 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2023-12-14T18:16:28.074 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 72/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 75/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/161 2023-12-14T18:16:28.075 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.1-9.el8.x86_64 79/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 80/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 81/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 82/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 83/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 86/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 87/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 88/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 89/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 90/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 91/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 92/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 93/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 94/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 95/161 2023-12-14T18:16:28.076 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-10.23-2.module+el8.8.0+19493+5804baf6 96/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-10.23-2.module+el8.8.0+19493+ 97/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-10.23-2.module+el8.8.0+19493+5 98/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.1-8.el8.noarch 99/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpq-13.11-1.el8.x86_64 100/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.6-7.el8.x86_64 101/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 102/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 103/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 104/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 105/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 106/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 107/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 108/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 109/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/161 2023-12-14T18:16:28.077 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 112/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 113/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 114/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 115/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 117/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 118/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 122/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 123/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 124/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 125/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 126/161 2023-12-14T18:16:28.078 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 128/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 129/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 130/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 132/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 134/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 135/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 136/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 138/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 139/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 140/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 141/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/161 2023-12-14T18:16:28.079 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 143/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 145/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 147/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 149/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 151/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 154/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 155/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 156/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 157/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 158/161 2023-12-14T18:16:28.080 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 159/161 2023-12-14T18:16:28.081 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 160/161 2023-12-14T18:16:28.385 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 161/161 2023-12-14T18:16:28.386 INFO:teuthology.orchestra.run.smithi091.stdout:Installed products updated. 2023-12-14T18:16:29.007 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout:Upgraded: 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:29.008 INFO:teuthology.orchestra.run.smithi091.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout:Installed: 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: automake-1.16.1-8.el8.noarch 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: bison-3.0.4-10.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.009 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.010 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: flex-2.6.1-9.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: jq-1.6-7.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-14T18:16:29.011 INFO:teuthology.orchestra.run.smithi091.stdout: libpq-13.11-1.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-14T18:16:29.012 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-contrib-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-server-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-14T18:16:29.013 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-14T18:16:29.014 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-portend-2.6-1.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-14T18:16:29.015 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-14T18:16:29.016 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-14T18:16:29.017 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-14T18:16:29.018 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-12-14T18:16:29.273 DEBUG:teuthology.parallel:result is None 2023-12-14T18:16:42.044 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 161/161 2023-12-14T18:16:42.044 INFO:teuthology.orchestra.run.smithi119.stdout:Installed products updated. 2023-12-14T18:16:42.125 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 161/161 2023-12-14T18:16:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.630 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.1-8.el8.noarch 2023-12-14T18:16:42.631 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.0.4-10.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.632 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.1-9.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-7.el8.x86_64 2023-12-14T18:16:42.633 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libpq-13.11-1.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-14T18:16:42.634 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-14T18:16:42.635 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-14T18:16:42.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-14T18:16:42.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-2.6-1.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-14T18:16:42.638 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-14T18:16:42.639 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:16:42.640 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.436 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.1-8.el8.noarch 2023-12-14T18:16:43.437 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.0.4-10.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.438 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:18.0.0-3905.g1faa3533.el8.noarch 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.1-9.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.6-7.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-14T18:16:43.439 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libpq-13.11-1.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-14T18:16:43.440 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-14T18:16:43.441 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-10.23-2.module+el8.8.0+19493+5804baf6.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-14T18:16:43.442 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-14T18:16:43.443 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-2.6-1.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-14T18:16:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.445 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:18.0.0-3905.g1faa3533.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:16:43.446 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-14T18:16:44.695 DEBUG:teuthology.parallel:result is None 2023-12-14T18:16:45.051 DEBUG:teuthology.parallel:result is None 2023-12-14T18:16:45.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:16:45.266 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-14T18:16:45.294 INFO:teuthology.orchestra.run.smithi069.stdout:18.0.0-3905.g1faa3533.el8 2023-12-14T18:16:45.294 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3905.g1faa3533.el8 2023-12-14T18:16:45.294 INFO:teuthology.task.install:The correct ceph version 18.0.0-3905.g1faa3533 is installed. 2023-12-14T18:16:45.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:16:45.505 DEBUG:teuthology.orchestra.run.smithi091:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-14T18:16:45.547 INFO:teuthology.orchestra.run.smithi091.stdout:18.0.0-3905.g1faa3533.el8 2023-12-14T18:16:45.547 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3905.g1faa3533.el8 2023-12-14T18:16:45.548 INFO:teuthology.task.install:The correct ceph version 18.0.0-3905.g1faa3533 is installed. 2023-12-14T18:16:45.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:16:45.757 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-14T18:16:45.783 INFO:teuthology.orchestra.run.smithi119.stdout:18.0.0-3905.g1faa3533.el8 2023-12-14T18:16:45.783 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3905.g1faa3533.el8 2023-12-14T18:16:45.783 INFO:teuthology.task.install:The correct ceph version 18.0.0-3905.g1faa3533 is installed. 2023-12-14T18:16:45.784 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-14T18:16:45.784 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:16:45.784 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-14T18:16:45.832 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:16:45.832 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-14T18:16:45.880 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:16:45.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-14T18:16:45.922 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-14T18:16:45.923 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:16:45.923 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-12-14T18:16:45.954 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-14T18:16:46.023 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:16:46.024 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2023-12-14T18:16:46.054 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-14T18:16:46.124 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:16:46.124 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-12-14T18:16:46.152 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-14T18:16:46.219 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-14T18:16:46.220 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:16:46.220 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-14T18:16:46.250 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-14T18:16:46.319 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:16:46.319 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-14T18:16:46.349 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-14T18:16:46.420 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:16:46.421 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-14T18:16:46.447 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-14T18:16:46.514 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-14T18:16:46.514 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:16:46.514 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-12-14T18:16:46.544 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-14T18:16:46.614 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:16:46.614 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/stdin-killer 2023-12-14T18:16:46.646 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-14T18:16:46.716 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:16:46.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-12-14T18:16:46.743 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-14T18:16:46.810 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-14T18:16:46.882 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-12-14T18:16:46.882 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:16:46.883 INFO:tasks.cephadm:Cluster fsid is f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:16:46.883 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-14T18:16:46.883 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.69', 'mon.b': '172.21.15.91', 'mon.c': '172.21.15.119'} 2023-12-14T18:16:46.883 INFO:tasks.cephadm:First mon is mon.a on smithi069 2023-12-14T18:16:46.883 INFO:tasks.cephadm:First mgr is x 2023-12-14T18:16:46.883 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-14T18:16:46.883 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname $(hostname -s) 2023-12-14T18:16:46.917 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname $(hostname -s) 2023-12-14T18:16:46.950 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2023-12-14T18:16:46.977 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-12-14T18:16:46.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:16:47.112 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1faa353368ad4f5aeb56d7107b638336f58659ed', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74952/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-3905-g1faa3533', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-3905.g1faa3533'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-12-13 17:15:35.607942', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-choffman-62793', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-12-14T18:16:47.244 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-choffman-62793, sha1 1faa353368ad4f5aeb56d7107b638336f58659ed from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=1faa353368ad4f5aeb56d7107b638336f58659ed 2023-12-14T18:16:47.246 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm 2023-12-14T18:16:47.246 DEBUG:teuthology.orchestra.run.smithi069:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:47.657 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 Dec 14 18:16 /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:47.658 DEBUG:teuthology.orchestra.run.smithi091:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.220 INFO:teuthology.orchestra.run.smithi091.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 Dec 14 18:16 /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.221 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-choffman-62793/1faa353368ad4f5aeb56d7107b638336f58659ed/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 Dec 14 18:16 /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.768 DEBUG:teuthology.orchestra.run.smithi069:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.790 DEBUG:teuthology.orchestra.run.smithi091:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.811 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-14T18:16:48.847 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed on all hosts... 2023-12-14T18:16:48.847 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed pull 2023-12-14T18:16:48.849 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed pull 2023-12-14T18:16:48.853 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed pull 2023-12-14T18:16:50.206 INFO:teuthology.orchestra.run.smithi091.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T18:16:50.881 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T18:16:50.896 INFO:teuthology.orchestra.run.smithi069.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T18:17:30.318 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-14T18:17:30.318 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T18:17:30.318 INFO:teuthology.orchestra.run.smithi091.stdout: "image_id": "0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0", 2023-12-14T18:17:30.319 INFO:teuthology.orchestra.run.smithi091.stdout: "repo_digests": [ 2023-12-14T18:17:30.319 INFO:teuthology.orchestra.run.smithi091.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:4f00bb7c6b97266b68e12e45f4e426e52b86010cb97d3e773903241deee4098b" 2023-12-14T18:17:30.319 INFO:teuthology.orchestra.run.smithi091.stdout: ] 2023-12-14T18:17:30.319 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-14T18:17:31.018 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T18:17:31.018 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T18:17:31.018 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0", 2023-12-14T18:17:31.019 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2023-12-14T18:17:31.019 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:4f00bb7c6b97266b68e12e45f4e426e52b86010cb97d3e773903241deee4098b" 2023-12-14T18:17:31.019 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2023-12-14T18:17:31.019 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T18:17:31.720 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:17:31.721 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T18:17:31.721 INFO:teuthology.orchestra.run.smithi069.stdout: "image_id": "0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0", 2023-12-14T18:17:31.721 INFO:teuthology.orchestra.run.smithi069.stdout: "repo_digests": [ 2023-12-14T18:17:31.721 INFO:teuthology.orchestra.run.smithi069.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:4f00bb7c6b97266b68e12e45f4e426e52b86010cb97d3e773903241deee4098b" 2023-12-14T18:17:31.721 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:17:31.721 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:17:31.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph 2023-12-14T18:17:31.770 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph 2023-12-14T18:17:31.808 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2023-12-14T18:17:31.843 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /etc/ceph 2023-12-14T18:17:31.870 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /etc/ceph 2023-12-14T18:17:31.901 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2023-12-14T18:17:31.930 INFO:tasks.cephadm:Writing seed config... 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-14T18:17:31.931 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-14T18:17:31.932 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-14T18:17:31.933 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-14T18:17:31.934 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-14T18:17:31.934 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-12-14T18:17:31.934 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-12-14T18:17:31.934 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:17:31.934 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-14T18:17:31.951 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f1527c12-9aac-11ee-95a5-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-14T18:17:31.952 DEBUG:teuthology.orchestra.run.smithi069:mon.a> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a.service 2023-12-14T18:17:31.994 DEBUG:teuthology.orchestra.run.smithi069:mgr.x> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x.service 2023-12-14T18:17:32.020 INFO:journalctl@ceph.mon.a.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:17:32.021 INFO:tasks.cephadm:Bootstrapping... 2023-12-14T18:17:32.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed -v bootstrap --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.69 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:17:32.046 INFO:journalctl@ceph.mgr.x.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:17:32.268 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-14T18:17:32.268 INFO:teuthology.orchestra.run.smithi069.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed', '-v', 'bootstrap', '--fsid', 'f1527c12-9aac-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.69', '--skip-admin-label'] 2023-12-14T18:17:32.303 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.6.1 2023-12-14T18:17:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-14T18:17:32.304 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying podman|docker is present... 2023-12-14T18:17:32.344 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.6.1 2023-12-14T18:17:32.344 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying lvm2 is present... 2023-12-14T18:17:32.344 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying time synchronization is in place... 2023-12-14T18:17:32.351 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-14T18:17:32.352 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-14T18:17:32.357 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-14T18:17:32.357 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T18:17:32.363 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2023-12-14T18:17:32.369 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2023-12-14T18:17:32.369 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2023-12-14T18:17:32.369 INFO:teuthology.orchestra.run.smithi069.stdout:Repeating the final host check... 2023-12-14T18:17:32.402 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.6.1 2023-12-14T18:17:32.403 INFO:teuthology.orchestra.run.smithi069.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-14T18:17:32.403 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl is present 2023-12-14T18:17:32.403 INFO:teuthology.orchestra.run.smithi069.stdout:lvcreate is present 2023-12-14T18:17:32.408 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-14T18:17:32.409 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-14T18:17:32.414 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-14T18:17:32.414 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T18:17:32.420 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2023-12-14T18:17:32.426 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2023-12-14T18:17:32.426 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2023-12-14T18:17:32.426 INFO:teuthology.orchestra.run.smithi069.stdout:Host looks OK 2023-12-14T18:17:32.427 INFO:teuthology.orchestra.run.smithi069.stdout:Cluster fsid: f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:32.427 INFO:teuthology.orchestra.run.smithi069.stdout:Acquiring lock 139947620284904 on /run/cephadm/f1527c12-9aac-11ee-95a5-87774f69a715.lock 2023-12-14T18:17:32.427 INFO:teuthology.orchestra.run.smithi069.stdout:Lock 139947620284904 acquired on /run/cephadm/f1527c12-9aac-11ee-95a5-87774f69a715.lock 2023-12-14T18:17:32.427 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 3300 ... 2023-12-14T18:17:32.427 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 6789 ... 2023-12-14T18:17:32.427 INFO:teuthology.orchestra.run.smithi069.stdout:Base mon IP(s) is [172.21.15.69:3300, 172.21.15.69:6789], mon addrv is [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2023-12-14T18:17:32.431 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-12-14T18:17:32.431 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.69 metric 100 2023-12-14T18:17:32.434 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-14T18:17:32.434 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-12-14T18:17:32.434 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-12-14T18:17:32.436 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-14T18:17:32.437 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-14T18:17:32.437 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-14T18:17:32.437 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-14T18:17:32.437 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 fe80::13b6:b696:cf97:b326/64 scope link noprefixroute 2023-12-14T18:17:32.437 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-14T18:17:32.438 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2023-12-14T18:17:32.438 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2023-12-14T18:17:32.438 INFO:teuthology.orchestra.run.smithi069.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-14T18:17:32.438 INFO:teuthology.orchestra.run.smithi069.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-14T18:17:32.439 INFO:teuthology.orchestra.run.smithi069.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T18:17:32.860 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0 2023-12-14T18:17:32.860 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed... 2023-12-14T18:17:32.861 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Getting image source signatures 2023-12-14T18:17:32.861 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:a83bc5fcf8de435b160e58e3bb5830aa8038f139ef00a293340a26641aa5a474 2023-12-14T18:17:32.861 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-14T18:17:32.861 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying config sha256:0caf899250bd8e7e64baa66bc41be9a670e1a24f023c9b5250d24ffadc35c5c0 2023-12-14T18:17:32.861 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-14T18:17:33.588 INFO:teuthology.orchestra.run.smithi069.stdout:ceph: stdout ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev) 2023-12-14T18:17:33.588 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph version: ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev) 2023-12-14T18:17:33.588 INFO:teuthology.orchestra.run.smithi069.stdout:Extracting ceph user uid/gid from container image... 2023-12-14T18:17:34.195 INFO:teuthology.orchestra.run.smithi069.stdout:stat: stdout 167 167 2023-12-14T18:17:34.195 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial keys... 2023-12-14T18:17:34.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQC+RntlxeAfGRAAtqO17YjaEev6tc6NYII38g== 2023-12-14T18:17:36.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQC/RntlXzHaERAA3q2uzkWoCtXkcAwlveGxCw== 2023-12-14T18:17:38.023 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQDBRntlSPYrKBAAM+XAXZNCb7MGZxFgsSxJ+A== 2023-12-14T18:17:38.023 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial monmap... 2023-12-14T18:17:38.623 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-14T18:17:38.623 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-12-14T18:17:38.623 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:38.623 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-14T18:17:38.624 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool for a [v2:172.21.15.69:3300,v1:172.21.15.69:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-14T18:17:38.624 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = pacific 2023-12-14T18:17:38.624 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: set fsid to f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:38.624 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-14T18:17:38.624 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:17:38.624 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mon... 2023-12-14T18:17:39.217 INFO:teuthology.orchestra.run.smithi069.stdout:create mon.a on 2023-12-14T18:17:39.317 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-14T18:17:39.408 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-14T18:17:39.503 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f1527c12-9aac-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-f1527c12-9aac-11ee-95a5-87774f69a715.target. 2023-12-14T18:17:39.503 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f1527c12-9aac-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-f1527c12-9aac-11ee-95a5-87774f69a715.target. 2023-12-14T18:17:39.636 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a 2023-12-14T18:17:39.636 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a.service: Unit ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a.service not loaded. 2023-12-14T18:17:39.723 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f1527c12-9aac-11ee-95a5-87774f69a715.target.wants/ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a.service → /etc/systemd/system/ceph-f1527c12-9aac-11ee-95a5-87774f69a715@.service. 2023-12-14T18:17:39.763 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:39 smithi069 systemd[1]: Starting Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:17:40.133 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T18:17:40.134 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T18:17:40.142 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T18:17:40.142 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T18:17:40.142 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T18:17:40.142 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2023-12-14T18:17:40.142 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon to start... 2023-12-14T18:17:40.142 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon... 2023-12-14T18:17:40.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:40 smithi069 bash[41523]: 0eacbedb5b3084c4d53a69d14bb7e0e05666b9715c399b5ca973d6aa70b6cd3f 2023-12-14T18:17:40.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:40 smithi069 systemd[1]: Started Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:17:40.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:40 smithi069 ceph-mon[41562]: mkfs f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:40.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:40 smithi069 ceph-mon[41562]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-14T18:17:40.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout cluster: 2023-12-14T18:17:40.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout id: f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:40.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-14T18:17:40.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout services: 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.441834s) 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout data: 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pgs: 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:40.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84eb18f700 1 Processor -- start 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84eb18f700 1 -- start start 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84eb18f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e410a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84eb18f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e41062c0 con 0x7f84e4074020 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84e8f2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e410a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84e8f2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e410a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52450/0 (socket says 172.21.15.69:52450) 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.518+0000 7f84e8f2b700 1 -- 172.21.15.69:0/1273995185 learned_addr learned my addr 172.21.15.69:0/1273995185 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.519+0000 7f84e8f2b700 1 -- 172.21.15.69:0/1273995185 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e410ae10 con 0x7f84e4074020 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.519+0000 7f84e8f2b700 1 --2- 172.21.15.69:0/1273995185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e410a8d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098a0 tx=0x7f84d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31081e47540e28a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.519+0000 7f84e37fe700 1 -- 172.21.15.69:0/1273995185 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84d8004160 con 0x7f84e4074020 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.519+0000 7f84e37fe700 1 -- 172.21.15.69:0/1273995185 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80042c0 con 0x7f84e4074020 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.519+0000 7f84e37fe700 1 -- 172.21.15.69:0/1273995185 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84d80045a0 con 0x7f84e4074020 2023-12-14T18:17:40.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- 172.21.15.69:0/1273995185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 msgr2=0x7f84e410a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 --2- 172.21.15.69:0/1273995185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e410a8d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098a0 tx=0x7f84d8009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- 172.21.15.69:0/1273995185 shutdown_connections 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 --2- 172.21.15.69:0/1273995185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e410a8d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- 172.21.15.69:0/1273995185 >> 172.21.15.69:0/1273995185 conn(0x7f84e40ffea0 msgr2=0x7f84e41022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- 172.21.15.69:0/1273995185 shutdown_connections 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- 172.21.15.69:0/1273995185 wait complete. 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 Processor -- start 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- start start 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.520+0000 7f84eb18f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e419b5f0 con 0x7f84e4074020 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e8f2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e8f2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e419b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52466/0 (socket says 172.21.15.69:52466) 2023-12-14T18:17:40.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e8f2b700 1 -- 172.21.15.69:0/3415688147 learned_addr learned my addr 172.21.15.69:0/3415688147 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e8f2b700 1 -- 172.21.15.69:0/3415688147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8009550 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e8f2b700 1 --2- 172.21.15.69:0/3415688147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e419b0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f84d8004000 tx=0x7f84d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84d8011630 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8011790 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84d8011a30 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e410b250 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e410b0c0 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84d8022070 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.521+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f84d801c450 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.522+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e410b3e0 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.524+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f84d801b450 con 0x7f84e4074020 2023-12-14T18:17:40.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.595+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f84e419bc90 con 0x7f84e4074020 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.595+0000 7f84e1ffb700 1 -- 172.21.15.69:0/3415688147 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f84d801b5f0 con 0x7f84e4074020 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 msgr2=0x7f84e419b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 --2- 172.21.15.69:0/3415688147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e419b0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f84d8004000 tx=0x7f84d8004750 comp rx=0 tx=0).stop 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 shutdown_connections 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 --2- 172.21.15.69:0/3415688147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84e4074020 0x7f84e419b0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 >> 172.21.15.69:0/3415688147 conn(0x7f84e40ffea0 msgr2=0x7f84e41018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 shutdown_connections 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:40.596+0000 7f84eb18f700 1 -- 172.21.15.69:0/3415688147 wait complete. 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:mon is available 2023-12-14T18:17:40.949 INFO:teuthology.orchestra.run.smithi069.stdout:Assimilating anything we can from ceph.conf... 2023-12-14T18:17:41.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:41 smithi069 ceph-mon[41562]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-14T18:17:41.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:41 smithi069 ceph-mon[41562]: monmap e1: 1 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0]} removed_ranks: {} 2023-12-14T18:17:41.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:41 smithi069 ceph-mon[41562]: fsmap 2023-12-14T18:17:41.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:41 smithi069 ceph-mon[41562]: osdmap e1: 0 total, 0 up, 0 in 2023-12-14T18:17:41.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:41 smithi069 ceph-mon[41562]: mgrmap e1: no daemons active 2023-12-14T18:17:41.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:41 smithi069 ceph-mon[41562]: from='client.? 172.21.15.69:0/3415688147' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-14T18:17:41.760 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:41.760 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-14T18:17:41.761 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.324+0000 7fe1ce1a4700 1 Processor -- start 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.324+0000 7fe1ce1a4700 1 -- start start 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.325+0000 7fe1ce1a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8105db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.325+0000 7fe1ce1a4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81062f0 con 0x7fe1c81059a0 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.325+0000 7fe1c77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8105db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.325+0000 7fe1c77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8105db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52476/0 (socket says 172.21.15.69:52476) 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.325+0000 7fe1c77fe700 1 -- 172.21.15.69:0/1142255787 learned_addr learned my addr 172.21.15.69:0/1142255787 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.325+0000 7fe1c77fe700 1 -- 172.21.15.69:0/1142255787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8106430 con 0x7fe1c81059a0 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1c77fe700 1 --2- 172.21.15.69:0/1142255787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8105db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00098a0 tx=0x7fe1b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4ca1eea505e3d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1c67fc700 1 -- 172.21.15.69:0/1142255787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0004160 con 0x7fe1c81059a0 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1c67fc700 1 -- 172.21.15.69:0/1142255787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b00042c0 con 0x7fe1c81059a0 2023-12-14T18:17:41.762 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1c67fc700 1 -- 172.21.15.69:0/1142255787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b00045a0 con 0x7fe1c81059a0 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/1142255787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 msgr2=0x7fe1c8105db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 --2- 172.21.15.69:0/1142255787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8105db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00098a0 tx=0x7fe1b0009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/1142255787 shutdown_connections 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 --2- 172.21.15.69:0/1142255787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8105db0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/1142255787 >> 172.21.15.69:0/1142255787 conn(0x7fe1c8101010 msgr2=0x7fe1c8103420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/1142255787 shutdown_connections 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.326+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/1142255787 wait complete. 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1ce1a4700 1 Processor -- start 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1ce1a4700 1 -- start start 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1ce1a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1ce1a4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81993f0 con 0x7fe1c81059a0 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1c77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1c77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52488/0 (socket says 172.21.15.69:52488) 2023-12-14T18:17:41.763 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.327+0000 7fe1c77fe700 1 -- 172.21.15.69:0/3074432753 learned_addr learned my addr 172.21.15.69:0/3074432753 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c77fe700 1 -- 172.21.15.69:0/3074432753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0009550 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c77fe700 1 --2- 172.21.15.69:0/3074432753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8198eb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe1c81066d0 tx=0x7fe1b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0011630 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0011790 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c8106ef0 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0011a30 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c8106d60 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe1b0022070 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.328+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe1b001c450 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.329+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c8107080 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.331+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe1b001b450 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.398+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe1c802cfe0 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.402+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe1b001b5f0 con 0x7fe1c81059a0 2023-12-14T18:17:41.764 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.402+0000 7fe1c4ff9700 1 -- 172.21.15.69:0/3074432753 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fe1b0037540 con 0x7fe1c81059a0 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 msgr2=0x7fe1c8198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 --2- 172.21.15.69:0/3074432753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8198eb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe1c81066d0 tx=0x7fe1b0004750 comp rx=0 tx=0).stop 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 shutdown_connections 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 --2- 172.21.15.69:0/3074432753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1c81059a0 0x7fe1c8198eb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 >> 172.21.15.69:0/3074432753 conn(0x7fe1c8101010 msgr2=0x7fe1c818d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 shutdown_connections 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:41.403+0000 7fe1ce1a4700 1 -- 172.21.15.69:0/3074432753 wait complete. 2023-12-14T18:17:41.765 INFO:teuthology.orchestra.run.smithi069.stdout:Generating new minimal ceph.conf... 2023-12-14T18:17:42.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:42 smithi069 ceph-mon[41562]: from='client.? 172.21.15.69:0/3074432753' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-14T18:17:42.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:42 smithi069 ceph-mon[41562]: from='client.? 172.21.15.69:0/3074432753' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.099+0000 7f2554237700 1 Processor -- start 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2554237700 1 -- start start 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2554237700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c104010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2554237700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c104550 con 0x7f254c103c00 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2551fd3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c104010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2551fd3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c104010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52492/0 (socket says 172.21.15.69:52492) 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2551fd3700 1 -- 172.21.15.69:0/901990095 learned_addr learned my addr 172.21.15.69:0/901990095 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2551fd3700 1 -- 172.21.15.69:0/901990095 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c104690 con 0x7f254c103c00 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.100+0000 7f2551fd3700 1 --2- 172.21.15.69:0/901990095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c104010 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e80 tx=0x7f254400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b977910dcbe060d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2550fd1700 1 -- 172.21.15.69:0/901990095 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f254400e070 con 0x7f254c103c00 2023-12-14T18:17:42.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2550fd1700 1 -- 172.21.15.69:0/901990095 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2544003e90 con 0x7f254c103c00 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2550fd1700 1 -- 172.21.15.69:0/901990095 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2544004360 con 0x7f254c103c00 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 -- 172.21.15.69:0/901990095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 msgr2=0x7f254c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 --2- 172.21.15.69:0/901990095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c104010 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e80 tx=0x7f254400b330 comp rx=0 tx=0).stop 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 -- 172.21.15.69:0/901990095 shutdown_connections 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 --2- 172.21.15.69:0/901990095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c104010 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 -- 172.21.15.69:0/901990095 >> 172.21.15.69:0/901990095 conn(0x7f254c0ff5e0 msgr2=0x7f254c101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 -- 172.21.15.69:0/901990095 shutdown_connections 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.101+0000 7f2554237700 1 -- 172.21.15.69:0/901990095 wait complete. 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2554237700 1 Processor -- start 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2554237700 1 -- start start 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2554237700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c106590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:42.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2554237700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c106ad0 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2551fd3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c106590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2551fd3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c106590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52504/0 (socket says 172.21.15.69:52504) 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2551fd3700 1 -- 172.21.15.69:0/3277778259 learned_addr learned my addr 172.21.15.69:0/3277778259 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2551fd3700 1 -- 172.21.15.69:0/3277778259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009b30 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f2551fd3700 1 --2- 172.21.15.69:0/3277778259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c106590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f25440072a0 tx=0x7f2544003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.102+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f254400e040 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.103+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f25440128a0 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.103+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f254401c6b0 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.103+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c107970 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.103+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c1077e0 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.103+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f254401cc70 con 0x7f254c103c00 2023-12-14T18:17:42.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.103+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f254401b720 con 0x7f254c103c00 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.104+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c062120 con 0x7f254c103c00 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.106+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f254402a060 con 0x7f254c103c00 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.174+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f254c1055a0 con 0x7f254c103c00 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.174+0000 7f254affd700 1 -- 172.21.15.69:0/3277778259 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f2544033090 con 0x7f254c103c00 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 msgr2=0x7f254c106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 --2- 172.21.15.69:0/3277778259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c106590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f25440072a0 tx=0x7f2544003d00 comp rx=0 tx=0).stop 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 shutdown_connections 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 --2- 172.21.15.69:0/3277778259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f254c103c00 0x7f254c106590 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 >> 172.21.15.69:0/3277778259 conn(0x7f254c0ff5e0 msgr2=0x7f254c100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 shutdown_connections 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:42.175+0000 7f2554237700 1 -- 172.21.15.69:0/3277778259 wait complete. 2023-12-14T18:17:42.521 INFO:teuthology.orchestra.run.smithi069.stdout:Restarting the monitor... 2023-12-14T18:17:42.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:42 smithi069 systemd[1]: Stopping Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:17:43.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a[41538]: 2023-12-14T18:17:43.033+0000 7fbac87c2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:17:43.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a[41538]: 2023-12-14T18:17:43.034+0000 7fbac87c2700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-14T18:17:43.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:43 smithi069 bash[41889]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a 2023-12-14T18:17:44.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:43 smithi069 systemd[1]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a.service: Succeeded. 2023-12-14T18:17:44.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:43 smithi069 systemd[1]: Stopped Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:17:44.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:43 smithi069 systemd[1]: Starting Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:17:44.071 INFO:teuthology.orchestra.run.smithi069.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: set uid:gid to 167:167 (ceph:ceph) 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev), process ceph-mon, pid 7 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: pidfile_write: ignore empty --pid-file 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: load: jerasure load: lrc 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: RocksDB version: 7.9.2 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Git sha 0 2023-12-14T18:17:44.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Compile date 2023-12-13 16:19:48 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: DB SUMMARY 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: DB Session ID: VYN6A12GDGV7WAWJF97H 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: CURRENT file: CURRENT 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: IDENTITY file: IDENTITY 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 bash[42010]: bd9183de81f67054f29fb07f6408326de6749187184277a66df5fe656026fb60 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 97140 ; 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.error_if_exists: 0 2023-12-14T18:17:44.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.create_if_missing: 0 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.paranoid_checks: 1 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.env: 0x558cc8bf5720 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.fs: PosixFileSystem 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.info_log: 0x558ccc0ff3c0 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_file_opening_threads: 16 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.statistics: (nil) 2023-12-14T18:17:44.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.use_fsync: 0 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_log_file_size: 0 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.keep_log_file_num: 1000 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.recycle_log_file_num: 0 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.allow_fallocate: 1 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.allow_mmap_reads: 0 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.allow_mmap_writes: 0 2023-12-14T18:17:44.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.use_direct_reads: 0 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.create_missing_column_families: 0 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.db_log_dir: 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.wal_dir: 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-14T18:17:44.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.advise_random_on_open: 1 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.db_write_buffer_size: 0 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.write_buffer_manager: 0x558ccb3703c0 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.rate_limiter: (nil) 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.wal_recovery_mode: 2 2023-12-14T18:17:44.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.enable_thread_tracking: 0 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.enable_pipelined_write: 0 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.unordered_write: 0 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.row_cache: None 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.wal_filter: None 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.allow_ingest_behind: 0 2023-12-14T18:17:44.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.two_write_queues: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.manual_wal_flush: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.wal_compression: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.atomic_flush: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.log_readahead_size: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.best_efforts_recovery: 0 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-14T18:17:44.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.allow_data_in_errors: 0 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.db_host_id: __hostname__ 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_background_jobs: 2 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_background_compactions: -1 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_subcompactions: 1 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_total_wal_size: 0 2023-12-14T18:17:44.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_open_files: -1 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bytes_per_sync: 0 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_readahead_size: 0 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_background_flushes: -1 2023-12-14T18:17:44.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Compression algorithms supported: 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kZSTD supported: 0 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kXpressCompression supported: 0 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kLZ4HCCompression supported: 1 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kZlibCompression supported: 1 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kSnappyCompression supported: 1 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kLZ4Compression supported: 1 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: kBZip2Compression supported: 0 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-14T18:17:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.merge_operator: 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_filter: None 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_filter_factory: None 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.sst_partitioner_factory: None 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558ccc0ff4e0) 2023-12-14T18:17:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks: 1 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_top_level_index_and_filter: 1 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_type: 0 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_index_type: 0 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_shortening: 1 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: checksum: 4 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: no_block_cache: 0 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache: 0x558ccb4111f0 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_name: BinnedLRUCache 2023-12-14T18:17:44.472 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_options: 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: capacity : 536870912 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_shard_bits : 4 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: strict_capacity_limit : 0 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: high_pri_pool_ratio: 0.000 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_compressed: (nil) 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: persistent_cache: (nil) 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size: 4096 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size_deviation: 10 2023-12-14T18:17:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_restart_interval: 16 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_block_restart_interval: 1 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: metadata_block_size: 4096 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: partition_filters: 0 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: use_delta_encoding: 1 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: filter_policy: bloomfilter 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: whole_key_filtering: 1 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: verify_compression: 0 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: read_amp_bytes_per_bit: 0 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: format_version: 5 2023-12-14T18:17:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_index_compression: 1 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_align: 0 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout: max_auto_readahead_size: 262144 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout: prepopulate_block_cache: 0 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout: initial_auto_readahead_size: 8192 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_file_reads_for_auto_readahead: 2 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.write_buffer_size: 33554432 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_write_buffer_number: 2 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression: NoCompression 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression: Disabled 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.prefix_extractor: nullptr 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-14T18:17:44.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.num_levels: 7 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-14T18:17:44.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.level: 32767 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.strategy: 0 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.enabled: false 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-14T18:17:44.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.target_file_size_base: 67108864 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-14T18:17:44.478 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.arena_block_size: 1048576 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.disable_auto_compactions: 0 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-14T18:17:44.479 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.table_properties_collectors: 2023-12-14T18:17:44.480 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.inplace_update_support: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.bloom_locality: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.max_successive_merges: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.paranoid_file_checks: 0 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.force_consistency_checks: 1 2023-12-14T18:17:44.481 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.report_bg_io_stats: 0 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.ttl: 2592000 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.enable_blob_files: false 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.min_blob_size: 0 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.blob_file_size: 268435456 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-14T18:17:44.482 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.blob_file_starting_level: 0 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 43a83955-0a37-4b00-87ac-94cb4dc36b0c 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702577864068407, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702577864069407, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92583, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 307, "table_properties": {"data_size": 90582, "index_size": 283, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13574, "raw_average_key_size": 50, "raw_value_size": 83164, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 270, "num_filter_entries": 270, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702577864, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "43a83955-0a37-4b00-87ac-94cb4dc36b0c", "db_session_id": "VYN6A12GDGV7WAWJF97H", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-12-14T18:17:44.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702577864069478, "job": 1, "event": "recovery_finished"} 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 systemd[1]: Started Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558ccb4ae000 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: DB pointer 0x558ccb49a000 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** DB Stats ** 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-14T18:17:44.484 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: L0 2/0 92.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T18:17:44.485 INFO:journalctl@ceph.mon.a.smithi069.stdout: Sum 2/0 92.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-14T18:17:44.486 INFO:journalctl@ceph.mon.a.smithi069.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative compaction: 0.00 GB write, 24.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval compaction: 0.00 GB write, 24.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache BinnedLRUCache@0x558ccb4111f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T18:17:44.487 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: starting mon.a rank 0 at public addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] at bind addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???) e1 preinit fsid f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).mds e1 new map 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).mds e1 print_map 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout: e1 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout: legacy client fscid: -1 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout: No filesystems configured 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-14T18:17:44.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expand map: {default=false} 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta from 'false' to 'false' 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expanded map: {default=false} 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expand map: {default=info} 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta from 'info' to 'info' 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expanded map: {default=info} 2023-12-14T18:17:44.489 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expand map: {default=daemon} 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta from 'daemon' to 'daemon' 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expanded map: {default=daemon} 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expand map: {default=debug} 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta from 'debug' to 'debug' 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: expand_channel_meta expanded map: {default=debug} 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: monmap e1: 1 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0]} removed_ranks: {} 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: fsmap 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: osdmap e1: 0 total, 0 up, 0 in 2023-12-14T18:17:44.490 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:44 smithi069 ceph-mon[42047]: mgrmap e1: no daemons active 2023-12-14T18:17:44.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.405+0000 7f2292289700 1 Processor -- start 2023-12-14T18:17:44.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.405+0000 7f2292289700 1 -- start start 2023-12-14T18:17:44.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.405+0000 7f2292289700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:44.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.405+0000 7f2292289700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c0740c0 con 0x7f228c106420 2023-12-14T18:17:44.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52508/0 (socket says 172.21.15.69:52508) 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228bfff700 1 -- 172.21.15.69:0/1752138454 learned_addr learned my addr 172.21.15.69:0/1752138454 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228bfff700 1 -- 172.21.15.69:0/1752138454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c074200 con 0x7f228c106420 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228bfff700 1 --2- 172.21.15.69:0/1752138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c108800 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f227c0098a0 tx=0x7f227c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc14172125a7a24c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228affd700 1 -- 172.21.15.69:0/1752138454 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f227c004160 con 0x7f228c106420 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228affd700 1 -- 172.21.15.69:0/1752138454 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f227c0042c0 con 0x7f228c106420 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.406+0000 7f228affd700 1 -- 172.21.15.69:0/1752138454 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f227c011940 con 0x7f228c106420 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 -- 172.21.15.69:0/1752138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 msgr2=0x7f228c108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 --2- 172.21.15.69:0/1752138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c108800 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f227c0098a0 tx=0x7f227c009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:44.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 -- 172.21.15.69:0/1752138454 shutdown_connections 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 --2- 172.21.15.69:0/1752138454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c108800 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 -- 172.21.15.69:0/1752138454 >> 172.21.15.69:0/1752138454 conn(0x7f228c0ffea0 msgr2=0x7f228c1022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 -- 172.21.15.69:0/1752138454 shutdown_connections 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 -- 172.21.15.69:0/1752138454 wait complete. 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 Processor -- start 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.407+0000 7f2292289700 1 -- start start 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f2292289700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f2292289700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c199a70 con 0x7f228c106420 2023-12-14T18:17:44.888 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f228bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f228bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52512/0 (socket says 172.21.15.69:52512) 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f228bfff700 1 -- 172.21.15.69:0/1141055721 learned_addr learned my addr 172.21.15.69:0/1141055721 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f228bfff700 1 -- 172.21.15.69:0/1141055721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c009550 con 0x7f228c106420 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f228bfff700 1 --2- 172.21.15.69:0/1141055721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c199530 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f227c006af0 tx=0x7f227c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f227c003bf0 con 0x7f228c106420 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c109b40 con 0x7f228c106420 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f227c01b8b0 con 0x7f228c106420 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f227c0198b0 con 0x7f228c106420 2023-12-14T18:17:44.889 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.408+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c1099b0 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.409+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f227c0233f0 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.409+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f227c01a7a0 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.409+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c062120 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.412+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f227c028060 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.479+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f228c199fb0 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.482+0000 7f22897fa700 1 -- 172.21.15.69:0/1141055721 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f227c01bd70 con 0x7f228c106420 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 msgr2=0x7f228c199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 --2- 172.21.15.69:0/1141055721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c199530 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f227c006af0 tx=0x7f227c011a30 comp rx=0 tx=0).stop 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 shutdown_connections 2023-12-14T18:17:44.890 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 --2- 172.21.15.69:0/1141055721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c106420 0x7f228c199530 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 >> 172.21.15.69:0/1141055721 conn(0x7f228c0ffea0 msgr2=0x7f228c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 shutdown_connections 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:44.483+0000 7f2292289700 1 -- 172.21.15.69:0/1141055721 wait complete. 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mgr... 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 9283 ... 2023-12-14T18:17:44.891 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 8765 ... 2023-12-14T18:17:45.008 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x 2023-12-14T18:17:45.008 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x.service: Unit ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x.service not loaded. 2023-12-14T18:17:45.100 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f1527c12-9aac-11ee-95a5-87774f69a715.target.wants/ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-f1527c12-9aac-11ee-95a5-87774f69a715@.service. 2023-12-14T18:17:45.516 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T18:17:45.516 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T18:17:45.525 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T18:17:45.525 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T18:17:45.525 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T18:17:45.525 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2023-12-14T18:17:45.534 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T18:17:45.535 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T18:17:45.543 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T18:17:45.543 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T18:17:45.543 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T18:17:45.544 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-12-14T18:17:45.544 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr to start... 2023-12-14T18:17:45.544 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr... 2023-12-14T18:17:45.848 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:45 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1141055721' entity='client.admin' 2023-12-14T18:17:45.848 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:45 smithi069 bash[42280]: fb8afe99ccd2054dfa13341943a807bb27d27c66a894bd4fc37c57f81c065ea4 2023-12-14T18:17:45.848 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:45 smithi069 systemd[1]: Started Ceph mgr.x for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:17:46.148 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:45.845+0000 7f956d9be200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T18:17:46.149 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:45.954+0000 7f956d9be200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T18:17:46.149 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:46.051+0000 7f956d9be200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T18:17:46.149 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:46.146+0000 7f956d9be200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T18:17:46.354 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:46.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:17:46.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:17:46.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2023-12-14T18:17:46.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T18:17:46.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T18:17:46.365 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T18:17:46.366 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T18:17:40.157153+0000", 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.921+0000 7f528a1d8700 1 Processor -- start 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.921+0000 7f528a1d8700 1 -- start start 2023-12-14T18:17:46.367 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.921+0000 7f528a1d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f5284108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.921+0000 7f528a1d8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52840740c0 con 0x7f5284106420 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52837fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f5284108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52837fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f5284108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46016/0 (socket says 172.21.15.69:46016) 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52837fe700 1 -- 172.21.15.69:0/1238721746 learned_addr learned my addr 172.21.15.69:0/1238721746 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52837fe700 1 -- 172.21.15.69:0/1238721746 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284074200 con 0x7f5284106420 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52837fe700 1 --2- 172.21.15.69:0/1238721746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f5284108800 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f52740098a0 tx=0x7f5274009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6b1d39c4ec78d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52827fc700 1 -- 172.21.15.69:0/1238721746 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5274004160 con 0x7f5284106420 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52827fc700 1 -- 172.21.15.69:0/1238721746 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f52740042c0 con 0x7f5284106420 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.922+0000 7f52827fc700 1 -- 172.21.15.69:0/1238721746 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5274011940 con 0x7f5284106420 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 -- 172.21.15.69:0/1238721746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 msgr2=0x7f5284108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 --2- 172.21.15.69:0/1238721746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f5284108800 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f52740098a0 tx=0x7f5274009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 -- 172.21.15.69:0/1238721746 shutdown_connections 2023-12-14T18:17:46.368 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 --2- 172.21.15.69:0/1238721746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f5284108800 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 -- 172.21.15.69:0/1238721746 >> 172.21.15.69:0/1238721746 conn(0x7f52840ffea0 msgr2=0x7f52841022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 -- 172.21.15.69:0/1238721746 shutdown_connections 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.923+0000 7f528a1d8700 1 -- 172.21.15.69:0/1238721746 wait complete. 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f528a1d8700 1 Processor -- start 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f528a1d8700 1 -- start start 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f528a1d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f528419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f528a1d8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528419bd20 con 0x7f5284106420 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f52837fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f528419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f52837fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f528419b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46024/0 (socket says 172.21.15.69:46024) 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f52837fe700 1 -- 172.21.15.69:0/3744983090 learned_addr learned my addr 172.21.15.69:0/3744983090 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.924+0000 7f52837fe700 1 -- 172.21.15.69:0/3744983090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274009550 con 0x7f5284106420 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f52837fe700 1 --2- 172.21.15.69:0/3744983090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f528419b7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5274000c00 tx=0x7f5274011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:46.369 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740036a0 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f527401b440 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740193f0 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5284109b40 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52841099b0 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5274019930 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.925+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f527401a710 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.926+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5284109cd0 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:45.928+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f5274029060 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.000+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f528419c320 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.001+0000 7f5280ff9700 1 -- 172.21.15.69:0/3744983090 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f527401f070 con 0x7f5284106420 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.002+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 msgr2=0x7f528419b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.002+0000 7f528a1d8700 1 --2- 172.21.15.69:0/3744983090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f528419b7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5274000c00 tx=0x7f5274011e70 comp rx=0 tx=0).stop 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.002+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 shutdown_connections 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.002+0000 7f528a1d8700 1 --2- 172.21.15.69:0/3744983090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5284106420 0x7f528419b7e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.002+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 >> 172.21.15.69:0/3744983090 conn(0x7f52840ffea0 msgr2=0x7f5284100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:46.370 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.002+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 shutdown_connections 2023-12-14T18:17:46.371 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:46.003+0000 7f528a1d8700 1 -- 172.21.15.69:0/3744983090 wait complete. 2023-12-14T18:17:46.371 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (1/15)... 2023-12-14T18:17:46.773 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:46 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3744983090' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T18:17:47.097 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:46.771+0000 7f956d9be200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:17:47.098 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.011+0000 7f956d9be200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T18:17:47.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.096+0000 7f956d9be200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T18:17:47.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.204+0000 7f956d9be200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T18:17:47.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.294+0000 7f956d9be200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T18:17:47.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.487+0000 7f956d9be200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T18:17:47.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.571+0000 7f956d9be200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T18:17:48.205 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:47.942+0000 7f956d9be200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T18:17:48.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:48.204+0000 7f956d9be200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T18:17:48.794 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:48.495+0000 7f956d9be200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T18:17:48.794 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:48.591+0000 7f956d9be200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T18:17:49.094 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:48 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1233245141' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T18:17:49.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:49.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:17:49.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:17:49.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T18:17:49.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T18:17:49.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T18:17:49.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T18:17:49.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T18:17:49.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:49.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T18:17:49.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T18:17:49.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T18:17:49.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T18:17:40.157153+0000", 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T18:17:49.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.691+0000 7fba34ad0700 1 Processor -- start 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.691+0000 7fba34ad0700 1 -- start start 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.691+0000 7fba34ad0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.691+0000 7fba34ad0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300740c0 con 0x7fba30106420 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46040/0 (socket says 172.21.15.69:46040) 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2e59c700 1 -- 172.21.15.69:0/3411536514 learned_addr learned my addr 172.21.15.69:0/3411536514 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2e59c700 1 -- 172.21.15.69:0/3411536514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30074200 con 0x7fba30106420 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2e59c700 1 --2- 172.21.15.69:0/3411536514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30108800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba200098a0 tx=0x7fba20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f84e2a5bc65eef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2d59a700 1 -- 172.21.15.69:0/3411536514 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba20004160 con 0x7fba30106420 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2d59a700 1 -- 172.21.15.69:0/3411536514 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fba200042c0 con 0x7fba30106420 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.692+0000 7fba2d59a700 1 -- 172.21.15.69:0/3411536514 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba20011940 con 0x7fba30106420 2023-12-14T18:17:49.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 -- 172.21.15.69:0/3411536514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 msgr2=0x7fba30108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 --2- 172.21.15.69:0/3411536514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30108800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba200098a0 tx=0x7fba20009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 -- 172.21.15.69:0/3411536514 shutdown_connections 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 --2- 172.21.15.69:0/3411536514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30108800 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 -- 172.21.15.69:0/3411536514 >> 172.21.15.69:0/3411536514 conn(0x7fba300ffea0 msgr2=0x7fba301022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 -- 172.21.15.69:0/3411536514 shutdown_connections 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.693+0000 7fba34ad0700 1 -- 172.21.15.69:0/3411536514 wait complete. 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba34ad0700 1 Processor -- start 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba34ad0700 1 -- start start 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba34ad0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30105d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba34ad0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba301062c0 con 0x7fba30106420 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba2e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30105d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba2e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30105d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46044/0 (socket says 172.21.15.69:46044) 2023-12-14T18:17:49.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.694+0000 7fba2e59c700 1 -- 172.21.15.69:0/1233245141 learned_addr learned my addr 172.21.15.69:0/1233245141 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba2e59c700 1 -- 172.21.15.69:0/1233245141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009550 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba2e59c700 1 --2- 172.21.15.69:0/1233245141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30105d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fba20006af0 tx=0x7fba20011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba20003bf0 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba30109b40 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fba2001b8b0 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba200198b0 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba301099b0 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba200233f0 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.695+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fba2001a750 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.696+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba30109cd0 con 0x7fba30106420 2023-12-14T18:17:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.700+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fba20028060 con 0x7fba30106420 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.772+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fba30104bf0 con 0x7fba30106420 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.772+0000 7fba1f7fe700 1 -- 172.21.15.69:0/1233245141 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fba2001bd70 con 0x7fba30106420 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 msgr2=0x7fba30105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 --2- 172.21.15.69:0/1233245141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30105d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fba20006af0 tx=0x7fba20011a30 comp rx=0 tx=0).stop 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 shutdown_connections 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 --2- 172.21.15.69:0/1233245141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba30106420 0x7fba30105d80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 >> 172.21.15.69:0/1233245141 conn(0x7fba300ffea0 msgr2=0x7fba30100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 shutdown_connections 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:48.773+0000 7fba34ad0700 1 -- 172.21.15.69:0/1233245141 wait complete. 2023-12-14T18:17:49.154 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (2/15)... 2023-12-14T18:17:49.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:49.373+0000 7f956d9be200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T18:17:49.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:49.468+0000 7f956d9be200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T18:17:49.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:49.614+0000 7f956d9be200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T18:17:50.615 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:50.238+0000 7f956d9be200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T18:17:50.615 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:50.420+0000 7f956d9be200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T18:17:50.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:50.613+0000 7f956d9be200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T18:17:51.590 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:51.332+0000 7f956d9be200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T18:17:51.863 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:51 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2753426681' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T18:17:51.863 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:51.823+0000 7f956d9be200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:17:51.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T18:17:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T18:17:51.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T18:17:51.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T18:17:51.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T18:17:51.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T18:17:40.157153+0000", 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc61c92700 1 Processor -- start 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc61c92700 1 -- start start 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc61c92700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c0791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:51.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc61c92700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0796e0 con 0x7efc5c07aca0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c0791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c0791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46058/0 (socket says 172.21.15.69:46058) 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc5b7fe700 1 -- 172.21.15.69:0/1628003894 learned_addr learned my addr 172.21.15.69:0/1628003894 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc5b7fe700 1 -- 172.21.15.69:0/1628003894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c079820 con 0x7efc5c07aca0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.487+0000 7efc5b7fe700 1 --2- 172.21.15.69:0/1628003894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c0791a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0098a0 tx=0x7efc4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c09507c5ee157e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc5a7fc700 1 -- 172.21.15.69:0/1628003894 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc4c004160 con 0x7efc5c07aca0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc5a7fc700 1 -- 172.21.15.69:0/1628003894 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efc4c0042c0 con 0x7efc5c07aca0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc5a7fc700 1 -- 172.21.15.69:0/1628003894 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc4c011940 con 0x7efc5c07aca0 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc61c92700 1 -- 172.21.15.69:0/1628003894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 msgr2=0x7efc5c0791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc61c92700 1 --2- 172.21.15.69:0/1628003894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c0791a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0098a0 tx=0x7efc4c009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc61c92700 1 -- 172.21.15.69:0/1628003894 shutdown_connections 2023-12-14T18:17:51.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc61c92700 1 --2- 172.21.15.69:0/1628003894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c0791a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.488+0000 7efc61c92700 1 -- 172.21.15.69:0/1628003894 >> 172.21.15.69:0/1628003894 conn(0x7efc5c100f70 msgr2=0x7efc5c1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.489+0000 7efc61c92700 1 -- 172.21.15.69:0/1628003894 shutdown_connections 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.489+0000 7efc61c92700 1 -- 172.21.15.69:0/1628003894 wait complete. 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.489+0000 7efc61c92700 1 Processor -- start 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.489+0000 7efc61c92700 1 -- start start 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc61c92700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc61c92700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c19bd60 con 0x7efc5c07aca0 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46068/0 (socket says 172.21.15.69:46068) 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc5b7fe700 1 -- 172.21.15.69:0/2753426681 learned_addr learned my addr 172.21.15.69:0/2753426681 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc5b7fe700 1 -- 172.21.15.69:0/2753426681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009550 con 0x7efc5c07aca0 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc5b7fe700 1 --2- 172.21.15.69:0/2753426681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c19b820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc4c006af0 tx=0x7efc4c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc4c003bf0 con 0x7efc5c07aca0 2023-12-14T18:17:51.926 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c10bd70 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efc4c01b8b0 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc4c0198b0 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.490+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c10bbe0 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.491+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc4c0233f0 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.491+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc4c01a7a0 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.491+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c10bf00 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.493+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7efc4c028060 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.565+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7efc5c19c2a0 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.565+0000 7efc58ff9700 1 -- 172.21.15.69:0/2753426681 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7efc4c01bd70 con 0x7efc5c07aca0 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 msgr2=0x7efc5c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 --2- 172.21.15.69:0/2753426681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c19b820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc4c006af0 tx=0x7efc4c011a30 comp rx=0 tx=0).stop 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 shutdown_connections 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 --2- 172.21.15.69:0/2753426681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c07aca0 0x7efc5c19b820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:51.927 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 >> 172.21.15.69:0/2753426681 conn(0x7efc5c100f70 msgr2=0x7efc5c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:51.928 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 shutdown_connections 2023-12-14T18:17:51.928 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:51.566+0000 7efc61c92700 1 -- 172.21.15.69:0/2753426681 wait complete. 2023-12-14T18:17:51.928 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (3/15)... 2023-12-14T18:17:52.208 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:51.914+0000 7f956d9be200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T18:17:52.208 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:52.104+0000 7f956d9be200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: Activating manager daemon x 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: mgrmap e2: x(active, starting, since 0.00306166s) 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:17:52.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T18:17:52.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: Manager daemon x is now available 2023-12-14T18:17:52.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T18:17:52.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T18:17:52.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' 2023-12-14T18:17:52.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' 2023-12-14T18:17:52.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:52 smithi069 ceph-mon[42047]: from='mgr.14100 172.21.15.69:0/2751362806' entity='mgr.x' 2023-12-14T18:17:54.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:54 smithi069 ceph-mon[42047]: mgrmap e3: x(active, since 1.0087s) 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-14T18:17:54.896 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-14T18:17:54.897 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-14T18:17:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-14T18:17:54.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2023-12-14T18:17:40.157153+0000", 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10d0a73700 1 Processor -- start 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10d0a73700 1 -- start start 2023-12-14T18:17:54.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10d0a73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10d0a73700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc106270 con 0x7f10cc105920 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10ca59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10ca59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46148/0 (socket says 172.21.15.69:46148) 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10ca59c700 1 -- 172.21.15.69:0/162544516 learned_addr learned my addr 172.21.15.69:0/162544516 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10ca59c700 1 -- 172.21.15.69:0/162544516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc1063b0 con 0x7f10cc105920 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.266+0000 7f10ca59c700 1 --2- 172.21.15.69:0/162544516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc105d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10b40098a0 tx=0x7f10b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc41bdfb2f3bbd8f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10c959a700 1 -- 172.21.15.69:0/162544516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10b4004160 con 0x7f10cc105920 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10c959a700 1 -- 172.21.15.69:0/162544516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f10b40042c0 con 0x7f10cc105920 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10c959a700 1 -- 172.21.15.69:0/162544516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10b4011940 con 0x7f10cc105920 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 -- 172.21.15.69:0/162544516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 msgr2=0x7f10cc105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 --2- 172.21.15.69:0/162544516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc105d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10b40098a0 tx=0x7f10b4009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 -- 172.21.15.69:0/162544516 shutdown_connections 2023-12-14T18:17:54.908 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 --2- 172.21.15.69:0/162544516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc105d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 -- 172.21.15.69:0/162544516 >> 172.21.15.69:0/162544516 conn(0x7f10cc100f70 msgr2=0x7f10cc1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 -- 172.21.15.69:0/162544516 shutdown_connections 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.267+0000 7f10d0a73700 1 -- 172.21.15.69:0/162544516 wait complete. 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10d0a73700 1 Processor -- start 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10d0a73700 1 -- start start 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10d0a73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc07aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10d0a73700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc07b010 con 0x7f10cc105920 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10ca59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc07aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10ca59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc07aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46164/0 (socket says 172.21.15.69:46164) 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.268+0000 7f10ca59c700 1 -- 172.21.15.69:0/1347783109 learned_addr learned my addr 172.21.15.69:0/1347783109 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10ca59c700 1 -- 172.21.15.69:0/1347783109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4009550 con 0x7f10cc105920 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10ca59c700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc07aad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10b4011dc0 tx=0x7f10b4011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10b40037d0 con 0x7f10cc105920 2023-12-14T18:17:54.909 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f10b401b440 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10b401a560 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc107910 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.269+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc107780 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.270+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc062120 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.270+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 3) v1 ==== 45366+0+0 (secure 0 0 0) 0x7f10b401b5b0 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.270+0000 7f10c37fe700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f10b80385e0 0x7f10b803aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.270+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f10b404c2c0 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.270+0000 7f10c9d9b700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f10b80385e0 0x7f10b803aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.271+0000 7f10c9d9b700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f10b80385e0 0x7f10b803aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f10bc006fd0 tx=0x7f10bc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.276+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f10b4023980 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.540+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f10cc079880 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.540+0000 7f10c37fe700 1 -- 172.21.15.69:0/1347783109 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f10b401f070 con 0x7f10cc105920 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f10b80385e0 msgr2=0x7f10b803aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f10b80385e0 0x7f10b803aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f10bc006fd0 tx=0x7f10bc006e40 comp rx=0 tx=0).stop 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 msgr2=0x7f10cc07aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:54.910 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc07aad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10b4011dc0 tx=0x7f10b4011ea0 comp rx=0 tx=0).stop 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 shutdown_connections 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f10b80385e0 0x7f10b803aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 --2- 172.21.15.69:0/1347783109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10cc105920 0x7f10cc07aad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 >> 172.21.15.69:0/1347783109 conn(0x7f10cc100f70 msgr2=0x7f10cc101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 shutdown_connections 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:54.542+0000 7f10d0a73700 1 -- 172.21.15.69:0/1347783109 wait complete. 2023-12-14T18:17:54.911 INFO:teuthology.orchestra.run.smithi069.stdout:mgr is available 2023-12-14T18:17:55.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:55 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1347783109' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-14T18:17:55.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:55.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-14T18:17:55.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa206788700 1 Processor -- start 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa206788700 1 -- start start 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa206788700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200104010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa206788700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200104550 con 0x7fa200103c00 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200104010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200104010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46166/0 (socket says 172.21.15.69:46166) 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa1fffff700 1 -- 172.21.15.69:0/3155416511 learned_addr learned my addr 172.21.15.69:0/3155416511 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.224+0000 7fa1fffff700 1 -- 172.21.15.69:0/3155416511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200104690 con 0x7fa200103c00 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa1fffff700 1 --2- 172.21.15.69:0/3155416511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200104010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00098a0 tx=0x7fa1f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5277e9d733b7fc server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa1feffd700 1 -- 172.21.15.69:0/3155416511 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f0004160 con 0x7fa200103c00 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa1feffd700 1 -- 172.21.15.69:0/3155416511 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa1f00042c0 con 0x7fa200103c00 2023-12-14T18:17:55.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa1feffd700 1 -- 172.21.15.69:0/3155416511 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f0011940 con 0x7fa200103c00 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 -- 172.21.15.69:0/3155416511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 msgr2=0x7fa200104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 --2- 172.21.15.69:0/3155416511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200104010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00098a0 tx=0x7fa1f0009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 -- 172.21.15.69:0/3155416511 shutdown_connections 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 --2- 172.21.15.69:0/3155416511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200104010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 -- 172.21.15.69:0/3155416511 >> 172.21.15.69:0/3155416511 conn(0x7fa2000ff5e0 msgr2=0x7fa200101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 -- 172.21.15.69:0/3155416511 shutdown_connections 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.225+0000 7fa206788700 1 -- 172.21.15.69:0/3155416511 wait complete. 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa206788700 1 Processor -- start 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa206788700 1 -- start start 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa206788700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa206788700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200199b40 con 0x7fa200103c00 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:55.803 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46176/0 (socket says 172.21.15.69:46176) 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.226+0000 7fa1fffff700 1 -- 172.21.15.69:0/256845011 learned_addr learned my addr 172.21.15.69:0/256845011 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa1fffff700 1 -- 172.21.15.69:0/256845011 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0009550 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa1fffff700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200199600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f00036a0 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa200107970 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa1f001b440 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f00193f0 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.227+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001077e0 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.228+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fa1f0019630 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.228+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200109e60 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.228+0000 7fa1fd7fa700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fa1e80386c0 0x7fa1e803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.228+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa1f004c510 con 0x7fa200103c00 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.228+0000 7fa1ff7fe700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fa1e80386c0 0x7fa1e803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.228+0000 7fa1ff7fe700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fa1e80386c0 0x7fa1e803ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006fd0 tx=0x7fa1f4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:55.804 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.233+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa1f001b940 con 0x7fa200103c00 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.418+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa200062120 con 0x7fa200103c00 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.419+0000 7fa1fd7fa700 1 -- 172.21.15.69:0/256845011 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fa1f001f070 con 0x7fa200103c00 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fa1e80386c0 msgr2=0x7fa1e803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fa1e80386c0 0x7fa1e803ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006fd0 tx=0x7fa1f4006e40 comp rx=0 tx=0).stop 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 msgr2=0x7fa200199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200199600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0011e70 comp rx=0 tx=0).stop 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 shutdown_connections 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fa1e80386c0 0x7fa1e803ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 --2- 172.21.15.69:0/256845011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa200103c00 0x7fa200199600 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 >> 172.21.15.69:0/256845011 conn(0x7fa2000ff5e0 msgr2=0x7fa200100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 shutdown_connections 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:55.421+0000 7fa206788700 1 -- 172.21.15.69:0/256845011 wait complete. 2023-12-14T18:17:55.805 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling cephadm module... 2023-12-14T18:17:56.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:56 smithi069 ceph-mon[42047]: mgrmap e4: x(active, since 3s) 2023-12-14T18:17:56.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:56 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/256845011' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-14T18:17:57.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/781235725' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-14T18:17:57.446 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: ignoring --setuser ceph since I am not root 2023-12-14T18:17:57.446 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: ignoring --setgroup ceph since I am not root 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e900ad700 1 Processor -- start 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e900ad700 1 -- start start 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e900ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e900ad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880740c0 con 0x7f1e88106420 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e8de49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e8de49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46966/0 (socket says 172.21.15.69:46966) 2023-12-14T18:17:57.498 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.133+0000 7f1e8de49700 1 -- 172.21.15.69:0/2330747233 learned_addr learned my addr 172.21.15.69:0/2330747233 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e8de49700 1 -- 172.21.15.69:0/2330747233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88074200 con 0x7f1e88106420 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e8de49700 1 --2- 172.21.15.69:0/2330747233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88108800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098a0 tx=0x7f1e84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671d4e5b4d92e951 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e8ce47700 1 -- 172.21.15.69:0/2330747233 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e84004160 con 0x7f1e88106420 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e8ce47700 1 -- 172.21.15.69:0/2330747233 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1e840042c0 con 0x7f1e88106420 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e8ce47700 1 -- 172.21.15.69:0/2330747233 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e84011940 con 0x7f1e88106420 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e900ad700 1 -- 172.21.15.69:0/2330747233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 msgr2=0x7f1e88108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.134+0000 7f1e900ad700 1 --2- 172.21.15.69:0/2330747233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88108800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098a0 tx=0x7f1e84009bb0 comp rx=0 tx=0).stop 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 -- 172.21.15.69:0/2330747233 shutdown_connections 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 --2- 172.21.15.69:0/2330747233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88108800 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 -- 172.21.15.69:0/2330747233 >> 172.21.15.69:0/2330747233 conn(0x7f1e880ffea0 msgr2=0x7f1e881022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 -- 172.21.15.69:0/2330747233 shutdown_connections 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 -- 172.21.15.69:0/2330747233 wait complete. 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 Processor -- start 2023-12-14T18:17:57.499 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 -- start start 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.135+0000 7f1e900ad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88199a70 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e8de49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e8de49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46978/0 (socket says 172.21.15.69:46978) 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e8de49700 1 -- 172.21.15.69:0/781235725 learned_addr learned my addr 172.21.15.69:0/781235725 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e8de49700 1 -- 172.21.15.69:0/781235725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009550 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e8de49700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88199530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1e84006af0 tx=0x7f1e84011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e84003bf0 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1e8401b8b0 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e88109b40 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e840198b0 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.136+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e881099b0 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.137+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f1e84019b70 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.137+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88109cd0 con 0x7f1e88106420 2023-12-14T18:17:57.500 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.137+0000 7f1e7effd700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f1e74038670 0x7f1e7403ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.137+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1e8404cb70 con 0x7f1e88106420 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.137+0000 7f1e8d648700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f1e74038670 0x7f1e7403ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.138+0000 7f1e8d648700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f1e74038670 0x7f1e7403ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e78006fd0 tx=0x7f1e78006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.142+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1e84018db0 con 0x7f1e88106420 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:56.383+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f1e8819d1f0 con 0x7f1e88106420 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.135+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f1e8401ba90 con 0x7f1e88106420 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.136+0000 7f1e7effd700 1 -- 172.21.15.69:0/781235725 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f1e84022c30 con 0x7f1e88106420 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f1e74038670 msgr2=0x7f1e7403ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f1e74038670 0x7f1e7403ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e78006fd0 tx=0x7f1e78006e40 comp rx=0 tx=0).stop 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 msgr2=0x7f1e88199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88199530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1e84006af0 tx=0x7f1e84011a30 comp rx=0 tx=0).stop 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 shutdown_connections 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f1e74038670 0x7f1e7403ab20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 --2- 172.21.15.69:0/781235725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e88106420 0x7f1e88199530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:57.502 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.139+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 >> 172.21.15.69:0/781235725 conn(0x7f1e880ffea0 msgr2=0x7f1e88100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:57.502 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.140+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 shutdown_connections 2023-12-14T18:17:57.502 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.140+0000 7f1e900ad700 1 -- 172.21.15.69:0/781235725 wait complete. 2023-12-14T18:17:57.706 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:57.504+0000 7fdcde0c0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T18:17:57.707 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:57.610+0000 7fdcde0c0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T18:17:57.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:57.706+0000 7fdcde0c0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T18:17:57.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:57 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:57.794+0000 7fdcde0c0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T18:17:58.414 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/781235725' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-14T18:17:58.414 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-mon[42047]: mgrmap e5: x(active, since 5s) 2023-12-14T18:17:58.414 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2474245030' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-14T18:17:58.482 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:17:58.482 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-14T18:17:58.482 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-14T18:17:58.482 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-14T18:17:58.482 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.851+0000 7fd3b18ec700 1 Processor -- start 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.851+0000 7fd3b18ec700 1 -- start start 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3b18ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac105120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3b18ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac105660 con 0x7fd3ac104d10 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3aaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac105120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3aaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac105120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46996/0 (socket says 172.21.15.69:46996) 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3aaffd700 1 -- 172.21.15.69:0/1978598036 learned_addr learned my addr 172.21.15.69:0/1978598036 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3aaffd700 1 -- 172.21.15.69:0/1978598036 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac1057a0 con 0x7fd3ac104d10 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3aaffd700 1 --2- 172.21.15.69:0/1978598036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac105120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00bb40 tx=0x7fd39c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9763a5e7c0df5d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3a9ffb700 1 -- 172.21.15.69:0/1978598036 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39c00dbe0 con 0x7fd3ac104d10 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3a9ffb700 1 -- 172.21.15.69:0/1978598036 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd39c0044a0 con 0x7fd3ac104d10 2023-12-14T18:17:58.483 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.852+0000 7fd3a9ffb700 1 -- 172.21.15.69:0/1978598036 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39c003da0 con 0x7fd3ac104d10 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 -- 172.21.15.69:0/1978598036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 msgr2=0x7fd3ac105120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 --2- 172.21.15.69:0/1978598036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac105120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00bb40 tx=0x7fd39c00be50 comp rx=0 tx=0).stop 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 -- 172.21.15.69:0/1978598036 shutdown_connections 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 --2- 172.21.15.69:0/1978598036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac105120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 -- 172.21.15.69:0/1978598036 >> 172.21.15.69:0/1978598036 conn(0x7fd3ac0ff5e0 msgr2=0x7fd3ac101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 -- 172.21.15.69:0/1978598036 shutdown_connections 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.853+0000 7fd3b18ec700 1 -- 172.21.15.69:0/1978598036 wait complete. 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3b18ec700 1 Processor -- start 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3b18ec700 1 -- start start 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3b18ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3b18ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac19be10 con 0x7fd3ac104d10 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3aaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3aaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47004/0 (socket says 172.21.15.69:47004) 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3aaffd700 1 -- 172.21.15.69:0/2474245030 learned_addr learned my addr 172.21.15.69:0/2474245030 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:17:58.484 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3aaffd700 1 -- 172.21.15.69:0/2474245030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c00b7f0 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.854+0000 7fd3aaffd700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac19b8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd39c003df0 tx=0x7fd39c003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.855+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39c010500 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.855+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac106870 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.855+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd39c010ad0 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.855+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39c021aa0 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.855+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac1066e0 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.856+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac103910 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.856+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fd39c0193f0 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.856+0000 7fd3b08ea700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 0x7fd39403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.856+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd39c04c8a0 con 0x7fd3ac104d10 2023-12-14T18:17:58.485 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.856+0000 7fd3aa7fc700 1 -- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 msgr2=0x7fd39403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.856+0000 7fd3aa7fc700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 0x7fd39403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:57.860+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd39c00e770 con 0x7fd3ac104d10 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.057+0000 7fd3aa7fc700 1 -- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 msgr2=0x7fd39403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.057+0000 7fd3aa7fc700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 0x7fd39403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.108+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd3ac061700 con 0x7fd3ac104d10 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.108+0000 7fd3b08ea700 1 -- 172.21.15.69:0/2474245030 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fd39c00f3d0 con 0x7fd3ac104d10 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 msgr2=0x7fd39403ab70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 0x7fd39403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 msgr2=0x7fd3ac19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac19b8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd39c003df0 tx=0x7fd39c003ed0 comp rx=0 tx=0).stop 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 shutdown_connections 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7fd3940386c0 0x7fd39403ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 --2- 172.21.15.69:0/2474245030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ac104d10 0x7fd3ac19b8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 >> 172.21.15.69:0/2474245030 conn(0x7fd3ac0ff5e0 msgr2=0x7fd3ac18e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:17:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 shutdown_connections 2023-12-14T18:17:58.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:58.110+0000 7fd3b18ec700 1 -- 172.21.15.69:0/2474245030 wait complete. 2023-12-14T18:17:58.487 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2023-12-14T18:17:58.487 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 5... 2023-12-14T18:17:58.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:58.413+0000 7fdcde0c0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:17:58.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:58.662+0000 7fdcde0c0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T18:17:59.138 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:58.747+0000 7fdcde0c0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T18:17:59.139 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:58.854+0000 7fdcde0c0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T18:17:59.139 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:58 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:58.944+0000 7fdcde0c0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T18:17:59.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:59 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:59.138+0000 7fdcde0c0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T18:17:59.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:59 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:59.222+0000 7fdcde0c0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T18:17:59.870 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:59 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:59.605+0000 7fdcde0c0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T18:18:00.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:17:59 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:17:59.869+0000 7fdcde0c0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T18:18:00.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:00 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:00.155+0000 7fdcde0c0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T18:18:00.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:00 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:00.247+0000 7fdcde0c0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T18:18:01.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:00 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:00.987+0000 7fdcde0c0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T18:18:01.459 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:01 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:01.081+0000 7fdcde0c0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T18:18:01.459 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:01 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:01.226+0000 7fdcde0c0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T18:18:02.208 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:01 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:01.844+0000 7fdcde0c0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T18:18:02.208 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:02 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:02.024+0000 7fdcde0c0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T18:18:02.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:02 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:02.216+0000 7fdcde0c0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T18:18:03.208 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:02 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:02.919+0000 7fdcde0c0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T18:18:03.667 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:03.389+0000 7fdcde0c0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:18:03.667 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:03.476+0000 7fdcde0c0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T18:18:03.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:03.666+0000 7fdcde0c0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T18:18:03.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: Active manager daemon x restarted 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: Activating manager daemon x 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: osdmap e2: 0 total, 0 up, 0 in 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: mgrmap e6: x(active, starting, since 0.0051976s) 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: Manager daemon x is now available 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:03 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:05.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: Found migration_current of "None". Setting to last migration. 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:05.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:04 smithi069 ceph-mon[42047]: mgrmap e7: x(active, since 1.00528s) 2023-12-14T18:18:06.191 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:05 smithi069 ceph-mon[42047]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-14T18:18:06.191 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:05 smithi069 ceph-mon[42047]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-14T18:18:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:06 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:05] ENGINE Bus STARTING 2023-12-14T18:18:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:06 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:05] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T18:18:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:06 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:05] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T18:18:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:06 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:05] ENGINE Bus STARTED 2023-12-14T18:18:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:06 smithi069 ceph-mon[42047]: mgrmap e8: x(active, since 2s) 2023-12-14T18:18:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:06 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:07.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f6718773700 1 Processor -- start 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f6718773700 1 -- start start 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f6718773700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f6718773700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710074080 con 0x7f6710106460 2023-12-14T18:18:07.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f671650f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f671650f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47018/0 (socket says 172.21.15.69:47018) 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.917+0000 7f671650f700 1 -- 172.21.15.69:0/4171118572 learned_addr learned my addr 172.21.15.69:0/4171118572 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.918+0000 7f671650f700 1 -- 172.21.15.69:0/4171118572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100741c0 con 0x7f6710106460 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.918+0000 7f671650f700 1 --2- 172.21.15.69:0/4171118572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710108840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098a0 tx=0x7f670c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8b801a16e1acae server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.918+0000 7f671550d700 1 -- 172.21.15.69:0/4171118572 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f670c004160 con 0x7f6710106460 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.918+0000 7f671550d700 1 -- 172.21.15.69:0/4171118572 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f670c0042c0 con 0x7f6710106460 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.918+0000 7f671550d700 1 -- 172.21.15.69:0/4171118572 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f670c011940 con 0x7f6710106460 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 -- 172.21.15.69:0/4171118572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 msgr2=0x7f6710108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 --2- 172.21.15.69:0/4171118572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710108840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098a0 tx=0x7f670c009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 -- 172.21.15.69:0/4171118572 shutdown_connections 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 --2- 172.21.15.69:0/4171118572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710108840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 -- 172.21.15.69:0/4171118572 >> 172.21.15.69:0/4171118572 conn(0x7f67100ffea0 msgr2=0x7f67101022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 -- 172.21.15.69:0/4171118572 shutdown_connections 2023-12-14T18:18:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.919+0000 7f6718773700 1 -- 172.21.15.69:0/4171118572 wait complete. 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f6718773700 1 Processor -- start 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f6718773700 1 -- start start 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f6718773700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f6718773700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710199ad0 con 0x7f6710106460 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f671650f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f671650f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47034/0 (socket says 172.21.15.69:47034) 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f671650f700 1 -- 172.21.15.69:0/3097708732 learned_addr learned my addr 172.21.15.69:0/3097708732 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f671650f700 1 -- 172.21.15.69:0/3097708732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009550 con 0x7f6710106460 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.920+0000 7f671650f700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710199590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f670c006af0 tx=0x7f670c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.921+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f670c003bf0 con 0x7f6710106460 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.921+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f670c01b8b0 con 0x7f6710106460 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.921+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f670c0198b0 con 0x7f6710106460 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.921+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6710109ab0 con 0x7f6710106460 2023-12-14T18:18:07.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.921+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6710109920 con 0x7f6710106460 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.922+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f670c01ba20 con 0x7f6710106460 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.922+0000 7f67077fe700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.922+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 --> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66fc03b2d0 con 0x7f66fc038710 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.922+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f670c04c930 con 0x7f6710106460 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.922+0000 7f6715d0e700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 msgr2=0x7f66fc03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:17:59.922+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:00.123+0000 7f6715d0e700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 msgr2=0x7f66fc03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:00.123+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:00.524+0000 7f6715d0e700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 msgr2=0x7f66fc03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:00.524+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:01.325+0000 7f6715d0e700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 msgr2=0x7f66fc03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:01.325+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-14T18:18:07.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:02.926+0000 7f6715d0e700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 msgr2=0x7f66fc03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3801854408 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:02.926+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:03.684+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f670c01a3d0 con 0x7f6710106460 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:03.684+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 msgr2=0x7f66fc03abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:03.684+0000 7f67077fe700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.683+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f670c04e4a0 con 0x7f6710106460 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.683+0000 7f67077fe700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f66fc03bfe0 0x7f66fc03e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.683+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66fc03b2d0 con 0x7f66fc03bfe0 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.683+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f66fc03bfe0 0x7f66fc03e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.684+0000 7f6715d0e700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f66fc03bfe0 0x7f66fc03e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6700003a10 tx=0x7f67000092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.685+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f66fc03b2d0 con 0x7f66fc03bfe0 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.691+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f671019a8d0 con 0x7f66fc03bfe0 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.691+0000 7f67077fe700 1 -- 172.21.15.69:0/3097708732 <== mgr.14120 v2:172.21.15.69:6800/3699885016 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f671019a8d0 con 0x7f66fc03bfe0 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.691+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f66fc03bfe0 msgr2=0x7f66fc03e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.691+0000 7f6718773700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f66fc03bfe0 0x7f66fc03e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6700003a10 tx=0x7f67000092b0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.691+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 msgr2=0x7f6710199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.691+0000 7f6718773700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710199590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f670c006af0 tx=0x7f670c011a30 comp rx=0 tx=0).stop 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 shutdown_connections 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f66fc03bfe0 0x7f66fc03e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6710106460 0x7f6710199590 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 --2- 172.21.15.69:0/3097708732 >> [v2:172.21.15.69:6800/3801854408,v1:172.21.15.69:6801/3801854408] conn(0x7f66fc038710 0x7f66fc03abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 >> 172.21.15.69:0/3097708732 conn(0x7f67100ffea0 msgr2=0x7f6710100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 shutdown_connections 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:04.692+0000 7f6718773700 1 -- 172.21.15.69:0/3097708732 wait complete. 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 5 is available 2023-12-14T18:18:07.255 INFO:teuthology.orchestra.run.smithi069.stdout:Setting orchestrator backend to cephadm... 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.753+0000 7fecde04e700 1 Processor -- start 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.753+0000 7fecde04e700 1 -- start start 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.753+0000 7fecde04e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8105d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecde04e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd8106270 con 0x7fecd8105920 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45008/0 (socket says 172.21.15.69:45008) 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd77fe700 1 -- 172.21.15.69:0/1440298158 learned_addr learned my addr 172.21.15.69:0/1440298158 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:08.355 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd77fe700 1 -- 172.21.15.69:0/1440298158 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd81063b0 con 0x7fecd8105920 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd77fe700 1 --2- 172.21.15.69:0/1440298158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8105d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fecd00098a0 tx=0x7fecd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103e2ee683f9d471 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd67fc700 1 -- 172.21.15.69:0/1440298158 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecd0004160 con 0x7fecd8105920 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd67fc700 1 -- 172.21.15.69:0/1440298158 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fecd00042c0 con 0x7fecd8105920 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.754+0000 7fecd67fc700 1 -- 172.21.15.69:0/1440298158 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecd0011940 con 0x7fecd8105920 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 -- 172.21.15.69:0/1440298158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 msgr2=0x7fecd8105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 --2- 172.21.15.69:0/1440298158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8105d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fecd00098a0 tx=0x7fecd0009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 -- 172.21.15.69:0/1440298158 shutdown_connections 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 --2- 172.21.15.69:0/1440298158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8105d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 -- 172.21.15.69:0/1440298158 >> 172.21.15.69:0/1440298158 conn(0x7fecd8100f70 msgr2=0x7fecd81033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 -- 172.21.15.69:0/1440298158 shutdown_connections 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 -- 172.21.15.69:0/1440298158 wait complete. 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.755+0000 7fecde04e700 1 Processor -- start 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecde04e700 1 -- start start 2023-12-14T18:18:08.356 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecde04e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecde04e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd8199a60 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecd77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecd77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45024/0 (socket says 172.21.15.69:45024) 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecd77fe700 1 -- 172.21.15.69:0/491246965 learned_addr learned my addr 172.21.15.69:0/491246965 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecd77fe700 1 -- 172.21.15.69:0/491246965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009550 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecd77fe700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8199520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fecd0006af0 tx=0x7fecd0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.756+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecd0003bf0 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fecd001b8b0 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd8107910 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecd0019880 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd8107780 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fecd0019af0 con 0x7fecd8105920 2023-12-14T18:18:08.357 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd8062120 con 0x7fecd8105920 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.757+0000 7fecd4ff9700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fecc4038710 0x7fecc403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.758+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fecd004cc10 con 0x7fecd8105920 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.758+0000 7fecd6ffd700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fecc4038710 0x7fecc403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.758+0000 7fecd6ffd700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fecc4038710 0x7fecc403abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006fd0 tx=0x7fecc0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.762+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fecd0018b80 con 0x7fecd8105920 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.964+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fecd8102390 con 0x7fecc4038710 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.970+0000 7fecd4ff9700 1 -- 172.21.15.69:0/491246965 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fecd8102390 con 0x7fecc4038710 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fecc4038710 msgr2=0x7fecc403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fecc4038710 0x7fecc403abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006fd0 tx=0x7fecc0006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 msgr2=0x7fecd8199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8199520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fecd0006af0 tx=0x7fecd0011a30 comp rx=0 tx=0).stop 2023-12-14T18:18:08.358 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 shutdown_connections 2023-12-14T18:18:08.359 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fecc4038710 0x7fecc403abc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:08.359 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 --2- 172.21.15.69:0/491246965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecd8105920 0x7fecd8199520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:08.359 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.972+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 >> 172.21.15.69:0/491246965 conn(0x7fecd8100f70 msgr2=0x7fecd8101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:08.359 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.973+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 shutdown_connections 2023-12-14T18:18:08.359 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:07.973+0000 7fecde04e700 1 -- 172.21.15.69:0/491246965 wait complete. 2023-12-14T18:18:09.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:08 smithi069 ceph-mon[42047]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:09.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:08 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:09.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:08 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:09.272 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.713+0000 7f93df502700 1 Processor -- start 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.713+0000 7f93df502700 1 -- start start 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.713+0000 7f93df502700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d8108860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.713+0000 7f93df502700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8074060 con 0x7f93d8106480 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93dd29e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d8108860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93dd29e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d8108860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45038/0 (socket says 172.21.15.69:45038) 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93dd29e700 1 -- 172.21.15.69:0/260872292 learned_addr learned my addr 172.21.15.69:0/260872292 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93dd29e700 1 -- 172.21.15.69:0/260872292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80741a0 con 0x7f93d8106480 2023-12-14T18:18:09.273 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93dd29e700 1 --2- 172.21.15.69:0/260872292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d8108860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93c80098a0 tx=0x7f93c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11e906af6bf94dd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93cffff700 1 -- 172.21.15.69:0/260872292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93c8004160 con 0x7f93d8106480 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93cffff700 1 -- 172.21.15.69:0/260872292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f93c80042c0 con 0x7f93d8106480 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.714+0000 7f93cffff700 1 -- 172.21.15.69:0/260872292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93c8011940 con 0x7f93d8106480 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 -- 172.21.15.69:0/260872292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 msgr2=0x7f93d8108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 --2- 172.21.15.69:0/260872292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d8108860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93c80098a0 tx=0x7f93c8009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 -- 172.21.15.69:0/260872292 shutdown_connections 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 --2- 172.21.15.69:0/260872292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d8108860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 -- 172.21.15.69:0/260872292 >> 172.21.15.69:0/260872292 conn(0x7f93d80ffea0 msgr2=0x7f93d81022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 -- 172.21.15.69:0/260872292 shutdown_connections 2023-12-14T18:18:09.274 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 -- 172.21.15.69:0/260872292 wait complete. 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.715+0000 7f93df502700 1 Processor -- start 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93df502700 1 -- start start 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93df502700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d81995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93df502700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8199b30 con 0x7f93d8106480 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93dd29e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d81995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93dd29e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d81995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45048/0 (socket says 172.21.15.69:45048) 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93dd29e700 1 -- 172.21.15.69:0/3157638866 learned_addr learned my addr 172.21.15.69:0/3157638866 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93dd29e700 1 -- 172.21.15.69:0/3157638866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8009550 con 0x7f93d8106480 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93dd29e700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d81995f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006af0 tx=0x7f93c8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:09.275 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93c8003bf0 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f93c801b8b0 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8109b40 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93c80198b0 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.716+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81099b0 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.717+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f93c801ba20 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.717+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8109cd0 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.717+0000 7f93ce7fc700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f93c40386c0 0x7f93c403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.717+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f93c804c9e0 con 0x7f93d8106480 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.718+0000 7f93dca9d700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f93c40386c0 0x7f93c403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:09.276 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.718+0000 7f93dca9d700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f93c40386c0 0x7f93c403ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93d4006fd0 tx=0x7f93d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.722+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f93c8018530 con 0x7f93d8106480 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.914+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d8101380 con 0x7f93c40386c0 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.914+0000 7f93ce7fc700 1 -- 172.21.15.69:0/3157638866 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f93d8101380 con 0x7f93c40386c0 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f93c40386c0 msgr2=0x7f93c403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f93c40386c0 0x7f93c403ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93d4006fd0 tx=0x7f93d4006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 msgr2=0x7f93d81995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d81995f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006af0 tx=0x7f93c8011a30 comp rx=0 tx=0).stop 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 shutdown_connections 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f93c40386c0 0x7f93c403ab70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 --2- 172.21.15.69:0/3157638866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d8106480 0x7f93d81995f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:09.277 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 >> 172.21.15.69:0/3157638866 conn(0x7f93d80ffea0 msgr2=0x7f93d8100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:09.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 shutdown_connections 2023-12-14T18:18:09.278 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:08.916+0000 7f93df502700 1 -- 172.21.15.69:0/3157638866 wait complete. 2023-12-14T18:18:09.278 INFO:teuthology.orchestra.run.smithi069.stdout:Generating ssh key... 2023-12-14T18:18:10.177 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:10 smithi069 ceph-mon[42047]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:10.177 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:10 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:10.177 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:10 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: Generating public/private rsa key pair. 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: Your identification has been saved in /tmp/tmptfvfwu_3/key. 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: Your public key has been saved in /tmp/tmptfvfwu_3/key.pub. 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: The key fingerprint is: 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: SHA256:C80toPemtc0WYJElvJWu5iMcdS+53n8S3A6ICaqdLTM ceph-f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: The key's randomart image is: 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: +---[RSA 3072]----+ 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | ..o.. | 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | +.o | 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | . = | 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | . +*.o | 2023-12-14T18:18:10.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | . o+S=.= o . | 2023-12-14T18:18:10.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | .oooo* o + .| 2023-12-14T18:18:10.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | + *= + + | 2023-12-14T18:18:10.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | . E+++o. . o| 2023-12-14T18:18:10.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: | .=.++ ...o | 2023-12-14T18:18:10.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: +----[SHA256]-----+ 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2b5569700 1 Processor -- start 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2b5569700 1 -- start start 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2b5569700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2b5569700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0074080 con 0x7fb2b0106460 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45052/0 (socket says 172.21.15.69:45052) 2023-12-14T18:18:10.255 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.586+0000 7fb2aeffd700 1 -- 172.21.15.69:0/3335515673 learned_addr learned my addr 172.21.15.69:0/3335515673 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2aeffd700 1 -- 172.21.15.69:0/3335515673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00741c0 con 0x7fb2b0106460 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2aeffd700 1 --2- 172.21.15.69:0/3335515673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0108840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2980098a0 tx=0x7fb298009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bbfe5abb82dee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2adffb700 1 -- 172.21.15.69:0/3335515673 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb298004160 con 0x7fb2b0106460 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2adffb700 1 -- 172.21.15.69:0/3335515673 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb2980042c0 con 0x7fb2b0106460 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2adffb700 1 -- 172.21.15.69:0/3335515673 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb298011940 con 0x7fb2b0106460 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2b5569700 1 -- 172.21.15.69:0/3335515673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 msgr2=0x7fb2b0108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2b5569700 1 --2- 172.21.15.69:0/3335515673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0108840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2980098a0 tx=0x7fb298009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.587+0000 7fb2b5569700 1 -- 172.21.15.69:0/3335515673 shutdown_connections 2023-12-14T18:18:10.256 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.588+0000 7fb2b5569700 1 --2- 172.21.15.69:0/3335515673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0108840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.588+0000 7fb2b5569700 1 -- 172.21.15.69:0/3335515673 >> 172.21.15.69:0/3335515673 conn(0x7fb2b00ffea0 msgr2=0x7fb2b01022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.588+0000 7fb2b5569700 1 -- 172.21.15.69:0/3335515673 shutdown_connections 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.588+0000 7fb2b5569700 1 -- 172.21.15.69:0/3335515673 wait complete. 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.588+0000 7fb2b5569700 1 Processor -- start 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2b5569700 1 -- start start 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2b5569700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2b5569700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0199ad0 con 0x7fb2b0106460 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45060/0 (socket says 172.21.15.69:45060) 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2aeffd700 1 -- 172.21.15.69:0/440821673 learned_addr learned my addr 172.21.15.69:0/440821673 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:10.257 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2aeffd700 1 -- 172.21.15.69:0/440821673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009550 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2aeffd700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0199590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb298000c00 tx=0x7fb298011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2980036a0 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b0109ab0 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb29801b440 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2980193f0 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.589+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b0109920 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.590+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb298019670 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.590+0000 7fb2a7fff700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fb29c038710 0x7fb29c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.590+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b0109c40 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.591+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb29804c810 con 0x7fb2b0106460 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.591+0000 7fb2ae7fc700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fb29c038710 0x7fb29c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.591+0000 7fb2ae7fc700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fb29c038710 0x7fb29c03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0006fd0 tx=0x7fb2a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:10.258 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.595+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb298018b00 con 0x7fb2b0106460 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.785+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2b0101340 con 0x7fb29c038710 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.907+0000 7fb2a7fff700 1 -- 172.21.15.69:0/440821673 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb2b0101340 con 0x7fb29c038710 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fb29c038710 msgr2=0x7fb29c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fb29c038710 0x7fb29c03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0006fd0 tx=0x7fb2a0006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 msgr2=0x7fb2b0199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0199590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb298000c00 tx=0x7fb298011e70 comp rx=0 tx=0).stop 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 shutdown_connections 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fb29c038710 0x7fb29c03abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 --2- 172.21.15.69:0/440821673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2b0106460 0x7fb2b0199590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 >> 172.21.15.69:0/440821673 conn(0x7fb2b00ffea0 msgr2=0x7fb2b0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 shutdown_connections 2023-12-14T18:18:10.259 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:09.909+0000 7fb2b5569700 1 -- 172.21.15.69:0/440821673 wait complete. 2023-12-14T18:18:11.138 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc75a6d3700 1 Processor -- start 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc75a6d3700 1 -- start start 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc75a6d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75410a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc75a6d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541062c0 con 0x7fc754079c70 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc753fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75410a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc753fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75410a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45064/0 (socket says 172.21.15.69:45064) 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc753fff700 1 -- 172.21.15.69:0/1817225950 learned_addr learned my addr 172.21.15.69:0/1817225950 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.595+0000 7fc753fff700 1 -- 172.21.15.69:0/1817225950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75410ae10 con 0x7fc754079c70 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc753fff700 1 --2- 172.21.15.69:0/1817225950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75410a8d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098a0 tx=0x7fc744009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad7df2cd99d4671 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc752ffd700 1 -- 172.21.15.69:0/1817225950 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc744004160 con 0x7fc754079c70 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc752ffd700 1 -- 172.21.15.69:0/1817225950 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc7440042c0 con 0x7fc754079c70 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc752ffd700 1 -- 172.21.15.69:0/1817225950 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc744011940 con 0x7fc754079c70 2023-12-14T18:18:11.139 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 -- 172.21.15.69:0/1817225950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 msgr2=0x7fc75410a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 --2- 172.21.15.69:0/1817225950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75410a8d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098a0 tx=0x7fc744009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 -- 172.21.15.69:0/1817225950 shutdown_connections 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 --2- 172.21.15.69:0/1817225950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75410a8d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 -- 172.21.15.69:0/1817225950 >> 172.21.15.69:0/1817225950 conn(0x7fc7540ffe60 msgr2=0x7fc754102290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 -- 172.21.15.69:0/1817225950 shutdown_connections 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.596+0000 7fc75a6d3700 1 -- 172.21.15.69:0/1817225950 wait complete. 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc75a6d3700 1 Processor -- start 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc75a6d3700 1 -- start start 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc75a6d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc75a6d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75419bd40 con 0x7fc754079c70 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc753fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc753fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45074/0 (socket says 172.21.15.69:45074) 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.597+0000 7fc753fff700 1 -- 172.21.15.69:0/540352220 learned_addr learned my addr 172.21.15.69:0/540352220 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc753fff700 1 -- 172.21.15.69:0/540352220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009550 con 0x7fc754079c70 2023-12-14T18:18:11.140 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc753fff700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75419b800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc744006af0 tx=0x7fc744011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc744003c30 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc74401b8b0 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75410bd40 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7440237d0 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.598+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75410bbb0 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.599+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc744023a90 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.599+0000 7fc7517fa700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc73c0386c0 0x7fc73c03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.599+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc74404cbf0 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.599+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75410bed0 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.599+0000 7fc7537fe700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc73c0386c0 0x7fc73c03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.599+0000 7fc7537fe700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc73c0386c0 0x7fc73c03ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc748006fd0 tx=0x7fc748006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.604+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc744018760 con 0x7fc754079c70 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.792+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc754101330 con 0x7fc73c0386c0 2023-12-14T18:18:11.141 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.793+0000 7fc7517fa700 1 -- 172.21.15.69:0/540352220 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fc754101330 con 0x7fc73c0386c0 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc73c0386c0 msgr2=0x7fc73c03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc73c0386c0 0x7fc73c03ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc748006fd0 tx=0x7fc748006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 msgr2=0x7fc75419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75419b800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc744006af0 tx=0x7fc744011a30 comp rx=0 tx=0).stop 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 shutdown_connections 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc73c0386c0 0x7fc73c03ab70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 --2- 172.21.15.69:0/540352220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc754079c70 0x7fc75419b800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 >> 172.21.15.69:0/540352220 conn(0x7fc7540ffe60 msgr2=0x7fc754100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 shutdown_connections 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:10.795+0000 7fc75a6d3700 1 -- 172.21.15.69:0/540352220 wait complete. 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:Adding key to root@localhost authorized_keys... 2023-12-14T18:18:11.142 INFO:teuthology.orchestra.run.smithi069.stdout:Adding host smithi069... 2023-12-14T18:18:11.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:11 smithi069 ceph-mon[42047]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:11.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:11 smithi069 ceph-mon[42047]: Generating ssh key... 2023-12-14T18:18:12.323 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:12 smithi069 ceph-mon[42047]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:13.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:13 smithi069 ceph-mon[42047]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:13.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:13 smithi069 ceph-mon[42047]: Deploying cephadm binary to smithi069 2023-12-14T18:18:13.883 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Added host 'smithi069' with addr '172.21.15.69' 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad9b3f700 1 Processor -- start 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad9b3f700 1 -- start start 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad9b3f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4104c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad9b3f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4105160 con 0x7f9ad4104810 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4104c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45084/0 (socket says 172.21.15.69:45084) 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad37fe700 1 -- 172.21.15.69:0/3630708655 learned_addr learned my addr 172.21.15.69:0/3630708655 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.473+0000 7f9ad37fe700 1 -- 172.21.15.69:0/3630708655 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad41052a0 con 0x7f9ad4104810 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad37fe700 1 --2- 172.21.15.69:0/3630708655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4104c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40098a0 tx=0x7f9ac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae09df955eed2a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad27fc700 1 -- 172.21.15.69:0/3630708655 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4004160 con 0x7f9ad4104810 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad27fc700 1 -- 172.21.15.69:0/3630708655 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9ac40042c0 con 0x7f9ad4104810 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad27fc700 1 -- 172.21.15.69:0/3630708655 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4011940 con 0x7f9ad4104810 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/3630708655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 msgr2=0x7f9ad4104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:13.884 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad9b3f700 1 --2- 172.21.15.69:0/3630708655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4104c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40098a0 tx=0x7f9ac4009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/3630708655 shutdown_connections 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad9b3f700 1 --2- 172.21.15.69:0/3630708655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4104c20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/3630708655 >> 172.21.15.69:0/3630708655 conn(0x7f9ad40ffea0 msgr2=0x7f9ad41022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.474+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/3630708655 shutdown_connections 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.475+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/3630708655 wait complete. 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.475+0000 7f9ad9b3f700 1 Processor -- start 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.475+0000 7f9ad9b3f700 1 -- start start 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.475+0000 7f9ad9b3f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad9b3f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4197850 con 0x7f9ad4104810 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45088/0 (socket says 172.21.15.69:45088) 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad37fe700 1 -- 172.21.15.69:0/2126667815 learned_addr learned my addr 172.21.15.69:0/2126667815 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad37fe700 1 -- 172.21.15.69:0/2126667815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4009550 con 0x7f9ad4104810 2023-12-14T18:18:13.885 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad37fe700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4197310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006af0 tx=0x7f9ac4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4003bf0 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9ac401b8b0 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4106800 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4019880 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.476+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad4106670 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.477+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f9ac4019b40 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.477+0000 7f9ad0ff9700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f9abc03cac0 0x7f9abc03ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.477+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad4073310 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.477+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9ac404cc40 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.477+0000 7f9ad2ffd700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f9abc03cac0 0x7f9abc03ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.478+0000 7f9ad2ffd700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f9abc03cac0 0x7f9abc03ef70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8006fd0 tx=0x7f9ac8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.482+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9ac4018db0 con 0x7f9ad4104810 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:11.673+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ad4060f30 con 0x7f9abc03cac0 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.580+0000 7f9ad0ff9700 1 -- 172.21.15.69:0/2126667815 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f9ad4060f30 con 0x7f9abc03cac0 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f9abc03cac0 msgr2=0x7f9abc03ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:13.886 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f9abc03cac0 0x7f9abc03ef70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8006fd0 tx=0x7f9ac8006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 msgr2=0x7f9ad4197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4197310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006af0 tx=0x7f9ac4011a30 comp rx=0 tx=0).stop 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 shutdown_connections 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f9abc03cac0 0x7f9abc03ef70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 --2- 172.21.15.69:0/2126667815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4104810 0x7f9ad4197310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 >> 172.21.15.69:0/2126667815 conn(0x7f9ad40ffea0 msgr2=0x7f9ad418e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 shutdown_connections 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:13.583+0000 7f9ad9b3f700 1 -- 172.21.15.69:0/2126667815 wait complete. 2023-12-14T18:18:13.887 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mon service... 2023-12-14T18:18:14.842 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:14 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:14.843 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:14 smithi069 ceph-mon[42047]: Added host smithi069 2023-12-14T18:18:14.843 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:14 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:14.843 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:14 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:14.862 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-14T18:18:14.862 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.250+0000 7fc82be7b700 1 Processor -- start 2023-12-14T18:18:14.862 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.250+0000 7fc82be7b700 1 -- start start 2023-12-14T18:18:14.862 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.250+0000 7fc82be7b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:14.862 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.250+0000 7fc82be7b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240740c0 con 0x7fc824106420 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc829c17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc829c17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45104/0 (socket says 172.21.15.69:45104) 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc829c17700 1 -- 172.21.15.69:0/3660044084 learned_addr learned my addr 172.21.15.69:0/3660044084 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc829c17700 1 -- 172.21.15.69:0/3660044084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824074200 con 0x7fc824106420 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc829c17700 1 --2- 172.21.15.69:0/3660044084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824108800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098a0 tx=0x7fc814009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f650ce708d030cd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc828c15700 1 -- 172.21.15.69:0/3660044084 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc814004160 con 0x7fc824106420 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc828c15700 1 -- 172.21.15.69:0/3660044084 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc8140042c0 con 0x7fc824106420 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.251+0000 7fc828c15700 1 -- 172.21.15.69:0/3660044084 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc814011940 con 0x7fc824106420 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 -- 172.21.15.69:0/3660044084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 msgr2=0x7fc824108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 --2- 172.21.15.69:0/3660044084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824108800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098a0 tx=0x7fc814009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 -- 172.21.15.69:0/3660044084 shutdown_connections 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 --2- 172.21.15.69:0/3660044084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824108800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 -- 172.21.15.69:0/3660044084 >> 172.21.15.69:0/3660044084 conn(0x7fc8240ffea0 msgr2=0x7fc8241022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:14.863 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 -- 172.21.15.69:0/3660044084 shutdown_connections 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 -- 172.21.15.69:0/3660044084 wait complete. 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 Processor -- start 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.252+0000 7fc82be7b700 1 -- start start 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc82be7b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824105d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc82be7b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241062c0 con 0x7fc824106420 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc829c17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824105d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc829c17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824105d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45106/0 (socket says 172.21.15.69:45106) 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc829c17700 1 -- 172.21.15.69:0/679515300 learned_addr learned my addr 172.21.15.69:0/679515300 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc829c17700 1 -- 172.21.15.69:0/679515300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814009550 con 0x7fc824106420 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc829c17700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824105d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc814000c00 tx=0x7fc814011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8140036a0 con 0x7fc824106420 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc81401b440 con 0x7fc824106420 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc824109b40 con 0x7fc824106420 2023-12-14T18:18:14.864 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8140193f0 con 0x7fc824106420 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.253+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8241099b0 con 0x7fc824106420 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.254+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc8140195e0 con 0x7fc824106420 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.254+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc824062120 con 0x7fc824106420 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.254+0000 7fc81affd700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc810038760 0x7fc81003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.254+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc81404c7c0 con 0x7fc824106420 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.254+0000 7fc829416700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc810038760 0x7fc81003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.255+0000 7fc829416700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc810038760 0x7fc81003ac10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc820006fd0 tx=0x7fc820006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.259+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc814022720 con 0x7fc824106420 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.462+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc824101300 con 0x7fc810038760 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.467+0000 7fc81affd700 1 -- 172.21.15.69:0/679515300 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc824101300 con 0x7fc810038760 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc810038760 msgr2=0x7fc81003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc810038760 0x7fc81003ac10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc820006fd0 tx=0x7fc820006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 msgr2=0x7fc824105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:14.865 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824105d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc814000c00 tx=0x7fc814011e70 comp rx=0 tx=0).stop 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 shutdown_connections 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fc810038760 0x7fc81003ac10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 --2- 172.21.15.69:0/679515300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc824106420 0x7fc824105d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 >> 172.21.15.69:0/679515300 conn(0x7fc8240ffea0 msgr2=0x7fc824100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 shutdown_connections 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:14.469+0000 7fc82be7b700 1 -- 172.21.15.69:0/679515300 wait complete. 2023-12-14T18:18:14.866 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mgr service... 2023-12-14T18:18:15.903 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.224+0000 7f854a207700 1 Processor -- start 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.224+0000 7f854a207700 1 -- start start 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f854a207700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f8544108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f854a207700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544074080 con 0x7f8544106460 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f85437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f8544108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f85437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f8544108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45112/0 (socket says 172.21.15.69:45112) 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f85437fe700 1 -- 172.21.15.69:0/1067082724 learned_addr learned my addr 172.21.15.69:0/1067082724 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f85437fe700 1 -- 172.21.15.69:0/1067082724 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440741c0 con 0x7f8544106460 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.225+0000 7f85437fe700 1 --2- 172.21.15.69:0/1067082724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f8544108840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f85340098a0 tx=0x7f8534009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247ea0b858d945eb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f85427fc700 1 -- 172.21.15.69:0/1067082724 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8534004160 con 0x7f8544106460 2023-12-14T18:18:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f85427fc700 1 -- 172.21.15.69:0/1067082724 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f85340042c0 con 0x7f8544106460 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f85427fc700 1 -- 172.21.15.69:0/1067082724 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8534011940 con 0x7f8544106460 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 -- 172.21.15.69:0/1067082724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 msgr2=0x7f8544108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 --2- 172.21.15.69:0/1067082724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f8544108840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f85340098a0 tx=0x7f8534009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 -- 172.21.15.69:0/1067082724 shutdown_connections 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 --2- 172.21.15.69:0/1067082724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f8544108840 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 -- 172.21.15.69:0/1067082724 >> 172.21.15.69:0/1067082724 conn(0x7f85440ffea0 msgr2=0x7f85441022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 -- 172.21.15.69:0/1067082724 shutdown_connections 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.226+0000 7f854a207700 1 -- 172.21.15.69:0/1067082724 wait complete. 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.227+0000 7f854a207700 1 Processor -- start 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.227+0000 7f854a207700 1 -- start start 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.227+0000 7f854a207700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f85441994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.227+0000 7f854a207700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544199a20 con 0x7f8544106460 2023-12-14T18:18:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f85437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f85441994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f85437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f85441994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45120/0 (socket says 172.21.15.69:45120) 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f85437fe700 1 -- 172.21.15.69:0/2025381565 learned_addr learned my addr 172.21.15.69:0/2025381565 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f85437fe700 1 -- 172.21.15.69:0/2025381565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8534009550 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f85437fe700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f85441994e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8534006af0 tx=0x7f8534011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8534003bf0 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f853401b8b0 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85340198b0 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8544109ab0 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.228+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8544109920 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.229+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f853401b440 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.229+0000 7f8540ff9700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8530038710 0x7f853003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.229+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8544062120 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.229+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f853404c930 con 0x7f8544106460 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.229+0000 7f8542ffd700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8530038710 0x7f853003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.230+0000 7f8542ffd700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8530038710 0x7f853003abc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f852c006fd0 tx=0x7f852c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.234+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8534018530 con 0x7f8544106460 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.444+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f85441012e0 con 0x7f8530038710 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.449+0000 7f8540ff9700 1 -- 172.21.15.69:0/2025381565 <== mgr.14120 v2:172.21.15.69:6800/3699885016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f85441012e0 con 0x7f8530038710 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8530038710 msgr2=0x7f853003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8530038710 0x7f853003abc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f852c006fd0 tx=0x7f852c006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 msgr2=0x7f85441994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f85441994e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8534006af0 tx=0x7f8534011a30 comp rx=0 tx=0).stop 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 shutdown_connections 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8530038710 0x7f853003abc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 --2- 172.21.15.69:0/2025381565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8544106460 0x7f85441994e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 >> 172.21.15.69:0/2025381565 conn(0x7f85440ffea0 msgr2=0x7f8544100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 shutdown_connections 2023-12-14T18:18:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:15.451+0000 7f854a207700 1 -- 172.21.15.69:0/2025381565 wait complete. 2023-12-14T18:18:15.907 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:15 smithi069 ceph-mon[42047]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:15.907 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:15 smithi069 ceph-mon[42047]: Saving service mon spec with placement count:5 2023-12-14T18:18:15.908 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:15 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0f9ce700 1 Processor -- start 2023-12-14T18:18:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0f9ce700 1 -- start start 2023-12-14T18:18:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0f9ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae08106200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0f9ce700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08106740 con 0x7fae08105df0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0d76a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae08106200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0d76a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae08106200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53608/0 (socket says 172.21.15.69:53608) 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.252+0000 7fae0d76a700 1 -- 172.21.15.69:0/2058922387 learned_addr learned my addr 172.21.15.69:0/2058922387 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.253+0000 7fae0d76a700 1 -- 172.21.15.69:0/2058922387 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08106880 con 0x7fae08105df0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.253+0000 7fae0d76a700 1 --2- 172.21.15.69:0/2058922387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae08106200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fae040098a0 tx=0x7fae04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dad0c13e13647f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.253+0000 7fadfffff700 1 -- 172.21.15.69:0/2058922387 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae04004160 con 0x7fae08105df0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.253+0000 7fadfffff700 1 -- 172.21.15.69:0/2058922387 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae040042c0 con 0x7fae08105df0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.253+0000 7fadfffff700 1 -- 172.21.15.69:0/2058922387 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae040118e0 con 0x7fae08105df0 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 -- 172.21.15.69:0/2058922387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 msgr2=0x7fae08106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 --2- 172.21.15.69:0/2058922387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae08106200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fae040098a0 tx=0x7fae04009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 -- 172.21.15.69:0/2058922387 shutdown_connections 2023-12-14T18:18:16.821 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 --2- 172.21.15.69:0/2058922387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae08106200 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 -- 172.21.15.69:0/2058922387 >> 172.21.15.69:0/2058922387 conn(0x7fae080ff5e0 msgr2=0x7fae08101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 -- 172.21.15.69:0/2058922387 shutdown_connections 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.254+0000 7fae0f9ce700 1 -- 172.21.15.69:0/2058922387 wait complete. 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0f9ce700 1 Processor -- start 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0f9ce700 1 -- start start 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0f9ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae081044f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0f9ce700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0819a190 con 0x7fae08105df0 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0d76a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae081044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0d76a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae081044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53614/0 (socket says 172.21.15.69:53614) 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.255+0000 7fae0d76a700 1 -- 172.21.15.69:0/3371028447 learned_addr learned my addr 172.21.15.69:0/3371028447 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fae0d76a700 1 -- 172.21.15.69:0/3371028447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04009550 con 0x7fae08105df0 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fae0d76a700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae081044f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae04006af0 tx=0x7fae04011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae040037d0 con 0x7fae08105df0 2023-12-14T18:18:16.822 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fae0f9ce700 1 -- 172.21.15.69:0/3371028447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08105830 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae0401b440 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae040193d0 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.256+0000 7fae0f9ce700 1 -- 172.21.15.69:0/3371028447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae081056a0 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.257+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fae04019690 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.257+0000 7fadfe7fc700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fadf40386c0 0x7fadf403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.257+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade80052f0 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.257+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fae0404c8f0 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.257+0000 7fae0cf69700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fadf40386c0 0x7fadf403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.258+0000 7fae0cf69700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fadf40386c0 0x7fadf403ab70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fadf8006fd0 tx=0x7fadf8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.262+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fae0401a3d0 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.462+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fade80059c0 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.467+0000 7fadfe7fc700 1 -- 172.21.15.69:0/3371028447 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fae04018350 con 0x7fae08105df0 2023-12-14T18:18:16.823 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fadf40386c0 msgr2=0x7fadf403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fadf40386c0 0x7fadf403ab70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fadf8006fd0 tx=0x7fadf8006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 msgr2=0x7fae081044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae081044f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae04006af0 tx=0x7fae04011e80 comp rx=0 tx=0).stop 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 shutdown_connections 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7fadf40386c0 0x7fadf403ab70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 --2- 172.21.15.69:0/3371028447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae08105df0 0x7fae081044f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 >> 172.21.15.69:0/3371028447 conn(0x7fae080ff5e0 msgr2=0x7fae08100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 shutdown_connections 2023-12-14T18:18:16.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:16.469+0000 7fadf3fff700 1 -- 172.21.15.69:0/3371028447 wait complete. 2023-12-14T18:18:17.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:16 smithi069 ceph-mon[42047]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:17.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:16 smithi069 ceph-mon[42047]: Saving service mgr spec with placement count:2 2023-12-14T18:18:17.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:16 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:17.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:16 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:17.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:16 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3371028447' entity='client.admin' 2023-12-14T18:18:17.795 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.214+0000 7f88ccd36700 1 Processor -- start 2023-12-14T18:18:17.795 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.214+0000 7f88ccd36700 1 -- start start 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88ccd36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c8108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88ccd36700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8074080 con 0x7f88c8106460 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c8108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c8108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53616/0 (socket says 172.21.15.69:53616) 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c659c700 1 -- 172.21.15.69:0/1502883453 learned_addr learned my addr 172.21.15.69:0/1502883453 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c659c700 1 -- 172.21.15.69:0/1502883453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80741c0 con 0x7f88c8106460 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c659c700 1 --2- 172.21.15.69:0/1502883453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c8108840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88b80098a0 tx=0x7f88b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541659dabe726728 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c559a700 1 -- 172.21.15.69:0/1502883453 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8004160 con 0x7f88c8106460 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c559a700 1 -- 172.21.15.69:0/1502883453 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b80042c0 con 0x7f88c8106460 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.215+0000 7f88c559a700 1 -- 172.21.15.69:0/1502883453 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b80118e0 con 0x7f88c8106460 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 -- 172.21.15.69:0/1502883453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 msgr2=0x7f88c8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 --2- 172.21.15.69:0/1502883453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c8108840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88b80098a0 tx=0x7f88b8009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 -- 172.21.15.69:0/1502883453 shutdown_connections 2023-12-14T18:18:17.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 --2- 172.21.15.69:0/1502883453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c8108840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 -- 172.21.15.69:0/1502883453 >> 172.21.15.69:0/1502883453 conn(0x7f88c80ffea0 msgr2=0x7f88c81022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 -- 172.21.15.69:0/1502883453 shutdown_connections 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.216+0000 7f88ccd36700 1 -- 172.21.15.69:0/1502883453 wait complete. 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88ccd36700 1 Processor -- start 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88ccd36700 1 -- start start 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88ccd36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88ccd36700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c819bcd0 con 0x7f88c8106460 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88c659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88c659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c819b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53628/0 (socket says 172.21.15.69:53628) 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88c659c700 1 -- 172.21.15.69:0/2096648081 learned_addr learned my addr 172.21.15.69:0/2096648081 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88c659c700 1 -- 172.21.15.69:0/2096648081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009550 con 0x7f88c8106460 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.217+0000 7f88c659c700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c819b790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006af0 tx=0x7f88b8011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.218+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b80037d0 con 0x7f88c8106460 2023-12-14T18:18:17.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.218+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b801b440 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.218+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c8109b00 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.218+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8019560 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.218+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c8109970 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.218+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f88b80197d0 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.219+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c8109c90 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.219+0000 7f88b77fe700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f88b0038710 0x7f88b003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.219+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f88b804c6a0 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.219+0000 7f88c5d9b700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f88b0038710 0x7f88b003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.219+0000 7f88c5d9b700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f88b0038710 0x7f88b003abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f88bc006fd0 tx=0x7f88bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.223+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f88b8018db0 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.425+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f88c819f150 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.428+0000 7f88b77fe700 1 -- 172.21.15.69:0/2096648081 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f88b8018350 con 0x7f88c8106460 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f88b0038710 msgr2=0x7f88b003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:17.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f88b0038710 0x7f88b003abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f88bc006fd0 tx=0x7f88bc006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 msgr2=0x7f88c819b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c819b790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006af0 tx=0x7f88b8011e80 comp rx=0 tx=0).stop 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 shutdown_connections 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f88b0038710 0x7f88b003abc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 --2- 172.21.15.69:0/2096648081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c8106460 0x7f88c819b790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 >> 172.21.15.69:0/2096648081 conn(0x7f88c80ffea0 msgr2=0x7f88c8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.430+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 shutdown_connections 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:17.431+0000 7f88ccd36700 1 -- 172.21.15.69:0/2096648081 wait complete. 2023-12-14T18:18:17.799 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling the dashboard module... 2023-12-14T18:18:18.391 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:18 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:18.391 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:18 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2096648081' entity='client.admin' 2023-12-14T18:18:19.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:19 smithi069 ceph-mon[42047]: from='mgr.14120 172.21.15.69:0/474916038' entity='mgr.x' 2023-12-14T18:18:19.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:19 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1503358779' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-14T18:18:19.709 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:19 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: ignoring --setuser ceph since I am not root 2023-12-14T18:18:19.709 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:19 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: ignoring --setgroup ceph since I am not root 2023-12-14T18:18:19.998 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8c01113700 1 Processor -- start 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8c01113700 1 -- start start 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8c01113700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8c01113700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0740c0 con 0x7f8bfc106420 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8bfad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8bfad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53634/0 (socket says 172.21.15.69:53634) 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8bfad9d700 1 -- 172.21.15.69:0/1101121935 learned_addr learned my addr 172.21.15.69:0/1101121935 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:20.004 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8bfad9d700 1 -- 172.21.15.69:0/1101121935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc074200 con 0x7f8bfc106420 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.387+0000 7f8bfad9d700 1 --2- 172.21.15.69:0/1101121935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc108800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0098a0 tx=0x7f8bec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df08bb57f067a4b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8bf9d9b700 1 -- 172.21.15.69:0/1101121935 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bec004160 con 0x7f8bfc106420 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8bf9d9b700 1 -- 172.21.15.69:0/1101121935 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bec0042c0 con 0x7f8bfc106420 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8bf9d9b700 1 -- 172.21.15.69:0/1101121935 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bec0118e0 con 0x7f8bfc106420 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 -- 172.21.15.69:0/1101121935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 msgr2=0x7f8bfc108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 --2- 172.21.15.69:0/1101121935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc108800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0098a0 tx=0x7f8bec009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 -- 172.21.15.69:0/1101121935 shutdown_connections 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 --2- 172.21.15.69:0/1101121935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc108800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 -- 172.21.15.69:0/1101121935 >> 172.21.15.69:0/1101121935 conn(0x7f8bfc0ffea0 msgr2=0x7f8bfc1022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 -- 172.21.15.69:0/1101121935 shutdown_connections 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.388+0000 7f8c01113700 1 -- 172.21.15.69:0/1101121935 wait complete. 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.389+0000 7f8c01113700 1 Processor -- start 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.389+0000 7f8c01113700 1 -- start start 2023-12-14T18:18:20.005 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.389+0000 7f8c01113700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.389+0000 7f8c01113700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc199b00 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.390+0000 7f8bfad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.390+0000 7f8bfad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53636/0 (socket says 172.21.15.69:53636) 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.390+0000 7f8bfad9d700 1 -- 172.21.15.69:0/1503358779 learned_addr learned my addr 172.21.15.69:0/1503358779 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.390+0000 7f8bfad9d700 1 -- 172.21.15.69:0/1503358779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec009550 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.390+0000 7f8bfad9d700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc1995c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bec006af0 tx=0x7f8bec011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.392+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bec0037d0 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.392+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bec01b440 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.392+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc109b80 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.392+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bec019560 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.392+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc1099f0 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.393+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f8bec019820 con 0x7f8bfc106420 2023-12-14T18:18:20.006 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.393+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc109d10 con 0x7f8bfc106420 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.393+0000 7f8be3fff700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8be40386c0 0x7f8be403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.393+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8bec04c540 con 0x7f8bfc106420 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.393+0000 7f8bfa59c700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8be40386c0 0x7f8be403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.394+0000 7f8bfa59c700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8be40386c0 0x7f8be403ab70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0006fd0 tx=0x7f8bf0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.402+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8bec018bd0 con 0x7f8bfc106420 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:18.657+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f8bfc062120 con 0x7f8bfc106420 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.575+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f8bec00fda0 con 0x7f8bfc106420 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.576+0000 7f8be3fff700 1 -- 172.21.15.69:0/1503358779 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8bec04e680 con 0x7f8bfc106420 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8be40386c0 msgr2=0x7f8be403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8be40386c0 0x7f8be403ab70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0006fd0 tx=0x7f8bf0006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 msgr2=0x7f8bfc1995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc1995c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bec006af0 tx=0x7f8bec011e80 comp rx=0 tx=0).stop 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 shutdown_connections 2023-12-14T18:18:20.007 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f8be40386c0 0x7f8be403ab70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.008 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 --2- 172.21.15.69:0/1503358779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bfc106420 0x7f8bfc1995c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.008 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 >> 172.21.15.69:0/1503358779 conn(0x7f8bfc0ffea0 msgr2=0x7f8bfc100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:20.008 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 shutdown_connections 2023-12-14T18:18:20.008 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:19.579+0000 7f8c01113700 1 -- 172.21.15.69:0/1503358779 wait complete. 2023-12-14T18:18:20.105 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:19 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:19.950+0000 7f9c92e99200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T18:18:20.105 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:20.059+0000 7f9c92e99200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T18:18:20.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:20.154+0000 7f9c92e99200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T18:18:20.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:20.240+0000 7f9c92e99200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T18:18:20.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:20 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1503358779' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-14T18:18:20.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:20 smithi069 ceph-mon[42047]: mgrmap e9: x(active, since 15s) 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf7212700 1 Processor -- start 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf7212700 1 -- start start 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf7212700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf010a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf7212700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01062c0 con 0x7f4cf0074020 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf4fae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf010a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:20.980 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf4fae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf010a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53672/0 (socket says 172.21.15.69:53672) 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.358+0000 7f4cf4fae700 1 -- 172.21.15.69:0/3716382192 learned_addr learned my addr 172.21.15.69:0/3716382192 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.359+0000 7f4cf4fae700 1 -- 172.21.15.69:0/3716382192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf010ae10 con 0x7f4cf0074020 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.359+0000 7f4cf4fae700 1 --2- 172.21.15.69:0/3716382192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf010a8d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40098a0 tx=0x7f4ce4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860d215df7e11438 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.359+0000 7f4cef7fe700 1 -- 172.21.15.69:0/3716382192 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ce4004160 con 0x7f4cf0074020 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.359+0000 7f4cef7fe700 1 -- 172.21.15.69:0/3716382192 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ce40042c0 con 0x7f4cf0074020 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.359+0000 7f4cef7fe700 1 -- 172.21.15.69:0/3716382192 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ce40118e0 con 0x7f4cf0074020 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 -- 172.21.15.69:0/3716382192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 msgr2=0x7f4cf010a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 --2- 172.21.15.69:0/3716382192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf010a8d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40098a0 tx=0x7f4ce4009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 -- 172.21.15.69:0/3716382192 shutdown_connections 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 --2- 172.21.15.69:0/3716382192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf010a8d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 -- 172.21.15.69:0/3716382192 >> 172.21.15.69:0/3716382192 conn(0x7f4cf00ffea0 msgr2=0x7f4cf01022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 -- 172.21.15.69:0/3716382192 shutdown_connections 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 -- 172.21.15.69:0/3716382192 wait complete. 2023-12-14T18:18:20.981 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 Processor -- start 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.360+0000 7f4cf7212700 1 -- start start 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf7212700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf7212700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf019be00 con 0x7f4cf0074020 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf4fae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf4fae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53680/0 (socket says 172.21.15.69:53680) 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf4fae700 1 -- 172.21.15.69:0/2736721589 learned_addr learned my addr 172.21.15.69:0/2736721589 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf4fae700 1 -- 172.21.15.69:0/2736721589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4009550 con 0x7f4cf0074020 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf4fae700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf019b8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4006af0 tx=0x7f4ce4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ce40038b0 con 0x7f4cf0074020 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ce4003a10 con 0x7f4cf0074020 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ce4023400 con 0x7f4cf0074020 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.361+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf010bd80 con 0x7f4cf0074020 2023-12-14T18:18:20.982 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.362+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf010bbf0 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.362+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f4ce401b440 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.363+0000 7f4cedffb700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 0x7f4ce003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.363+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4ce404c790 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.363+0000 7f4ceffff700 1 -- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 msgr2=0x7f4ce003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.363+0000 7f4ceffff700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 0x7f4ce003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.363+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf010bf10 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.368+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4ce4003b80 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.564+0000 7f4ceffff700 1 -- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 msgr2=0x7f4ce003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.564+0000 7f4ceffff700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 0x7f4ce003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.621+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f4cf019f320 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.621+0000 7f4cedffb700 1 -- 172.21.15.69:0/2736721589 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f4ce402b350 con 0x7f4cf0074020 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 msgr2=0x7f4ce003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:18:20.983 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 0x7f4ce003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 msgr2=0x7f4cf019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf019b8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4006af0 tx=0x7f4ce4011ef0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 shutdown_connections 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f4ce0038760 0x7f4ce003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 --2- 172.21.15.69:0/2736721589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cf0074020 0x7f4cf019b8c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 >> 172.21.15.69:0/2736721589 conn(0x7f4cf00ffea0 msgr2=0x7f4cf0101590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 shutdown_connections 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:20.623+0000 7f4cf7212700 1 -- 172.21.15.69:0/2736721589 wait complete. 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2023-12-14T18:18:20.984 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 9... 2023-12-14T18:18:21.124 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:20.871+0000 7f9c92e99200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:18:21.124 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:21.122+0000 7f9c92e99200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T18:18:21.426 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:21.212+0000 7f9c92e99200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T18:18:21.426 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:21.328+0000 7f9c92e99200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T18:18:21.705 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2736721589' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-14T18:18:21.706 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:21.424+0000 7f9c92e99200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T18:18:21.706 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:21.619+0000 7f9c92e99200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T18:18:22.340 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:21.704+0000 7f9c92e99200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T18:18:22.340 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:22.073+0000 7f9c92e99200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T18:18:22.340 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:22.338+0000 7f9c92e99200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T18:18:22.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:22.618+0000 7f9c92e99200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T18:18:22.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:22.712+0000 7f9c92e99200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T18:18:23.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:23.459+0000 7f9c92e99200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T18:18:23.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:23.554+0000 7f9c92e99200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T18:18:23.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:23.701+0000 7f9c92e99200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T18:18:24.702 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:24.323+0000 7f9c92e99200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T18:18:24.702 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:24.507+0000 7f9c92e99200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T18:18:24.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:24.700+0000 7f9c92e99200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T18:18:25.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:25.408+0000 7f9c92e99200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T18:18:26.161 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:25.880+0000 7f9c92e99200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:18:26.161 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:25.968+0000 7f9c92e99200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T18:18:26.458 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:18:26.159+0000 7f9c92e99200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T18:18:26.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: Active manager daemon x restarted 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: Activating manager daemon x 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: osdmap e3: 0 total, 0 up, 0 in 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: mgrmap e10: x(active, starting, since 0.00326728s) 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: Manager daemon x is now available 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:26.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:27.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-14T18:18:27.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-14T18:18:27.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:27.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:27 smithi069 ceph-mon[42047]: mgrmap e11: x(active, since 1.00558s) 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f528329a700 1 Processor -- start 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f528329a700 1 -- start start 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f528329a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c104c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:27.537 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f528329a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c105160 con 0x7f527c104810 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f5281036700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f5281036700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c104c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53684/0 (socket says 172.21.15.69:53684) 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f5281036700 1 -- 172.21.15.69:0/1436489905 learned_addr learned my addr 172.21.15.69:0/1436489905 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.347+0000 7f5281036700 1 -- 172.21.15.69:0/1436489905 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c1052a0 con 0x7f527c104810 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f5281036700 1 --2- 172.21.15.69:0/1436489905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c104c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52780098a0 tx=0x7f5278009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea71e9a80fbaf18 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f5273fff700 1 -- 172.21.15.69:0/1436489905 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5278004160 con 0x7f527c104810 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f5273fff700 1 -- 172.21.15.69:0/1436489905 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52780042c0 con 0x7f527c104810 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f5273fff700 1 -- 172.21.15.69:0/1436489905 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52780118e0 con 0x7f527c104810 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f528329a700 1 -- 172.21.15.69:0/1436489905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 msgr2=0x7f527c104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f528329a700 1 --2- 172.21.15.69:0/1436489905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c104c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52780098a0 tx=0x7f5278009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f528329a700 1 -- 172.21.15.69:0/1436489905 shutdown_connections 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f528329a700 1 --2- 172.21.15.69:0/1436489905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c104c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.348+0000 7f528329a700 1 -- 172.21.15.69:0/1436489905 >> 172.21.15.69:0/1436489905 conn(0x7f527c0ffea0 msgr2=0x7f527c1022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:27.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f528329a700 1 -- 172.21.15.69:0/1436489905 shutdown_connections 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f528329a700 1 -- 172.21.15.69:0/1436489905 wait complete. 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f528329a700 1 Processor -- start 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f528329a700 1 -- start start 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f528329a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f528329a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c197970 con 0x7f527c104810 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.349+0000 7f5281036700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f5281036700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53700/0 (socket says 172.21.15.69:53700) 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f5281036700 1 -- 172.21.15.69:0/2642739999 learned_addr learned my addr 172.21.15.69:0/2642739999 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f5281036700 1 -- 172.21.15.69:0/2642739999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278009550 con 0x7f527c104810 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f5281036700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c197430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52780118f0 tx=0x7f52780119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52780036a0 con 0x7f527c104810 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c106840 con 0x7f527c104810 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f527801b440 con 0x7f527c104810 2023-12-14T18:18:27.539 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52780193f0 con 0x7f527c104810 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.350+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c1066b0 con 0x7f527c104810 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.351+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f5278019670 con 0x7f527c104810 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.351+0000 7f52727fc700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.351+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 --> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f526803d560 con 0x7f526803a9a0 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.351+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f527804c630 con 0x7f527c104810 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.351+0000 7f5280835700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 msgr2=0x7f526803ce50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.351+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.552+0000 7f5280835700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 msgr2=0x7f526803ce50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.552+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.953+0000 7f5280835700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 msgr2=0x7f526803ce50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:21.953+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-14T18:18:27.540 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:22.754+0000 7f5280835700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 msgr2=0x7f526803ce50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:22.754+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:24.355+0000 7f5280835700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 msgr2=0x7f526803ce50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3699885016 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:24.355+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:26.174+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7f527801b5b0 con 0x7f527c104810 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:26.174+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 msgr2=0x7f526803ce50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:26.174+0000 7f52727fc700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.175+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f5278019a10 con 0x7f527c104810 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.175+0000 7f52727fc700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f526803e400 0x7f52680407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.175+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f526803d560 con 0x7f526803e400 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.176+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f526803e400 0x7f52680407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.177+0000 7f5280835700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f526803e400 0x7f52680407e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f526c003a10 tx=0x7f526c0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.177+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f526803d560 con 0x7f526803e400 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.183+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f527c198770 con 0x7f526803e400 2023-12-14T18:18:27.541 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f52727fc700 1 -- 172.21.15.69:0/2642739999 <== mgr.14152 v2:172.21.15.69:6800/4294204545 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f527c198770 con 0x7f526803e400 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f526803e400 msgr2=0x7f52680407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f526803e400 0x7f52680407e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f526c003a10 tx=0x7f526c0092b0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 msgr2=0x7f527c197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c197430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52780118f0 tx=0x7f52780119d0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 shutdown_connections 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f526803e400 0x7f52680407e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f527c104810 0x7f527c197430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 --2- 172.21.15.69:0/2642739999 >> [v2:172.21.15.69:6800/3699885016,v1:172.21.15.69:6801/3699885016] conn(0x7f526803a9a0 0x7f526803ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 >> 172.21.15.69:0/2642739999 conn(0x7f527c0ffea0 msgr2=0x7f527c18e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 shutdown_connections 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.184+0000 7f528329a700 1 -- 172.21.15.69:0/2642739999 wait complete. 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 9 is available 2023-12-14T18:18:27.542 INFO:teuthology.orchestra.run.smithi069.stdout:Generating a dashboard self-signed certificate... 2023-12-14T18:18:28.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:27] ENGINE Bus STARTING 2023-12-14T18:18:28.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:27] ENGINE Serving on https://172.21.15.69:7150 2023-12-14T18:18:28.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-14T18:18:28.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-14T18:18:28.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:27] ENGINE Serving on http://172.21.15.69:8765 2023-12-14T18:18:28.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: [14/Dec/2023:18:18:27] ENGINE Bus STARTED 2023-12-14T18:18:28.571 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:28.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-14T18:18:28.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.912+0000 7f176a63a700 1 Processor -- start 2023-12-14T18:18:28.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.912+0000 7f176a63a700 1 -- start start 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.912+0000 7f176a63a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764108860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.912+0000 7f176a63a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764079cb0 con 0x7f1764106480 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1763fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764108860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1763fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764108860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43238/0 (socket says 172.21.15.69:43238) 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1763fff700 1 -- 172.21.15.69:0/3783060963 learned_addr learned my addr 172.21.15.69:0/3783060963 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1763fff700 1 -- 172.21.15.69:0/3783060963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764079df0 con 0x7f1764106480 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1763fff700 1 --2- 172.21.15.69:0/3783060963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764108860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f17540098a0 tx=0x7f1754009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dd6739bbd34265 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1762ffd700 1 -- 172.21.15.69:0/3783060963 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1754004160 con 0x7f1764106480 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1762ffd700 1 -- 172.21.15.69:0/3783060963 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17540042c0 con 0x7f1764106480 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.913+0000 7f1762ffd700 1 -- 172.21.15.69:0/3783060963 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17540118e0 con 0x7f1764106480 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 -- 172.21.15.69:0/3783060963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 msgr2=0x7f1764108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 --2- 172.21.15.69:0/3783060963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764108860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f17540098a0 tx=0x7f1754009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:28.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 -- 172.21.15.69:0/3783060963 shutdown_connections 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 --2- 172.21.15.69:0/3783060963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764108860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 -- 172.21.15.69:0/3783060963 >> 172.21.15.69:0/3783060963 conn(0x7f17640ffe60 msgr2=0x7f1764102290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 -- 172.21.15.69:0/3783060963 shutdown_connections 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.914+0000 7f176a63a700 1 -- 172.21.15.69:0/3783060963 wait complete. 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.915+0000 7f176a63a700 1 Processor -- start 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.915+0000 7f176a63a700 1 -- start start 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.915+0000 7f176a63a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764105de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.915+0000 7f176a63a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764106320 con 0x7f1764106480 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f1763fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f1763fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43250/0 (socket says 172.21.15.69:43250) 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f1763fff700 1 -- 172.21.15.69:0/1640256198 learned_addr learned my addr 172.21.15.69:0/1640256198 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f1763fff700 1 -- 172.21.15.69:0/1640256198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754009550 con 0x7f1764106480 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f1763fff700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764105de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1754006af0 tx=0x7f1754011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17540037d0 con 0x7f1764106480 2023-12-14T18:18:28.770 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f175401b440 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1754019560 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1764109b80 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.916+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17641099f0 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.917+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f17540197d0 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.917+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1764062120 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.917+0000 7f17617fa700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f174c038640 0x7f174c03aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.917+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f175404c480 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.917+0000 7f17637fe700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f174c038640 0x7f174c03aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.918+0000 7f17637fe700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f174c038640 0x7f174c03aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1758006fd0 tx=0x7f1758006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:27.922+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1754018db0 con 0x7f1764106480 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.133+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f1764105330 con 0x7f174c038640 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.297+0000 7f17617fa700 1 -- 172.21.15.69:0/1640256198 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f1764105330 con 0x7f174c038640 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.299+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f174c038640 msgr2=0x7f174c03aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:28.771 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.299+0000 7f176a63a700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f174c038640 0x7f174c03aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1758006fd0 tx=0x7f1758006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.299+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 msgr2=0x7f1764105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.299+0000 7f176a63a700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764105de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1754006af0 tx=0x7f1754011e80 comp rx=0 tx=0).stop 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.300+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 shutdown_connections 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.300+0000 7f176a63a700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f174c038640 0x7f174c03aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.300+0000 7f176a63a700 1 --2- 172.21.15.69:0/1640256198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1764106480 0x7f1764105de0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.300+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 >> 172.21.15.69:0/1640256198 conn(0x7f17640ffe60 msgr2=0x7f1764101560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.300+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 shutdown_connections 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:28.300+0000 7f176a63a700 1 -- 172.21.15.69:0/1640256198 wait complete. 2023-12-14T18:18:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial admin user... 2023-12-14T18:18:29.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:29 smithi069 ceph-mon[42047]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:29.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:29.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:29.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:29 smithi069 ceph-mon[42047]: mgrmap e12: x(active, since 2s) 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$AHnBcogUgoh.R8N6dgWc4uCU1m8Uk4Lj/wIuQ83dX4BgGe/5Vh/1a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702577909, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a5be3e700 1 Processor -- start 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a5be3e700 1 -- start start 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a5be3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54104c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a5be3e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54105160 con 0x7f7a54104810 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a59bda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:30.185 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a59bda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54104c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43256/0 (socket says 172.21.15.69:43256) 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.380+0000 7f7a59bda700 1 -- 172.21.15.69:0/3882933618 learned_addr learned my addr 172.21.15.69:0/3882933618 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.381+0000 7f7a59bda700 1 -- 172.21.15.69:0/3882933618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a541052a0 con 0x7f7a54104810 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.381+0000 7f7a59bda700 1 --2- 172.21.15.69:0/3882933618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54104c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a440098a0 tx=0x7f7a44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af52900c6d96ca24 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.381+0000 7f7a58bd8700 1 -- 172.21.15.69:0/3882933618 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a44004160 con 0x7f7a54104810 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.381+0000 7f7a58bd8700 1 -- 172.21.15.69:0/3882933618 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a440042c0 con 0x7f7a54104810 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.381+0000 7f7a58bd8700 1 -- 172.21.15.69:0/3882933618 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a440118e0 con 0x7f7a54104810 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- 172.21.15.69:0/3882933618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 msgr2=0x7f7a54104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 --2- 172.21.15.69:0/3882933618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54104c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a440098a0 tx=0x7f7a44009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- 172.21.15.69:0/3882933618 shutdown_connections 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 --2- 172.21.15.69:0/3882933618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54104c20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- 172.21.15.69:0/3882933618 >> 172.21.15.69:0/3882933618 conn(0x7f7a540ffea0 msgr2=0x7f7a541022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- 172.21.15.69:0/3882933618 shutdown_connections 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- 172.21.15.69:0/3882933618 wait complete. 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 Processor -- start 2023-12-14T18:18:30.186 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- start start 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54073e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.382+0000 7f7a5be3e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5419c370 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a59bda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a59bda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54073e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43264/0 (socket says 172.21.15.69:43264) 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a59bda700 1 -- 172.21.15.69:0/1413035578 learned_addr learned my addr 172.21.15.69:0/1413035578 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a59bda700 1 -- 172.21.15.69:0/1413035578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44009550 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a59bda700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54073e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a440118f0 tx=0x7f7a440119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a440036a0 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a54106840 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a4401b440 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a440193f0 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.383+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a541066b0 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.384+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7a44003800 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.384+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a54108ce0 con 0x7f7a54104810 2023-12-14T18:18:30.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.384+0000 7f7a4affd700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a40038760 0x7f7a4003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.384+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7a4404c6f0 con 0x7f7a54104810 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.384+0000 7f7a593d9700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a40038760 0x7f7a4003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.385+0000 7f7a593d9700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a40038760 0x7f7a4003ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a50006fd0 tx=0x7f7a50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.389+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7a44023a00 con 0x7f7a54104810 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.592+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5419cf60 con 0x7f7a40038760 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.810+0000 7f7a4affd700 1 -- 172.21.15.69:0/1413035578 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f7a5419cf60 con 0x7f7a40038760 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a40038760 msgr2=0x7f7a4003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a40038760 0x7f7a4003ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a50006fd0 tx=0x7f7a50006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 msgr2=0x7f7a54073e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54073e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a440118f0 tx=0x7f7a440119d0 comp rx=0 tx=0).stop 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 shutdown_connections 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a40038760 0x7f7a4003ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 --2- 172.21.15.69:0/1413035578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a54104810 0x7f7a54073e90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 >> 172.21.15.69:0/1413035578 conn(0x7f7a540ffea0 msgr2=0x7f7a541015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:30.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 shutdown_connections 2023-12-14T18:18:30.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:29.812+0000 7f7a5be3e700 1 -- 172.21.15.69:0/1413035578 wait complete. 2023-12-14T18:18:30.189 INFO:teuthology.orchestra.run.smithi069.stdout:Fetching dashboard port number... 2023-12-14T18:18:30.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:30 smithi069 ceph-mon[42047]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:30.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:30 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:31.093 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 8443 2023-12-14T18:18:31.093 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d930a1700 1 Processor -- start 2023-12-14T18:18:31.093 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d930a1700 1 -- start start 2023-12-14T18:18:31.093 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d930a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c108860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:31.093 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d930a1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c074060 con 0x7f2d8c106480 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d90e3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c108860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d90e3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c108860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43280/0 (socket says 172.21.15.69:43280) 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d90e3d700 1 -- 172.21.15.69:0/1760409024 learned_addr learned my addr 172.21.15.69:0/1760409024 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d90e3d700 1 -- 172.21.15.69:0/1760409024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0741a0 con 0x7f2d8c106480 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.535+0000 7f2d90e3d700 1 --2- 172.21.15.69:0/1760409024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c108860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d800098a0 tx=0x7f2d80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b889b5e5cffa94e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d8b7fe700 1 -- 172.21.15.69:0/1760409024 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d80004160 con 0x7f2d8c106480 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d8b7fe700 1 -- 172.21.15.69:0/1760409024 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d800042c0 con 0x7f2d8c106480 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d8b7fe700 1 -- 172.21.15.69:0/1760409024 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d800118e0 con 0x7f2d8c106480 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 -- 172.21.15.69:0/1760409024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 msgr2=0x7f2d8c108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 --2- 172.21.15.69:0/1760409024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c108860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d800098a0 tx=0x7f2d80009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 -- 172.21.15.69:0/1760409024 shutdown_connections 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 --2- 172.21.15.69:0/1760409024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c108860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 -- 172.21.15.69:0/1760409024 >> 172.21.15.69:0/1760409024 conn(0x7f2d8c0ffea0 msgr2=0x7f2d8c1022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:31.094 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 -- 172.21.15.69:0/1760409024 shutdown_connections 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.536+0000 7f2d930a1700 1 -- 172.21.15.69:0/1760409024 wait complete. 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d930a1700 1 Processor -- start 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d930a1700 1 -- start start 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d930a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c105de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d930a1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c106320 con 0x7f2d8c106480 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d90e3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d90e3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43292/0 (socket says 172.21.15.69:43292) 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d90e3d700 1 -- 172.21.15.69:0/3237864207 learned_addr learned my addr 172.21.15.69:0/3237864207 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.537+0000 7f2d90e3d700 1 -- 172.21.15.69:0/3237864207 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80009550 con 0x7f2d8c106480 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.538+0000 7f2d90e3d700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c105de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d80000c00 tx=0x7f2d800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.538+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d800036a0 con 0x7f2d8c106480 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.538+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d8001b440 con 0x7f2d8c106480 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.538+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d8001a3d0 con 0x7f2d8c106480 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.538+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c109b80 con 0x7f2d8c106480 2023-12-14T18:18:31.095 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.538+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c1099f0 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.539+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2d8001b5b0 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.539+0000 7f2d89ffb700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0387b0 0x7f2d7c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.539+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c109d10 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.539+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2d8004c670 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.539+0000 7f2d8bfff700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0387b0 0x7f2d7c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.539+0000 7f2d8bfff700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0387b0 0x7f2d7c03ac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2d78006fd0 tx=0x7f2d78006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.544+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2d8001f020 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.732+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f2d8c104fa0 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.733+0000 7f2d89ffb700 1 -- 172.21.15.69:0/3237864207 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f2d80023c00 con 0x7f2d8c106480 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0387b0 msgr2=0x7f2d7c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0387b0 0x7f2d7c03ac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2d78006fd0 tx=0x7f2d78006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 msgr2=0x7f2d8c105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:31.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c105de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d80000c00 tx=0x7f2d800119a0 comp rx=0 tx=0).stop 2023-12-14T18:18:31.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 shutdown_connections 2023-12-14T18:18:31.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0387b0 0x7f2d7c03ac60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:31.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 --2- 172.21.15.69:0/3237864207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d8c106480 0x7f2d8c105de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:31.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 >> 172.21.15.69:0/3237864207 conn(0x7f2d8c0ffea0 msgr2=0x7f2d8c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:31.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 shutdown_connections 2023-12-14T18:18:31.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:30.735+0000 7f2d930a1700 1 -- 172.21.15.69:0/3237864207 wait complete. 2023-12-14T18:18:31.099 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-14T18:18:31.099 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2023-12-14T18:18:31.106 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-14T18:18:31.106 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2023-12-14T18:18:31.106 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2023-12-14T18:18:31.106 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-14T18:18:31.108 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph Dashboard is now available at: 2023-12-14T18:18:31.108 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:31.108 INFO:teuthology.orchestra.run.smithi069.stdout: URL: https://smithi069:8443/ 2023-12-14T18:18:31.108 INFO:teuthology.orchestra.run.smithi069.stdout: User: admin 2023-12-14T18:18:31.108 INFO:teuthology.orchestra.run.smithi069.stdout: Password: 4p1h5a0c2k 2023-12-14T18:18:31.108 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:31.109 INFO:teuthology.orchestra.run.smithi069.stdout:Saving cluster configuration to /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config directory 2023-12-14T18:18:31.109 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling autotune for osd_memory_target 2023-12-14T18:18:31.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:31 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3237864207' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f5190831700 1 Processor -- start 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f5190831700 1 -- start start 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f5190831700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c1062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f5190831700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c1067f0 con 0x7f518c105ea0 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f518a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c1062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f518a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c1062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43302/0 (socket says 172.21.15.69:43302) 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.479+0000 7f518a59c700 1 -- 172.21.15.69:0/1110479002 learned_addr learned my addr 172.21.15.69:0/1110479002 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f518a59c700 1 -- 172.21.15.69:0/1110479002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c106930 con 0x7f518c105ea0 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f518a59c700 1 --2- 172.21.15.69:0/1110479002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c1062b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f517c0098a0 tx=0x7f517c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ae9514bcc33913 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:32.060 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f518959a700 1 -- 172.21.15.69:0/1110479002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c004160 con 0x7f518c105ea0 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f518959a700 1 -- 172.21.15.69:0/1110479002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f517c0042c0 con 0x7f518c105ea0 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f518959a700 1 -- 172.21.15.69:0/1110479002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c0118e0 con 0x7f518c105ea0 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f5190831700 1 -- 172.21.15.69:0/1110479002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 msgr2=0x7f518c1062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.480+0000 7f5190831700 1 --2- 172.21.15.69:0/1110479002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c1062b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f517c0098a0 tx=0x7f517c009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 -- 172.21.15.69:0/1110479002 shutdown_connections 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 --2- 172.21.15.69:0/1110479002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c1062b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 -- 172.21.15.69:0/1110479002 >> 172.21.15.69:0/1110479002 conn(0x7f518c0ff5e0 msgr2=0x7f518c101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 -- 172.21.15.69:0/1110479002 shutdown_connections 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 -- 172.21.15.69:0/1110479002 wait complete. 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 Processor -- start 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.481+0000 7f5190831700 1 -- start start 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f5190831700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:32.061 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f5190831700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c19bd00 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f518a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f518a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c19b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43312/0 (socket says 172.21.15.69:43312) 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f518a59c700 1 -- 172.21.15.69:0/3930352458 learned_addr learned my addr 172.21.15.69:0/3930352458 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f518a59c700 1 -- 172.21.15.69:0/3930352458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009550 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f518a59c700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c19b7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f517c006af0 tx=0x7f517c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c0037d0 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f517c01b440 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c10bdb0 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c0193d0 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.482+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c10bc20 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.483+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f517c019690 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.483+0000 7f517b7fe700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5174038710 0x7f517403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.483+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f517c04c760 con 0x7f518c105ea0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.483+0000 7f5189d9b700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5174038710 0x7f517403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:32.062 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.483+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c10bf40 con 0x7f518c105ea0 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.484+0000 7f5189d9b700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5174038710 0x7f517403abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5180006fd0 tx=0x7f5180006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.488+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f517c048080 con 0x7f518c105ea0 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.675+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f518c062120 con 0x7f518c105ea0 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.676+0000 7f517b7fe700 1 -- 172.21.15.69:0/3930352458 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f517c01a3d0 con 0x7f518c105ea0 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5174038710 msgr2=0x7f517403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5174038710 0x7f517403abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5180006fd0 tx=0x7f5180006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 msgr2=0x7f518c19b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c19b7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f517c006af0 tx=0x7f517c011e80 comp rx=0 tx=0).stop 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 shutdown_connections 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5174038710 0x7f517403abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 --2- 172.21.15.69:0/3930352458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f518c105ea0 0x7f518c19b7c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 >> 172.21.15.69:0/3930352458 conn(0x7f518c0ff5e0 msgr2=0x7f518c100350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 shutdown_connections 2023-12-14T18:18:32.063 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:31.678+0000 7f5190831700 1 -- 172.21.15.69:0/3930352458 wait complete. 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.410+0000 7f5684d21700 1 Processor -- start 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.410+0000 7f5684d21700 1 -- start start 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.410+0000 7f5684d21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f5680108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.410+0000 7f5684d21700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680079cd0 con 0x7f5680106460 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f5680108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f5680108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43318/0 (socket says 172.21.15.69:43318) 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567e59c700 1 -- 172.21.15.69:0/4084059816 learned_addr learned my addr 172.21.15.69:0/4084059816 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567e59c700 1 -- 172.21.15.69:0/4084059816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680079e10 con 0x7f5680106460 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567e59c700 1 --2- 172.21.15.69:0/4084059816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f5680108840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56680098a0 tx=0x7f5668009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59161d269150829b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567d59a700 1 -- 172.21.15.69:0/4084059816 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5668004160 con 0x7f5680106460 2023-12-14T18:18:33.143 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567d59a700 1 -- 172.21.15.69:0/4084059816 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56680042c0 con 0x7f5680106460 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.411+0000 7f567d59a700 1 -- 172.21.15.69:0/4084059816 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56680118e0 con 0x7f5680106460 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 -- 172.21.15.69:0/4084059816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 msgr2=0x7f5680108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 --2- 172.21.15.69:0/4084059816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f5680108840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56680098a0 tx=0x7f5668009bb0 comp rx=0 tx=0).stop 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 -- 172.21.15.69:0/4084059816 shutdown_connections 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 --2- 172.21.15.69:0/4084059816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f5680108840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 -- 172.21.15.69:0/4084059816 >> 172.21.15.69:0/4084059816 conn(0x7f56800ffe60 msgr2=0x7f5680102290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 -- 172.21.15.69:0/4084059816 shutdown_connections 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.412+0000 7f5684d21700 1 -- 172.21.15.69:0/4084059816 wait complete. 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f5684d21700 1 Processor -- start 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f5684d21700 1 -- start start 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f5684d21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f56801995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f5684d21700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680199b00 con 0x7f5680106460 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f567e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f56801995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:33.144 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f567e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f56801995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43332/0 (socket says 172.21.15.69:43332) 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f567e59c700 1 -- 172.21.15.69:0/3862009445 learned_addr learned my addr 172.21.15.69:0/3862009445 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f567e59c700 1 -- 172.21.15.69:0/3862009445 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668009550 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f567e59c700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f56801995c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5668000c00 tx=0x7f56680119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.413+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56680036a0 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.414+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f566801b440 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.414+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5680109b00 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.414+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f566801a3d0 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.414+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5680109970 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.414+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f566801a690 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.414+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5680109c90 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.415+0000 7f56777fe700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f566c038800 0x7f566c03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.415+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f566804c7b0 con 0x7f5680106460 2023-12-14T18:18:33.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.415+0000 7f567dd9b700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f566c038800 0x7f566c03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.415+0000 7f567dd9b700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f566c038800 0x7f566c03acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5670006fd0 tx=0x7f5670006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.419+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5668023770 con 0x7f5680106460 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.712+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f568019cfb0 con 0x7f5680106460 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.715+0000 7f56777fe700 1 -- 172.21.15.69:0/3862009445 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f566801f070 con 0x7f5680106460 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f566c038800 msgr2=0x7f566c03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f566c038800 0x7f566c03acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5670006fd0 tx=0x7f5670006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 msgr2=0x7f56801995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f56801995c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5668000c00 tx=0x7f56680119a0 comp rx=0 tx=0).stop 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 shutdown_connections 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f566c038800 0x7f566c03acb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 --2- 172.21.15.69:0/3862009445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5680106460 0x7f56801995c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 >> 172.21.15.69:0/3862009445 conn(0x7f56800ffe60 msgr2=0x7f5680100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 shutdown_connections 2023-12-14T18:18:33.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2023-12-14T18:18:32.717+0000 7f5684d21700 1 -- 172.21.15.69:0/3862009445 wait complete. 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout:Or, if you are only running a single cluster on this host: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: ceph telemetry on 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout:For more information see: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.147 INFO:teuthology.orchestra.run.smithi069.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-12-14T18:18:33.148 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:33.148 INFO:teuthology.orchestra.run.smithi069.stdout:Bootstrap complete. 2023-12-14T18:18:33.176 INFO:tasks.cephadm:Fetching config... 2023-12-14T18:18:33.176 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:18:33.177 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-14T18:18:33.193 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-14T18:18:33.193 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:18:33.193 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-14T18:18:33.251 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-14T18:18:33.251 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:18:33.252 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/keyring of=/dev/stdout 2023-12-14T18:18:33.312 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:33 smithi069 ceph-mon[42047]: mgrmap e13: x(active, since 6s) 2023-12-14T18:18:33.312 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:33 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3862009445' entity='client.admin' 2023-12-14T18:18:33.323 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-14T18:18:33.323 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:18:33.323 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-14T18:18:33.380 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-14T18:18:33.380 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-14T18:18:33.458 INFO:teuthology.orchestra.run.smithi069.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:18:33.470 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-14T18:18:33.515 INFO:teuthology.orchestra.run.smithi091.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:18:33.528 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-14T18:18:33.574 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKseoUFiL6HcdCIJRmTXH1y9Ep6kZ6ZiZNMYO1wU+NyTlMkc3rfncuVIb25ebQ8tWiktmMAIFbbovQxHh/4wYamElL8CmQI9Skx/mXuuexIr53qh4OfVQZTGxBmaHS5iBk/BTIjoMXwKbs4zzDf1+K3bTTHgSZrlgY0/VAMyXzvMmY51DB7mRG91jnZcdjS5WtsCyl3AR3iYeDkClfd8NURW+jJXoosBELs3orWGDCT6JUY95dhc6f0XbSO0n3rn2/KfQIAGgc3Px68zscafcf/Z6l7mVoNKxUdW96u+3tQ8f1aauzRXVcJszzWEoMTj4WwMCuL03mjzTcuXTYlxvSLp9JutC3A+AqyiAQ8aDVvPvpCL2D/oSs0VOipPfTn6szlVBM/N5+CBc5624y8pLBoIjoti75SqqMSFzkrOQ2tryzOL2D19cm4ds6lllV0r7nNqp0Uiyjxq7XZHByxrMp5W7vV0/GXKqGJ3A1q+dWPTzlIajM5R6+7W2b8THSdn8= ceph-f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:18:33.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-14T18:18:33.903 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 -- 172.21.15.69:0/434434311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0430068a20 msgr2=0x7f0430102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 --2- 172.21.15.69:0/434434311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0430068a20 0x7f0430102890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0420009910 tx=0x7f0420009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 -- 172.21.15.69:0/434434311 shutdown_connections 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 --2- 172.21.15.69:0/434434311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0430068a20 0x7f0430102890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 -- 172.21.15.69:0/434434311 >> 172.21.15.69:0/434434311 conn(0x7f04300fa240 msgr2=0x7f04300fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 -- 172.21.15.69:0/434434311 shutdown_connections 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 -- 172.21.15.69:0/434434311 wait complete. 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.073+0000 7f0436231700 1 Processor -- start 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f0436231700 1 -- start start 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f0436231700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 0x7f04300fe830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f0436231700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04301005b0 con 0x7f04301001a0 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 0x7f04300fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 0x7f04300fe830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43354/0 (socket says 172.21.15.69:43354) 2023-12-14T18:18:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f042f7fe700 1 -- 172.21.15.69:0/4251328385 learned_addr learned my addr 172.21.15.69:0/4251328385 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f042f7fe700 1 -- 172.21.15.69:0/4251328385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200095f0 con 0x7f04301001a0 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f042f7fe700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 0x7f04300fe830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0420006010 tx=0x7f0420005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.074+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f042000ba90 con 0x7f04301001a0 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.075+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04301059f0 con 0x7f04301001a0 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.075+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f042000bbf0 con 0x7f04301001a0 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.075+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0420017440 con 0x7f04301001a0 2023-12-14T18:18:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.075+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0430105860 con 0x7f04301001a0 2023-12-14T18:18:35.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.075+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f0420017670 con 0x7f04301001a0 2023-12-14T18:18:35.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.076+0000 7f042cff9700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0418038870 0x7f041803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:35.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.076+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f042004c900 con 0x7f04301001a0 2023-12-14T18:18:35.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.076+0000 7f042effd700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0418038870 0x7f041803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:35.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.076+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0430105b80 con 0x7f04301001a0 2023-12-14T18:18:35.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.076+0000 7f042effd700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0418038870 0x7f041803ad20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f0424006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:35.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.081+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0420027070 con 0x7f04301001a0 2023-12-14T18:18:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.277+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f0430062120 con 0x7f04301001a0 2023-12-14T18:18:35.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.280+0000 7f042cff9700 1 -- 172.21.15.69:0/4251328385 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f042002c440 con 0x7f04301001a0 2023-12-14T18:18:35.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0418038870 msgr2=0x7f041803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:35.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0418038870 0x7f041803ad20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f0424006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:35.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 msgr2=0x7f04300fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:35.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 0x7f04300fe830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0420006010 tx=0x7f0420005810 comp rx=0 tx=0).stop 2023-12-14T18:18:35.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 shutdown_connections 2023-12-14T18:18:35.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0418038870 0x7f041803ad20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:35.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 --2- 172.21.15.69:0/4251328385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04301001a0 0x7f04300fe830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:35.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 >> 172.21.15.69:0/4251328385 conn(0x7f04300fa240 msgr2=0x7f04300faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:35.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.282+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 shutdown_connections 2023-12-14T18:18:35.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:35.283+0000 7f0436231700 1 -- 172.21.15.69:0/4251328385 wait complete. 2023-12-14T18:18:35.827 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-14T18:18:35.828 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-14T18:18:36.133 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4251328385' entity='client.admin' 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi069", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:36.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 -- 172.21.15.69:0/3401618542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 msgr2=0x7f12a4100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 --2- 172.21.15.69:0/3401618542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4100130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1294009910 tx=0x7f1294009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 -- 172.21.15.69:0/3401618542 shutdown_connections 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 --2- 172.21.15.69:0/3401618542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4100130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 -- 172.21.15.69:0/3401618542 >> 172.21.15.69:0/3401618542 conn(0x7f12a40fb2d0 msgr2=0x7f12a40fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 -- 172.21.15.69:0/3401618542 shutdown_connections 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.081+0000 7f12aa73a700 1 -- 172.21.15.69:0/3401618542 wait complete. 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12aa73a700 1 Processor -- start 2023-12-14T18:18:37.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12aa73a700 1 -- start start 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12aa73a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12aa73a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4074dd0 con 0x7f12a40ffd20 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4074890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59562/0 (socket says 172.21.15.69:59562) 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12a3fff700 1 -- 172.21.15.69:0/2840742941 learned_addr learned my addr 172.21.15.69:0/2840742941 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.082+0000 7f12a3fff700 1 -- 172.21.15.69:0/2840742941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940095f0 con 0x7f12a40ffd20 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.083+0000 7f12a3fff700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4074890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1294006010 tx=0x7f1294005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.083+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f129400ba90 con 0x7f12a40ffd20 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.083+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f129400bbf0 con 0x7f12a40ffd20 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.083+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a4105aa0 con 0x7f12a40ffd20 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.083+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1294017440 con 0x7f12a40ffd20 2023-12-14T18:18:37.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.083+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a4105910 con 0x7f12a40ffd20 2023-12-14T18:18:37.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.084+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a4062120 con 0x7f12a40ffd20 2023-12-14T18:18:37.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.084+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f129400bd60 con 0x7f12a40ffd20 2023-12-14T18:18:37.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.084+0000 7f12a17fa700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1290038870 0x7f129003ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:37.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.084+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f129404c970 con 0x7f12a40ffd20 2023-12-14T18:18:37.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.084+0000 7f12a37fe700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1290038870 0x7f129003ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:37.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.085+0000 7f12a37fe700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1290038870 0x7f129003ad20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f128c006fd0 tx=0x7f128c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:37.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.089+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f129402a7d0 con 0x7f12a40ffd20 2023-12-14T18:18:37.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.282+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a40732a0 con 0x7f1290038870 2023-12-14T18:18:37.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.286+0000 7f12a17fa700 1 -- 172.21.15.69:0/2840742941 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f12a40732a0 con 0x7f1290038870 2023-12-14T18:18:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1290038870 msgr2=0x7f129003ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:37.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1290038870 0x7f129003ad20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f128c006fd0 tx=0x7f128c006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 msgr2=0x7f12a4074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4074890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1294006010 tx=0x7f1294005810 comp rx=0 tx=0).stop 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 shutdown_connections 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1290038870 0x7f129003ad20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 --2- 172.21.15.69:0/2840742941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a40ffd20 0x7f12a4074890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 >> 172.21.15.69:0/2840742941 conn(0x7f12a40fb2d0 msgr2=0x7f12a40fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 shutdown_connections 2023-12-14T18:18:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:37.288+0000 7f12aa73a700 1 -- 172.21.15.69:0/2840742941 wait complete. 2023-12-14T18:18:37.668 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi091 2023-12-14T18:18:37.668 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:18:37.668 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/etc/ceph/ceph.conf 2023-12-14T18:18:37.688 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:18:37.689 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:18:37.748 INFO:tasks.cephadm:Adding host smithi091 to orchestrator... 2023-12-14T18:18:37.748 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch host add smithi091 2023-12-14T18:18:38.077 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:38.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:38.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:38.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:38.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: Updating smithi069:/etc/ceph/ceph.conf 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: Updating smithi069:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:38.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 -- 172.21.15.69:0/843508627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 msgr2=0x7fa564101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 --2- 172.21.15.69:0/843508627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564101200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa554009910 tx=0x7fa554009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 -- 172.21.15.69:0/843508627 shutdown_connections 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 --2- 172.21.15.69:0/843508627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564101200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 -- 172.21.15.69:0/843508627 >> 172.21.15.69:0/843508627 conn(0x7fa564074930 msgr2=0x7fa564074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 -- 172.21.15.69:0/843508627 shutdown_connections 2023-12-14T18:18:39.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.054+0000 7fa56ac84700 1 -- 172.21.15.69:0/843508627 wait complete. 2023-12-14T18:18:39.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa56ac84700 1 Processor -- start 2023-12-14T18:18:39.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa56ac84700 1 -- start start 2023-12-14T18:18:39.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa56ac84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa56ac84700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa564197850 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa568a20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa568a20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59584/0 (socket says 172.21.15.69:59584) 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa568a20700 1 -- 172.21.15.69:0/2792052152 learned_addr learned my addr 172.21.15.69:0/2792052152 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa568a20700 1 -- 172.21.15.69:0/2792052152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540095f0 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa568a20700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564197310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa554004e90 tx=0x7fa554004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.055+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55401d070 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.056+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5540044b0 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.056+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56410a050 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.056+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540038f0 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.056+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa564109ec0 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.056+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fa554003b70 con 0x7fa564100e30 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.057+0000 7fa561ffb700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa54c038870 0x7fa54c03ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:39.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.057+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa55404c860 con 0x7fa564100e30 2023-12-14T18:18:39.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.057+0000 7fa563fff700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa54c038870 0x7fa54c03ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:39.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.057+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56410a1e0 con 0x7fa564100e30 2023-12-14T18:18:39.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.057+0000 7fa563fff700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa54c038870 0x7fa54c03ad20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa558006fd0 tx=0x7fa558006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:39.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.062+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa55400f460 con 0x7fa564100e30 2023-12-14T18:18:39.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:39.255+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi091", "target": ["mon-mgr", ""]}) v1 -- 0x7fa564197d90 con 0x7fa54c038870 2023-12-14T18:18:39.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:39 smithi069 ceph-mon[42047]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:18:39.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:39 smithi069 ceph-mon[42047]: Updating smithi069:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T18:18:40.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:40 smithi069 ceph-mon[42047]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi091", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:41.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.260+0000 7fa561ffb700 1 -- 172.21.15.69:0/2792052152 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa564197d90 con 0x7fa54c038870 2023-12-14T18:18:41.261 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi091' with addr '172.21.15.91' 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa54c038870 msgr2=0x7fa54c03ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa54c038870 0x7fa54c03ad20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa558006fd0 tx=0x7fa558006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 msgr2=0x7fa564197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564197310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa554004e90 tx=0x7fa554004f70 comp rx=0 tx=0).stop 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 shutdown_connections 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa54c038870 0x7fa54c03ad20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 --2- 172.21.15.69:0/2792052152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa564100e30 0x7fa564197310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:41.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 >> 172.21.15.69:0/2792052152 conn(0x7fa564074930 msgr2=0x7fa564106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 shutdown_connections 2023-12-14T18:18:41.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:41.262+0000 7fa56ac84700 1 -- 172.21.15.69:0/2792052152 wait complete. 2023-12-14T18:18:41.547 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:41 smithi069 ceph-mon[42047]: Deploying cephadm binary to smithi091 2023-12-14T18:18:41.547 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:41 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:41.547 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:41 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:41.624 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-14T18:18:41.929 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:42.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:42 smithi069 ceph-mon[42047]: Added host smithi091 2023-12-14T18:18:42.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:42 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:42.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:42 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 -- 172.21.15.69:0/2549989677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 msgr2=0x7f718c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 --2- 172.21.15.69:0/2549989677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0ff140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f717c009910 tx=0x7f717c009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 -- 172.21.15.69:0/2549989677 shutdown_connections 2023-12-14T18:18:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 --2- 172.21.15.69:0/2549989677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0ff140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 -- 172.21.15.69:0/2549989677 >> 172.21.15.69:0/2549989677 conn(0x7f718c074350 msgr2=0x7f718c074750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:42.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 -- 172.21.15.69:0/2549989677 shutdown_connections 2023-12-14T18:18:42.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.939+0000 7f7191074700 1 -- 172.21.15.69:0/2549989677 wait complete. 2023-12-14T18:18:42.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f7191074700 1 Processor -- start 2023-12-14T18:18:42.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f7191074700 1 -- start start 2023-12-14T18:18:42.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f7191074700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:42.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f7191074700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c101f20 con 0x7f718c0fed70 2023-12-14T18:18:42.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f718ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:42.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f718ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59600/0 (socket says 172.21.15.69:59600) 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.940+0000 7f718ad9d700 1 -- 172.21.15.69:0/1943728693 learned_addr learned my addr 172.21.15.69:0/1943728693 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f718ad9d700 1 -- 172.21.15.69:0/1943728693 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0095f0 con 0x7f718c0fed70 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f718ad9d700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0fff50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f717c004f40 tx=0x7f717c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f717c01d070 con 0x7f718c0fed70 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f717c0044b0 con 0x7f718c0fed70 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f717c003860 con 0x7f718c0fed70 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c10a1c0 con 0x7f718c0fed70 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.941+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c10a030 con 0x7f718c0fed70 2023-12-14T18:18:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.942+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f717c003a90 con 0x7f718c0fed70 2023-12-14T18:18:42.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.942+0000 7f7183fff700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71780388c0 0x7f717803ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:42.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.942+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c10a350 con 0x7f718c0fed70 2023-12-14T18:18:42.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.942+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f717c04c670 con 0x7f718c0fed70 2023-12-14T18:18:42.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.942+0000 7f718a59c700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71780388c0 0x7f717803ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:42.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.942+0000 7f718a59c700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71780388c0 0x7f717803ad70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7174006fd0 tx=0x7f7174006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:42.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:42.947+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f717c02a770 con 0x7f718c0fed70 2023-12-14T18:18:43.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.140+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f718c062190 con 0x7f71780388c0 2023-12-14T18:18:43.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.141+0000 7f7183fff700 1 -- 172.21.15.69:0/1943728693 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f718c062190 con 0x7f71780388c0 2023-12-14T18:18:43.142 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:43.142 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.91", "hostname": "smithi091", "labels": [], "status": ""}] 2023-12-14T18:18:43.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71780388c0 msgr2=0x7f717803ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:43.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71780388c0 0x7f717803ad70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7174006fd0 tx=0x7f7174006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:43.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 msgr2=0x7f718c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:43.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0fff50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f717c004f40 tx=0x7f717c005020 comp rx=0 tx=0).stop 2023-12-14T18:18:43.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 shutdown_connections 2023-12-14T18:18:43.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71780388c0 0x7f717803ad70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:43.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 --2- 172.21.15.69:0/1943728693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f718c0fed70 0x7f718c0fff50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:43.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.143+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 >> 172.21.15.69:0/1943728693 conn(0x7f718c074350 msgr2=0x7f718c104930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:43.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.144+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 shutdown_connections 2023-12-14T18:18:43.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:43.144+0000 7f7191074700 1 -- 172.21.15.69:0/1943728693 wait complete. 2023-12-14T18:18:43.515 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2023-12-14T18:18:43.515 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:18:43.515 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2023-12-14T18:18:43.536 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:18:43.536 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:18:43.596 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2023-12-14T18:18:43.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch host add smithi119 2023-12-14T18:18:43.903 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:44.142 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:44.142 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:43 smithi069 ceph-mon[42047]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 -- 172.21.15.69:0/3464041609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 msgr2=0x7f95240ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 --2- 172.21.15.69:0/3464041609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f95240ff2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9520009910 tx=0x7f9520009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 -- 172.21.15.69:0/3464041609 shutdown_connections 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 --2- 172.21.15.69:0/3464041609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f95240ff2d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 -- 172.21.15.69:0/3464041609 >> 172.21.15.69:0/3464041609 conn(0x7f9524074930 msgr2=0x7f9524074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 -- 172.21.15.69:0/3464041609 shutdown_connections 2023-12-14T18:18:44.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 -- 172.21.15.69:0/3464041609 wait complete. 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 Processor -- start 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.944+0000 7f952b422700 1 -- start start 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f952b422700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f9524195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f952b422700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95241963e0 con 0x7f95240fef00 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f95291be700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f9524195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f95291be700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f9524195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59616/0 (socket says 172.21.15.69:59616) 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f95291be700 1 -- 172.21.15.69:0/1715045618 learned_addr learned my addr 172.21.15.69:0/1715045618 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f95291be700 1 -- 172.21.15.69:0/1715045618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95200095f0 con 0x7f95240fef00 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f95291be700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f9524195ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9520006010 tx=0x7f9520004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f952001d070 con 0x7f95240fef00 2023-12-14T18:18:44.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f952000bdf0 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9520022d80 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9524108f40 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.945+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9524108db0 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.946+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f952000f460 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.946+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95241090d0 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.947+0000 7f951a7fc700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f95100388c0 0x7f951003ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.947+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f952004c960 con 0x7f95240fef00 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.947+0000 7f95289bd700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f95100388c0 0x7f951003ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.947+0000 7f95289bd700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f95100388c0 0x7f951003ad70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9514006fd0 tx=0x7f9514006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:44.951+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9520020370 con 0x7f95240fef00 2023-12-14T18:18:45.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:45.153+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}) v1 -- 0x7f95240683b0 con 0x7f95100388c0 2023-12-14T18:18:46.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi091", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: Updating smithi091:/etc/ceph/ceph.conf 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: Updating smithi091:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-14T18:18:46.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: Updating smithi091:/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:18:46.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: Updating smithi091:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T18:18:46.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: Deploying cephadm binary to smithi119 2023-12-14T18:18:46.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:46.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:46.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:47.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.050+0000 7f951a7fc700 1 -- 172.21.15.69:0/1715045618 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f95240683b0 con 0x7f95100388c0 2023-12-14T18:18:47.051 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi119' with addr '172.21.15.119' 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f95100388c0 msgr2=0x7f951003ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f95100388c0 0x7f951003ad70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9514006fd0 tx=0x7f9514006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 msgr2=0x7f9524195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f9524195ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9520006010 tx=0x7f9520004ff0 comp rx=0 tx=0).stop 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 shutdown_connections 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f95100388c0 0x7f951003ad70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 --2- 172.21.15.69:0/1715045618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95240fef00 0x7f9524195ea0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 >> 172.21.15.69:0/1715045618 conn(0x7f9524074930 msgr2=0x7f9524103090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 shutdown_connections 2023-12-14T18:18:47.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:47.052+0000 7f952b422700 1 -- 172.21.15.69:0/1715045618 wait complete. 2023-12-14T18:18:47.437 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:47 smithi069 ceph-mon[42047]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:18:47.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:47.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:47.439 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-14T18:18:47.745 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:48.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 -- 172.21.15.69:0/2836483305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 msgr2=0x7fe7f80ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:48.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 --2- 172.21.15.69:0/2836483305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f80ff2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009910 tx=0x7fe7ec009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:48.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 -- 172.21.15.69:0/2836483305 shutdown_connections 2023-12-14T18:18:48.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 --2- 172.21.15.69:0/2836483305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f80ff2d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 -- 172.21.15.69:0/2836483305 >> 172.21.15.69:0/2836483305 conn(0x7fe7f8074930 msgr2=0x7fe7f8074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 -- 172.21.15.69:0/2836483305 shutdown_connections 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 -- 172.21.15.69:0/2836483305 wait complete. 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 Processor -- start 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.659+0000 7fe7fe36f700 1 -- start start 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7fe36f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f81950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:48.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7fe36f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81955f0 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f81950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f81950b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33786/0 (socket says 172.21.15.69:33786) 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f7fff700 1 -- 172.21.15.69:0/614438996 learned_addr learned my addr 172.21.15.69:0/614438996 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f7fff700 1 -- 172.21.15.69:0/614438996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0095f0 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f7fff700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f81950b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec004f40 tx=0x7fe7ec005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec01d070 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7ec0044b0 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.660+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec003860 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.661+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f8108f40 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.661+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f8108db0 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.661+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fe7ec003a90 con 0x7fe7f80fef00 2023-12-14T18:18:48.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.661+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f81090d0 con 0x7fe7f80fef00 2023-12-14T18:18:48.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.662+0000 7fe7f57fa700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe7e00388c0 0x7fe7e003ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:48.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.662+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe7ec04c890 con 0x7fe7f80fef00 2023-12-14T18:18:48.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.662+0000 7fe7f77fe700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe7e00388c0 0x7fe7e003ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:48.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.662+0000 7fe7f77fe700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe7e00388c0 0x7fe7e003ad70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006fd0 tx=0x7fe7e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:48.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.666+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe7ec022990 con 0x7fe7f80fef00 2023-12-14T18:18:48.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.862+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7f8195bd0 con 0x7fe7e00388c0 2023-12-14T18:18:48.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.863+0000 7fe7f57fa700 1 -- 172.21.15.69:0/614438996 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fe7f8195bd0 con 0x7fe7e00388c0 2023-12-14T18:18:48.865 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:18:48.865 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.91", "hostname": "smithi091", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe7e00388c0 msgr2=0x7fe7e003ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe7e00388c0 0x7fe7e003ad70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006fd0 tx=0x7fe7e8006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 msgr2=0x7fe7f81950b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f81950b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec004f40 tx=0x7fe7ec005020 comp rx=0 tx=0).stop 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 shutdown_connections 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe7e00388c0 0x7fe7e003ad70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 --2- 172.21.15.69:0/614438996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7f80fef00 0x7fe7f81950b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 >> 172.21.15.69:0/614438996 conn(0x7fe7f8074930 msgr2=0x7fe7f8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:48.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 shutdown_connections 2023-12-14T18:18:48.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:48.865+0000 7fe7fe36f700 1 -- 172.21.15.69:0/614438996 wait complete. 2023-12-14T18:18:48.890 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:48 smithi069 ceph-mon[42047]: Added host smithi119 2023-12-14T18:18:48.890 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:48 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:48.890 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:48 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:49.390 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-14T18:18:49.390 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-14T18:18:49.697 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:18:49.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:49 smithi069 ceph-mon[42047]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:18:49.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:49 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 -- 172.21.15.69:0/1049519811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 msgr2=0x7f50d00ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 --2- 172.21.15.69:0/1049519811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d00ff260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009910 tx=0x7f50c0009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 -- 172.21.15.69:0/1049519811 shutdown_connections 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 --2- 172.21.15.69:0/1049519811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d00ff260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 -- 172.21.15.69:0/1049519811 >> 172.21.15.69:0/1049519811 conn(0x7f50d00fa750 msgr2=0x7f50d00fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 -- 172.21.15.69:0/1049519811 shutdown_connections 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.593+0000 7f50d7286700 1 -- 172.21.15.69:0/1049519811 wait complete. 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d7286700 1 Processor -- start 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d7286700 1 -- start start 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d7286700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d0195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d7286700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d01956b0 con 0x7f50d00fee90 2023-12-14T18:18:50.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d5022700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d0195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d5022700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d0195170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33814/0 (socket says 172.21.15.69:33814) 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d5022700 1 -- 172.21.15.69:0/3498394392 learned_addr learned my addr 172.21.15.69:0/3498394392 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.594+0000 7f50d5022700 1 -- 172.21.15.69:0/3498394392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00095f0 con 0x7f50d00fee90 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50d5022700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d0195170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50c0004f40 tx=0x7f50c0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50c001d070 con 0x7f50d00fee90 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50c00044b0 con 0x7f50d00fee90 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d0108f20 con 0x7f50d00fee90 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50c0003860 con 0x7f50d00fee90 2023-12-14T18:18:50.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d0108d90 con 0x7f50d00fee90 2023-12-14T18:18:50.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.595+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f50c0003ae0 con 0x7f50d00fee90 2023-12-14T18:18:50.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.596+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d01090b0 con 0x7f50d00fee90 2023-12-14T18:18:50.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.596+0000 7f50c67fc700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f50bc038870 0x7f50bc03ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:50.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.596+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f50c004cbd0 con 0x7f50d00fee90 2023-12-14T18:18:50.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.596+0000 7f50d4821700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f50bc038870 0x7f50bc03ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:50.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.596+0000 7f50d4821700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f50bc038870 0x7f50bc03ad20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f50cc006fd0 tx=0x7f50cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:50.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.600+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f50c002a540 con 0x7f50d00fee90 2023-12-14T18:18:50.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:50 smithi069 ceph-mon[42047]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:18:50.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:50.800+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f50d0195bf0 con 0x7f50d00fee90 2023-12-14T18:18:51.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.698+0000 7f50c67fc700 1 -- 172.21.15.69:0/3498394392 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f50c000e3e0 con 0x7f50d00fee90 2023-12-14T18:18:51.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f50bc038870 msgr2=0x7f50bc03ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:51.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f50bc038870 0x7f50bc03ad20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f50cc006fd0 tx=0x7f50cc006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:51.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 msgr2=0x7f50d0195170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:51.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d0195170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50c0004f40 tx=0x7f50c0005020 comp rx=0 tx=0).stop 2023-12-14T18:18:51.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 shutdown_connections 2023-12-14T18:18:51.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f50bc038870 0x7f50bc03ad20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:51.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 --2- 172.21.15.69:0/3498394392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50d00fee90 0x7f50d0195170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:51.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 >> 172.21.15.69:0/3498394392 conn(0x7f50d00fa750 msgr2=0x7f50d0068720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:51.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 shutdown_connections 2023-12-14T18:18:51.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:18:51.700+0000 7f50d7286700 1 -- 172.21.15.69:0/3498394392 wait complete. 2023-12-14T18:18:51.702 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:18:51.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:51 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3498394392' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-14T18:18:52.071 INFO:tasks.cephadm:Adding mon.a on smithi069 2023-12-14T18:18:52.071 INFO:tasks.cephadm:Adding mon.b on smithi091 2023-12-14T18:18:52.071 INFO:tasks.cephadm:Adding mon.c on smithi119 2023-12-14T18:18:52.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch apply mon '3;smithi069:172.21.15.69=a;smithi091:172.21.15.91=b;smithi119:172.21.15.119=c' 2023-12-14T18:18:52.394 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-14T18:18:52.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:18:52.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-14T18:18:52.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: Updating smithi119:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-14T18:18:52.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:18:52.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: Updating smithi119:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-14T18:18:52.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:52.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:52.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:52.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3498394392' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-14T18:18:52.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:52 smithi069 ceph-mon[42047]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:18:53.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2477720864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 msgr2=0x7f17c4100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:53.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 --2- 172.21.15.119:0/2477720864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c4100360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009910 tx=0x7f17b4009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2477720864 shutdown_connections 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 --2- 172.21.15.119:0/2477720864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c4100360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2477720864 >> 172.21.15.119:0/2477720864 conn(0x7f17c40fb870 msgr2=0x7f17c40fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2477720864 shutdown_connections 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2477720864 wait complete. 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 Processor -- start 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- start start 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c41950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.383+0000 7f17cbd1a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4195610 con 0x7f17c40fff90 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17c9ab6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c41950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17c9ab6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c41950d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.119:42418/0 (socket says 172.21.15.119:42418) 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17c9ab6700 1 -- 172.21.15.119:0/2568439595 learned_addr learned my addr 172.21.15.119:0/2568439595 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:18:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17c9ab6700 1 -- 172.21.15.119:0/2568439595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40095f0 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17c9ab6700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c41950d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17b4004f40 tx=0x7f17b4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17b401d070 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b40044b0 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c410a020 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17b4003860 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.384+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c4109e90 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.385+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f17b400b960 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.385+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c410a1b0 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.386+0000 7f17baffd700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f17b0038870 0x7f17b003ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.386+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f17b404c670 con 0x7f17c40fff90 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.386+0000 7f17c92b5700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f17b0038870 0x7f17b003ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.386+0000 7f17c92b5700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f17b0038870 0x7f17b003ad20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006fd0 tx=0x7f17c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:53.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.391+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f17b402a540 con 0x7f17c40fff90 2023-12-14T18:18:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.584+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi091:172.21.15.91=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f17c4108190 con 0x7f17b0038870 2023-12-14T18:18:53.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.591+0000 7f17baffd700 1 -- 172.21.15.119:0/2568439595 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f17c4108190 con 0x7f17b0038870 2023-12-14T18:18:53.591 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mon update... 2023-12-14T18:18:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f17b0038870 msgr2=0x7f17b003ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f17b0038870 0x7f17b003ad20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006fd0 tx=0x7f17c0006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 msgr2=0x7f17c41950d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c41950d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17b4004f40 tx=0x7f17b4005020 comp rx=0 tx=0).stop 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 shutdown_connections 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f17b0038870 0x7f17b003ad20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 --2- 172.21.15.119:0/2568439595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17c40fff90 0x7f17c41950d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.592+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 >> 172.21.15.119:0/2568439595 conn(0x7f17c40fb870 msgr2=0x7f17c4104170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.593+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 shutdown_connections 2023-12-14T18:18:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:53.593+0000 7f17cbd1a700 1 -- 172.21.15.119:0/2568439595 wait complete. 2023-12-14T18:18:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:53 smithi069 ceph-mon[42047]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:18:53.974 DEBUG:teuthology.orchestra.run.smithi091:mon.b> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.b.service 2023-12-14T18:18:53.977 DEBUG:teuthology.orchestra.run.smithi119:mon.c> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.c.service 2023-12-14T18:18:53.979 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-14T18:18:53.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-14T18:18:54.007 INFO:journalctl@ceph.mon.c.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:18:54.012 INFO:journalctl@ceph.mon.b.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:18:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-14T18:18:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi091:172.21.15.91=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:18:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi091:172.21.15.91=b;smithi119:172.21.15.119=c;count:3 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:18:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:54 smithi069 ceph-mon[42047]: Deploying daemon mon.c on smithi119 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- 172.21.15.119:0/1428427189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 msgr2=0x7fe9b8100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 --2- 172.21.15.119:0/1428427189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8100250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009910 tx=0x7fe9a8009c20 comp rx=0 tx=0).stop 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- 172.21.15.119:0/1428427189 shutdown_connections 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 --2- 172.21.15.119:0/1428427189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8100250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- 172.21.15.119:0/1428427189 >> 172.21.15.119:0/1428427189 conn(0x7fe9b8074350 msgr2=0x7fe9b8074750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- 172.21.15.119:0/1428427189 shutdown_connections 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- 172.21.15.119:0/1428427189 wait complete. 2023-12-14T18:18:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 Processor -- start 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- start start 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.474+0000 7fe9c03a7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8196590 con 0x7fe9b80ffe80 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9be143700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9be143700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.119:42442/0 (socket says 172.21.15.119:42442) 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9be143700 1 -- 172.21.15.119:0/3432675333 learned_addr learned my addr 172.21.15.119:0/3432675333 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9be143700 1 -- 172.21.15.119:0/3432675333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80095f0 con 0x7fe9b80ffe80 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9be143700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8196050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8006010 tx=0x7fe9a8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9a801d070 con 0x7fe9b80ffe80 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b8109050 con 0x7fe9b80ffe80 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9a800bdf0 con 0x7fe9b80ffe80 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9a8022d80 con 0x7fe9b80ffe80 2023-12-14T18:18:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.475+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b8108ec0 con 0x7fe9b80ffe80 2023-12-14T18:18:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.476+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fe9a8022570 con 0x7fe9b80ffe80 2023-12-14T18:18:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.476+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b81091e0 con 0x7fe9b80ffe80 2023-12-14T18:18:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.476+0000 7fe9af7fe700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe9a4038870 0x7fe9a403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:18:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.476+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe9a804c8c0 con 0x7fe9b80ffe80 2023-12-14T18:18:55.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.477+0000 7fe9bd942700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe9a4038870 0x7fe9a403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:18:55.479 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.477+0000 7fe9bd942700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe9a4038870 0x7fe9a403ad20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4006fd0 tx=0x7fe9b4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:18:55.482 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.482+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe9a802bba0 con 0x7fe9b80ffe80 2023-12-14T18:18:55.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.766+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe9b8062150 con 0x7fe9b80ffe80 2023-12-14T18:18:55.768 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.767+0000 7fe9af7fe700 1 -- 172.21.15.119:0/3432675333 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fe9a8027030 con 0x7fe9b80ffe80 2023-12-14T18:18:55.768 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:18:55.768 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","modified":"2023-12-14T18:17:38.277255Z","created":"2023-12-14T18:17:38.277255Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe9a4038870 msgr2=0x7fe9a403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe9a4038870 0x7fe9a403ad20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4006fd0 tx=0x7fe9b4006e40 comp rx=0 tx=0).stop 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 msgr2=0x7fe9b8196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8196050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8006010 tx=0x7fe9a8004ff0 comp rx=0 tx=0).stop 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 shutdown_connections 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe9a4038870 0x7fe9a403ad20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 --2- 172.21.15.119:0/3432675333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9b80ffe80 0x7fe9b8196050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 >> 172.21.15.119:0/3432675333 conn(0x7fe9b8074350 msgr2=0x7fe9b8103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 shutdown_connections 2023-12-14T18:18:55.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:18:55.769+0000 7fe9c03a7700 1 -- 172.21.15.119:0/3432675333 wait complete. 2023-12-14T18:18:55.771 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-14T18:18:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:55 smithi069 ceph-mon[42047]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:18:56.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:18:56 smithi119 bash[43935]: e1c3bec13f48fad2cb21e4858591ac07a3ba2e1e2c2e0455954626a8f3898b6a 2023-12-14T18:18:56.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:18:56 smithi119 systemd[1]: Started Ceph mon.c for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:18:56.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:18:56 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/3432675333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T18:18:57.158 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-14T18:18:57.158 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-14T18:18:57.465 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 -- 172.21.15.119:0/3682919243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 msgr2=0x7fb0e8005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 --2- 172.21.15.119:0/3682919243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0e8005a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0ffd80 tx=0x7fb0e4013e90 comp rx=0 tx=0).stop 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 -- 172.21.15.119:0/3682919243 shutdown_connections 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 --2- 172.21.15.119:0/3682919243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0e8005a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 -- 172.21.15.119:0/3682919243 >> 172.21.15.119:0/3682919243 conn(0x7fb0fc0fb950 msgr2=0x7fb0fc0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 -- 172.21.15.119:0/3682919243 shutdown_connections 2023-12-14T18:19:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.722+0000 7fb101ea6700 1 -- 172.21.15.119:0/3682919243 wait complete. 2023-12-14T18:19:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.723+0000 7fb101ea6700 1 Processor -- start 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb101ea6700 1 -- start start 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb101ea6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0fc195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb101ea6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb101ea6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc195d10 con 0x7fb0e80035c0 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb101ea6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc195e80 con 0x7fb0fc195790 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50142/0 (socket says 172.21.15.119:50142) 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 -- 172.21.15.119:0/2536074573 learned_addr learned my addr 172.21.15.119:0/2536074573 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0fb7fe700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0fc195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 -- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 msgr2=0x7fb0fc199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 -- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 msgr2=0x7fb0fc199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T18:19:01.726 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T18:19:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.724+0000 7fb0faffd700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:19:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.725+0000 7fb0fb7fe700 1 -- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 msgr2=0x7fb0fc199c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:19:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.725+0000 7fb0fb7fe700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.725+0000 7fb0fb7fe700 1 -- 172.21.15.119:0/2536074573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40138e0 con 0x7fb0e80035c0 2023-12-14T18:19:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.725+0000 7fb0fb7fe700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0fc195250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401c000 tx=0x7fb0e400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.726+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb0e4018070 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.726+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0e40046d0 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.726+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc107b50 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.726+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb0e4003b70 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.726+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc1079c0 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.727+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fb0e4003cd0 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.727+0000 7fb0f8ff9700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb0dc0386b0 0x7fb0dc03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.727+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb0e4005530 con 0x7fb0e80035c0 2023-12-14T18:19:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.727+0000 7fb0faffd700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb0dc0386b0 0x7fb0dc03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:01.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.727+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc107ce0 con 0x7fb0e80035c0 2023-12-14T18:19:01.729 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.728+0000 7fb0faffd700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb0dc0386b0 0x7fb0dc03ab60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009180 tx=0x7fb0ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.733+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb0e4025400 con 0x7fb0e80035c0 2023-12-14T18:19:01.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.997+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb0fc196680 con 0x7fb0e80035c0 2023-12-14T18:19:01.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:01.998+0000 7fb0f8ff9700 1 -- 172.21.15.119:0/2536074573 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7fb0e404c020 con 0x7fb0e80035c0 2023-12-14T18:19:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:19:01.999 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","modified":"2023-12-14T18:18:56.627219Z","created":"2023-12-14T18:17:38.277255Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb0dc0386b0 msgr2=0x7fb0dc03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb0dc0386b0 0x7fb0dc03ab60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009180 tx=0x7fb0ec008040 comp rx=0 tx=0).stop 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 msgr2=0x7fb0fc195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0fc195250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401c000 tx=0x7fb0e400ff90 comp rx=0 tx=0).stop 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 shutdown_connections 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb0dc0386b0 0x7fb0dc03ab60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0e80035c0 0x7fb0fc195250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 --2- 172.21.15.119:0/2536074573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc195790 0x7fb0fc199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 >> 172.21.15.119:0/2536074573 conn(0x7fb0fc0fb950 msgr2=0x7fb0fc18e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 shutdown_connections 2023-12-14T18:19:02.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:02.000+0000 7fb101ea6700 1 -- 172.21.15.119:0/2536074573 wait complete. 2023-12-14T18:19:02.002 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: mon.a calling monitor election 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: mon.c calling monitor election 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.023 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: monmap e2: 2 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: fsmap 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: mgrmap e13: x(active, since 35s) 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: overall HEALTH_OK 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:02.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:02.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: mon.a calling monitor election 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: mon.c calling monitor election 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T18:19:02.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: monmap e2: 2 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: fsmap 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: mgrmap e13: x(active, since 35s) 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: overall HEALTH_OK 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:02.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:03.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:02 smithi119 ceph-mon[43973]: Deploying daemon mon.b on smithi091 2023-12-14T18:19:03.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:02 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/2536074573' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T18:19:03.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:02 smithi119 ceph-mon[43973]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:03.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:02 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:03.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:02 smithi069 ceph-mon[42047]: Deploying daemon mon.b on smithi091 2023-12-14T18:19:03.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:02 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/2536074573' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-14T18:19:03.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:02 smithi069 ceph-mon[42047]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:03.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:02 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:03.383 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-14T18:19:03.383 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-14T18:19:03.696 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:19:03.958 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:19:03 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:19:03.626+0000 7f9c500c1700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-14T18:19:04.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:04 smithi091 ceph-mon[43601]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-12-14T18:19:04.778 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:04 smithi091 systemd[1]: Started Ceph mon.b for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: mon.a calling monitor election 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: mon.c calling monitor election 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: fsmap 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: mgrmap e13: x(active, since 43s) 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: mon.b (rank 2) addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] is down (out of quorum) 2023-12-14T18:19:09.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:09.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:19:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: mon.a calling monitor election 2023-12-14T18:19:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: mon.c calling monitor election 2023-12-14T18:19:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: fsmap 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: mgrmap e13: x(active, since 43s) 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-14T18:19:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-14T18:19:09.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: mon.b (rank 2) addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] is down (out of quorum) 2023-12-14T18:19:09.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:09.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.580 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.577+0000 7fad77c8b700 1 -- 172.21.15.119:0/1809597714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 msgr2=0x7fad5c008690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.577+0000 7fad77c8b700 1 --2- 172.21.15.119:0/1809597714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad5c008690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fad700ff530 tx=0x7fad6000fe90 comp rx=0 tx=0).stop 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.577+0000 7fad77c8b700 1 -- 172.21.15.119:0/1809597714 shutdown_connections 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.577+0000 7fad77c8b700 1 --2- 172.21.15.119:0/1809597714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad5c008690 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.577+0000 7fad77c8b700 1 -- 172.21.15.119:0/1809597714 >> 172.21.15.119:0/1809597714 conn(0x7fad700742a0 msgr2=0x7fad700746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 -- 172.21.15.119:0/1809597714 shutdown_connections 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 -- 172.21.15.119:0/1809597714 wait complete. 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 Processor -- start 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 -- start start 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad70195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 0x7fad70199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70196060 con 0x7fad5c006230 2023-12-14T18:19:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701a20b0 con 0x7fad70195990 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.578+0000 7fad77c8b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701a21f0 con 0x7fad7019a340 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad70195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad76228700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad70195450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.119:48786/0 (socket says 172.21.15.119:48786) 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 -- 172.21.15.119:0/2045132394 learned_addr learned my addr 172.21.15.119:0/2045132394 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad76228700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40802/0 (socket says 172.21.15.119:40802) 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75226700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 0x7fad70199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad76228700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 msgr2=0x7fad7019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad76228700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 msgr2=0x7fad7019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad76228700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad76228700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75226700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 msgr2=0x7fad70199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75226700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 msgr2=0x7fad70199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-14T18:19:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75226700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 0x7fad70199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75226700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 0x7fad70199e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 msgr2=0x7fad7019a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 msgr2=0x7fad70199e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 0x7fad70199e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 -- 172.21.15.119:0/2045132394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6000f8e0 con 0x7fad5c006230 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad75a27700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad70195450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad6001da60 tx=0x7fad60005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60005460 con 0x7fad5c006230 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad60011440 con 0x7fad5c006230 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad70107c50 con 0x7fad5c006230 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60011960 con 0x7fad5c006230 2023-12-14T18:19:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.579+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad70107ac0 con 0x7fad5c006230 2023-12-14T18:19:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.580+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fad60011ac0 con 0x7fad5c006230 2023-12-14T18:19:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.580+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70107de0 con 0x7fad5c006230 2023-12-14T18:19:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.581+0000 7fad66ffd700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad54038cf0 0x7fad5403b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.581+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fad6004e8a0 con 0x7fad5c006230 2023-12-14T18:19:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.581+0000 7fad75226700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad54038cf0 0x7fad5403b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:10.584 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.581+0000 7fad75226700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad54038cf0 0x7fad5403b1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009850 tx=0x7fad6c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.586+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fad60038d90 con 0x7fad5c006230 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:10.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:10.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.879+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fad7018f870 con 0x7fad5c006230 2023-12-14T18:19:10.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.880+0000 7fad66ffd700 1 -- 172.21.15.119:0/2045132394 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7fad60038350 con 0x7fad5c006230 2023-12-14T18:19:10.880 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-14T18:19:10.881 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","modified":"2023-12-14T18:19:04.291066Z","created":"2023-12-14T18:17:38.277255Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:3300","nonce":0},{"type":"v1","addr":"172.21.15.91:6789","nonce":0}]},"addr":"172.21.15.91:6789/0","public_addr":"172.21.15.91:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-14T18:19:10.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad54038cf0 msgr2=0x7fad5403b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:10.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad54038cf0 0x7fad5403b1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009850 tx=0x7fad6c008040 comp rx=0 tx=0).stop 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 msgr2=0x7fad70195450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad70195450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad6001da60 tx=0x7fad60005be0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 shutdown_connections 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad54038cf0 0x7fad5403b1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7019a340 0x7fad7019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5c006230 0x7fad70195450 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 --2- 172.21.15.119:0/2045132394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad70195990 0x7fad70199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 >> 172.21.15.119:0/2045132394 conn(0x7fad700742a0 msgr2=0x7fad700fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 shutdown_connections 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:10.882+0000 7fad77c8b700 1 -- 172.21.15.119:0/2045132394 wait complete. 2023-12-14T18:19:10.883 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 3 2023-12-14T18:19:11.249 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-14T18:19:11.250 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-14T18:19:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: mon.a calling monitor election 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: mon.c calling monitor election 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: fsmap 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: mgrmap e13: x(active, since 43s) 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: mon.b (rank 2) addr [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] is down (out of quorum) 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:11.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:11.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: mon.b calling monitor election 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: Reconfiguring mon.a (unknown last config time)... 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: Reconfiguring daemon mon.a on smithi069 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: mon.b calling monitor election 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: mon.c calling monitor election 2023-12-14T18:19:12.534 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: mon.a calling monitor election 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: fsmap 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: mgrmap e13: x(active, since 45s) 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: Cluster is now healthy 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: overall HEALTH_OK 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:12.535 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:12.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T18:19:12.536 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:12.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: mon.b calling monitor election 2023-12-14T18:19:12.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:12.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: Reconfiguring mon.a (unknown last config time)... 2023-12-14T18:19:12.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: Reconfiguring daemon mon.a on smithi069 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: mon.b calling monitor election 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: mon.c calling monitor election 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: mon.a calling monitor election 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: fsmap 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: mgrmap e13: x(active, since 45s) 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: Cluster is now healthy 2023-12-14T18:19:12.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: overall HEALTH_OK 2023-12-14T18:19:12.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:12.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:12.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:12.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T18:19:12.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:12.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: mon.b calling monitor election 2023-12-14T18:19:12.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:12.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: Reconfiguring mon.a (unknown last config time)... 2023-12-14T18:19:12.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: Reconfiguring daemon mon.a on smithi069 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: mon.b calling monitor election 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: mon.c calling monitor election 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: mon.a calling monitor election 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: monmap e3: 3 mons at {a=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0],b=[v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0],c=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: fsmap 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: osdmap e4: 0 total, 0 up, 0 in 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: mgrmap e13: x(active, since 45s) 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-14T18:19:12.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: Cluster is now healthy 2023-12-14T18:19:12.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: overall HEALTH_OK 2023-12-14T18:19:12.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:12.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:12.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:12.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T18:19:12.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:12.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 -- 172.21.15.69:0/3205410796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100ef0 msgr2=0x7f11e0104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:12.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 --2- 172.21.15.69:0/3205410796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100ef0 0x7f11e0104ec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11d40099c0 tx=0x7f11d4009cd0 comp rx=0 tx=0).stop 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 -- 172.21.15.69:0/3205410796 shutdown_connections 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 --2- 172.21.15.69:0/3205410796 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11e01055f0 0x7f11e010d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 --2- 172.21.15.69:0/3205410796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e0100550 0x7f11e0100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 --2- 172.21.15.69:0/3205410796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100ef0 0x7f11e0104ec0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 -- 172.21.15.69:0/3205410796 >> 172.21.15.69:0/3205410796 conn(0x7f11e00fbdf0 msgr2=0x7f11e00fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 -- 172.21.15.69:0/3205410796 shutdown_connections 2023-12-14T18:19:12.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.930+0000 7f11e6626700 1 -- 172.21.15.69:0/3205410796 wait complete. 2023-12-14T18:19:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 Processor -- start 2023-12-14T18:19:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 -- start start 2023-12-14T18:19:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 0x7f11e0196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11e0100ef0 0x7f11e0196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e01055f0 0x7f11e019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e019b240 con 0x7f11e0100550 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e019b3b0 con 0x7f11e0100ef0 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.931+0000 7f11e6626700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e019b570 con 0x7f11e01055f0 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 0x7f11e0196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 0x7f11e0196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34348/0 (socket says 172.21.15.69:34348) 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 -- 172.21.15.69:0/1504405526 learned_addr learned my addr 172.21.15.69:0/1504405526 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11df7fe700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11e0100ef0 0x7f11e0196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11e4bc3700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e01055f0 0x7f11e019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 -- 172.21.15.69:0/1504405526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e01055f0 msgr2=0x7f11e019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:12.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e01055f0 0x7f11e019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 -- 172.21.15.69:0/1504405526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11e0100ef0 msgr2=0x7f11e0196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11e0100ef0 0x7f11e0196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 -- 172.21.15.69:0/1504405526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40095f0 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11e4bc3700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e01055f0 0x7f11e019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dffff700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 0x7f11e0196320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c920 tx=0x7f11d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007b00 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11d0004cc0 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0005590 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e01101d0 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.932+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e0110040 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.933+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f11d000f450 con 0x7f11e0100550 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.933+0000 7f11dd7fa700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c8038a30 0x7f11c803aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:12.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.933+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f11d004b2e0 con 0x7f11e0100550 2023-12-14T18:19:12.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.933+0000 7f11df7fe700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c8038a30 0x7f11c803aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:12.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.933+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e0110360 con 0x7f11e0100550 2023-12-14T18:19:12.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.934+0000 7f11df7fe700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c8038a30 0x7f11c803aee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f11d4000c00 tx=0x7f11d4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:12.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:12.938+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f11d000d930 con 0x7f11e0100550 2023-12-14T18:19:13.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.125+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f11e0197750 con 0x7f11e0100550 2023-12-14T18:19:13.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.126+0000 7f11dd7fa700 1 -- 172.21.15.69:0/1504405526 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f11d0049030 con 0x7f11e0100550 2023-12-14T18:19:13.128 INFO:teuthology.orchestra.run.smithi069.stdout:# minimal ceph.conf for f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:19:13.128 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-12-14T18:19:13.128 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:19:13.128 INFO:teuthology.orchestra.run.smithi069.stdout: mon_host = [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c8038a30 msgr2=0x7f11c803aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c8038a30 0x7f11c803aee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f11d4000c00 tx=0x7f11d4005fb0 comp rx=0 tx=0).stop 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 msgr2=0x7f11e0196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 0x7f11e0196320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c920 tx=0x7f11d000cce0 comp rx=0 tx=0).stop 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 shutdown_connections 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c8038a30 0x7f11c803aee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e01055f0 0x7f11e019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11e0100550 0x7f11e0196320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 --2- 172.21.15.69:0/1504405526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11e0100ef0 0x7f11e0196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 >> 172.21.15.69:0/1504405526 conn(0x7f11e00fbdf0 msgr2=0x7f11e00fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 shutdown_connections 2023-12-14T18:19:13.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:13.128+0000 7f11e6626700 1 -- 172.21.15.69:0/1504405526 wait complete. 2023-12-14T18:19:13.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:13 smithi091 ceph-mon[43601]: Reconfiguring mon.b (monmap changed)... 2023-12-14T18:19:13.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:13 smithi091 ceph-mon[43601]: Reconfiguring daemon mon.b on smithi091 2023-12-14T18:19:13.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:13 smithi091 ceph-mon[43601]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:13.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:13.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:13 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1504405526' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:13.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:13 smithi069 ceph-mon[42047]: Reconfiguring mon.b (monmap changed)... 2023-12-14T18:19:13.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:13 smithi069 ceph-mon[42047]: Reconfiguring daemon mon.b on smithi091 2023-12-14T18:19:13.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:13 smithi069 ceph-mon[42047]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:13.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:13.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:13 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1504405526' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:13.492 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-14T18:19:13.492 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:19:13.492 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.conf 2023-12-14T18:19:13.523 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:19:13.523 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:19:13.590 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:19:13.590 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.conf 2023-12-14T18:19:13.621 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:19:13.621 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:19:13.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:13 smithi119 ceph-mon[43973]: Reconfiguring mon.b (monmap changed)... 2023-12-14T18:19:13.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:13 smithi119 ceph-mon[43973]: Reconfiguring daemon mon.b on smithi091 2023-12-14T18:19:13.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:13 smithi119 ceph-mon[43973]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:13.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:19:13.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:13 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1504405526' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:13.688 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:19:13.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2023-12-14T18:19:13.718 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:19:13.718 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-14T18:19:13.786 INFO:tasks.cephadm:Adding mgr.x on smithi069 2023-12-14T18:19:13.786 INFO:tasks.cephadm:Adding mgr.y on smithi091 2023-12-14T18:19:13.786 INFO:tasks.cephadm:Adding mgr.z on smithi119 2023-12-14T18:19:13.787 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch apply mgr '3;smithi069=x;smithi091=y;smithi119=z' 2023-12-14T18:19:14.335 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:19:14.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: Reconfiguring mon.c (monmap changed)... 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: Reconfiguring daemon mon.c on smithi119 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:14.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: Reconfiguring mon.c (monmap changed)... 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: Reconfiguring daemon mon.c on smithi119 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:14.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: Reconfiguring mon.c (monmap changed)... 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: Reconfiguring daemon mon.c on smithi119 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.227+0000 7f7805e6a700 1 -- 172.21.15.119:0/981371851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 msgr2=0x7f7800108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.227+0000 7f7805e6a700 1 --2- 172.21.15.119:0/981371851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f7800108770 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77f800b0a0 tx=0x7f77f800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- 172.21.15.119:0/981371851 shutdown_connections 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 --2- 172.21.15.119:0/981371851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f7800108770 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 --2- 172.21.15.119:0/981371851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7800100320 0x7f7800100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 --2- 172.21.15.119:0/981371851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 0x7f7800101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- 172.21.15.119:0/981371851 >> 172.21.15.119:0/981371851 conn(0x7f78000fb970 msgr2=0x7f78000fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- 172.21.15.119:0/981371851 shutdown_connections 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- 172.21.15.119:0/981371851 wait complete. 2023-12-14T18:19:15.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 Processor -- start 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- start start 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7800100320 0x7f7800196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 0x7f7800196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f780019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780019dca0 con 0x7f7800101520 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780019dde0 con 0x7f7800100320 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.228+0000 7f7805e6a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780019df70 con 0x7f7800101eb0 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f780019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f780019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40820/0 (socket says 172.21.15.119:40820) 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 -- 172.21.15.119:0/2484167210 learned_addr learned my addr 172.21.15.119:0/2484167210 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77ff7fe700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7800100320 0x7f7800196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77feffd700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 0x7f7800196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 -- 172.21.15.119:0/2484167210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7800100320 msgr2=0x7f7800196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7800100320 0x7f7800196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.232 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 -- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 msgr2=0x7f7800196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 0x7f7800196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 -- 172.21.15.119:0/2484167210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8009d00 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77feffd700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 0x7f7800196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fffff700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f780019d6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77f8007a30 tx=0x7f77f8004db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800e040 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780010bbd0 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77f801db20 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f801bc50 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.229+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780010ba40 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.230+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f77f8005040 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.230+0000 7f77fcff9700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77e80389e0 0x7f77e803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.230+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f77f804d550 con 0x7f7800101eb0 2023-12-14T18:19:15.233 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.230+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800066ea0 con 0x7f7800101eb0 2023-12-14T18:19:15.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.231+0000 7f77ff7fe700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77e80389e0 0x7f77e803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:15.234 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.231+0000 7f77ff7fe700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77e80389e0 0x7f77e803ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77f0006fd0 tx=0x7f77f0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:15.236 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.235+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f77f8021070 con 0x7f7800101eb0 2023-12-14T18:19:15.436 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.435+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi091=y;smithi119=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f7800060f30 con 0x7f77e80389e0 2023-12-14T18:19:15.442 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.441+0000 7f77fcff9700 1 -- 172.21.15.119:0/2484167210 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7800060f30 con 0x7f77e80389e0 2023-12-14T18:19:15.442 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mgr update... 2023-12-14T18:19:15.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77e80389e0 msgr2=0x7f77e803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:15.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77e80389e0 0x7f77e803ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77f0006fd0 tx=0x7f77f0008040 comp rx=0 tx=0).stop 2023-12-14T18:19:15.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 msgr2=0x7f780019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f780019d6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77f8007a30 tx=0x7f77f8004db0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 shutdown_connections 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77e80389e0 0x7f77e803ae90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7800101eb0 0x7f780019d6d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7800100320 0x7f7800196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 --2- 172.21.15.119:0/2484167210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7800101520 0x7f7800196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 >> 172.21.15.119:0/2484167210 conn(0x7f78000fb970 msgr2=0x7f78000fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 shutdown_connections 2023-12-14T18:19:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:15.443+0000 7f7805e6a700 1 -- 172.21.15.119:0/2484167210 wait complete. 2023-12-14T18:19:15.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:15 smithi119 ceph-mon[43973]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:15.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:15 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:15.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:15 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:15.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:15 smithi091 ceph-mon[43601]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:15.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:15 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:15.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:15 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:15 smithi069 ceph-mon[42047]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:15 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:15 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:15.809 DEBUG:teuthology.orchestra.run.smithi091:mgr.y> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.y.service 2023-12-14T18:19:15.812 DEBUG:teuthology.orchestra.run.smithi119:mgr.z> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.z.service 2023-12-14T18:19:15.814 INFO:tasks.cephadm:Deploying OSDs... 2023-12-14T18:19:15.814 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:19:15.814 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-12-14T18:19:15.835 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-14T18:19:15.835 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-12-14T18:19:15.843 INFO:journalctl@ceph.mgr.y.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:19:15.845 INFO:journalctl@ceph.mgr.z.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:19:15.896 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-14T18:19:15.896 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:15.896 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 127157 Links: 1 2023-12-14T18:19:15.896 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:15.896 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:15.897 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 18:18:35.123634646 +0000 2023-12-14T18:19:15.897 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 18:11:35.621798318 +0000 2023-12-14T18:19:15.897 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 18:11:35.621798318 +0000 2023-12-14T18:19:15.897 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T18:19:15.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-14T18:19:15.965 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T18:19:15.965 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T18:19:15.965 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000331547 s, 1.5 MB/s 2023-12-14T18:19:15.967 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-14T18:19:16.026 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 122736 Links: 1 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 18:18:35.123634646 +0000 2023-12-14T18:19:16.085 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 18:11:36.121786771 +0000 2023-12-14T18:19:16.086 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 18:11:36.121786771 +0000 2023-12-14T18:19:16.086 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T18:19:16.086 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-14T18:19:16.152 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T18:19:16.153 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T18:19:16.153 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000235914 s, 2.2 MB/s 2023-12-14T18:19:16.154 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-14T18:19:16.214 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 127260 Links: 1 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 18:18:35.123634646 +0000 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 18:11:36.629775038 +0000 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 18:11:36.629775038 +0000 2023-12-14T18:19:16.273 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T18:19:16.273 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-14T18:19:16.340 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T18:19:16.341 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T18:19:16.341 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00025005 s, 2.0 MB/s 2023-12-14T18:19:16.342 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-14T18:19:16.401 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 125436 Links: 1 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 18:18:35.123634646 +0000 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 18:11:37.204761759 +0000 2023-12-14T18:19:16.459 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 18:11:37.204761759 +0000 2023-12-14T18:19:16.460 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T18:19:16.460 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi091=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: Saving service mgr spec with placement smithi069=x;smithi091=y;smithi119=z;count:3 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:16.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:16.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T18:19:16.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:16.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:16.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:16 smithi119 ceph-mon[43973]: Deploying daemon mgr.z on smithi119 2023-12-14T18:19:16.525 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-14T18:19:16.526 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-14T18:19:16.526 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000224474 s, 2.3 MB/s 2023-12-14T18:19:16.527 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-14T18:19:16.586 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-14T18:19:16.586 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2023-12-14T18:19:16.606 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-14T18:19:16.607 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 2023-12-14T18:19:16.667 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-14T18:19:16.667 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 126697 Links: 1 2023-12-14T18:19:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-14 18:19:03.845199035 +0000 2023-12-14T18:19:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-14 18:12:14.750754125 +0000 2023-12-14T18:19:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-14 18:12:14.750754125 +0000 2023-12-14T18:19:16.668 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-14T18:19:16.668 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-14T18:19:16.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi091=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: Saving service mgr spec with placement smithi069=x;smithi091=y;smithi119=z;count:3 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:16.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:16 smithi069 ceph-mon[42047]: Deploying daemon mgr.z on smithi119 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi091=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: Saving service mgr spec with placement smithi069=x;smithi091=y;smithi119=z;count:3 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:16.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:16.736 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:16 smithi091 ceph-mon[43601]: Deploying daemon mgr.z on smithi119 2023-12-14T18:19:16.738 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-14T18:19:16.738 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-14T18:19:16.738 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000316189 s, 1.6 MB/s 2023-12-14T18:19:16.739 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-14T18:19:16.799 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 122564 Links: 1 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-14 18:19:03.846199010 +0000 2023-12-14T18:19:16.858 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-14 18:12:15.245741615 +0000 2023-12-14T18:19:16.859 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-14 18:12:15.245741615 +0000 2023-12-14T18:19:16.859 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-14T18:19:16.859 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-14T18:19:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-14T18:19:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-14T18:19:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000209185 s, 2.4 MB/s 2023-12-14T18:19:16.928 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-14T18:19:16.986 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 2023-12-14T18:19:17.044 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 126852 Links: 1 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-14 18:19:03.846199010 +0000 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-14 18:12:15.788727892 +0000 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-14 18:12:15.788727892 +0000 2023-12-14T18:19:17.045 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-14T18:19:17.045 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-14T18:19:17.112 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-14T18:19:17.112 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-14T18:19:17.112 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000304437 s, 1.7 MB/s 2023-12-14T18:19:17.113 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-14T18:19:17.125 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:16 smithi119 systemd[1]: Starting Ceph mgr.z for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:19:17.172 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 2023-12-14T18:19:17.230 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-14T18:19:17.230 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:17.230 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 129248 Links: 1 2023-12-14T18:19:17.230 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:17.230 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:17.230 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-14 18:19:03.846199010 +0000 2023-12-14T18:19:17.231 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-14 18:12:16.304714852 +0000 2023-12-14T18:19:17.231 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-14 18:12:16.304714852 +0000 2023-12-14T18:19:17.231 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-14T18:19:17.231 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-14T18:19:17.296 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-14T18:19:17.296 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-14T18:19:17.296 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000304427 s, 1.7 MB/s 2023-12-14T18:19:17.297 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-14T18:19:17.354 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-14T18:19:17.354 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-12-14T18:19:17.374 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-14T18:19:17.374 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 128101 Links: 1 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 18:19:16.755976531 +0000 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 18:11:33.003490412 +0000 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 18:11:33.003490412 +0000 2023-12-14T18:19:17.431 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T18:19:17.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-14T18:19:17.480 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mgr[45861]: -- 172.21.15.119:0/2158746152 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b11af27520 con 0x55b11aefcc00 2023-12-14T18:19:17.480 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 bash[45823]: 87ff93856a0c6156f1a536cf01a633761b270aa8198975bbe7aecae34e407acb 2023-12-14T18:19:17.481 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 systemd[1]: Started Ceph mgr.z for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:19:17.501 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T18:19:17.501 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T18:19:17.502 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.0002392 s, 2.1 MB/s 2023-12-14T18:19:17.503 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-14T18:19:17.563 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-12-14T18:19:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-14T18:19:17.622 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 127592 Links: 1 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 18:19:16.755976531 +0000 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 18:11:33.516477713 +0000 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 18:11:33.516477713 +0000 2023-12-14T18:19:17.623 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T18:19:17.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-14T18:19:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T18:19:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T18:19:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000223327 s, 2.3 MB/s 2023-12-14T18:19:17.692 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-14T18:19:17.752 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-12-14T18:19:17.756 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:17.756 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.756 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.757 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.757 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:17.757 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T18:19:17.757 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:17.757 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:17.775 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:17.478+0000 7f499effe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T18:19:17.775 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:17.588+0000 7f499effe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T18:19:17.775 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:17.683+0000 7f499effe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:17.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-14T18:19:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:17.792 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 124363 Links: 1 2023-12-14T18:19:17.793 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:17.793 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:17.793 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 18:19:16.755976531 +0000 2023-12-14T18:19:17.793 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 18:11:34.029465012 +0000 2023-12-14T18:19:17.793 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 18:11:34.029465012 +0000 2023-12-14T18:19:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T18:19:17.793 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-14T18:19:17.858 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T18:19:17.858 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T18:19:17.858 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000210253 s, 2.4 MB/s 2023-12-14T18:19:17.860 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-14T18:19:17.916 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-14T18:19:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:17.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:17.973 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-14T18:19:17.973 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-14T18:19:17.973 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 129424 Links: 1 2023-12-14T18:19:17.973 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:19:17.973 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-14T18:19:17.973 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-14 18:19:16.755976531 +0000 2023-12-14T18:19:17.974 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-14 18:11:34.528452659 +0000 2023-12-14T18:19:17.974 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-14 18:11:34.528452659 +0000 2023-12-14T18:19:17.974 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-12-14T18:19:17.974 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-14T18:19:18.036 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:17 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:17.773+0000 7f499effe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T18:19:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-14T18:19:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-14T18:19:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000237644 s, 2.2 MB/s 2023-12-14T18:19:18.040 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-14T18:19:18.098 INFO:tasks.cephadm:Deploying osd.0 on smithi069 with /dev/vg_nvme/lv_4... 2023-12-14T18:19:18.098 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-14T18:19:18.413 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:19:18.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:18 smithi091 ceph-mon[43601]: Deploying daemon mgr.y on smithi091 2023-12-14T18:19:18.637 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:18 smithi091 systemd[1]: Starting Ceph mgr.y for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:19:18.726 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:18 smithi119 ceph-mon[43973]: Deploying daemon mgr.y on smithi091 2023-12-14T18:19:18.726 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:18.406+0000 7f499effe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:19:18.726 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:18.640+0000 7f499effe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T18:19:18.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:18 smithi069 ceph-mon[42047]: Deploying daemon mgr.y on smithi091 2023-12-14T18:19:19.119 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:18.724+0000 7f499effe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T18:19:19.119 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:18.832+0000 7f499effe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T18:19:19.119 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:18.923+0000 7f499effe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T18:19:19.220 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:18 smithi091 ceph-mgr[45102]: -- 172.21.15.91:0/3314254148 <== mon.2 v2:172.21.15.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55751cac1520 con 0x55751ca97000 2023-12-14T18:19:19.220 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:18 smithi091 bash[45064]: 7d956068ab5c0d3de41004312d027080da76df8585bd4c7b614383e8203f3789 2023-12-14T18:19:19.220 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:18 smithi091 systemd[1]: Started Ceph mgr.y for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:19:19.375 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:19.117+0000 7f499effe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T18:19:19.375 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:19.211+0000 7f499effe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T18:19:19.493 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:19.217+0000 7f0278fff200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-14T18:19:19.493 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:19.326+0000 7f0278fff200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-14T18:19:19.493 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:19.418+0000 7f0278fff200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-14T18:19:19.621 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-14T18:19:19.621 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-14T18:19:19.621 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T18:19:19.621 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T18:19:19.622 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115222 s, 910 MB/s 2023-12-14T18:19:19.622 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T18:19:19.820 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:19 smithi069 ceph-mon[42047]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:19.821 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.821 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.821 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.821 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.821 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:19.645+0000 7f499effe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-mon[43973]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:19.511+0000 7f0278fff200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-mon[43601]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:20.027 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_4 2023-12-14T18:19:20.250 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:19 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:19.937+0000 7f499effe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T18:19:20.250 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:20.248+0000 7f499effe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T18:19:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:19:20.494 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.178+0000 7f0278fff200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:19:20.495 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.413+0000 7f0278fff200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:20.340+0000 7f499effe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:20.735 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:20.886 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.498+0000 7f0278fff200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-14T18:19:20.886 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.607+0000 7f0278fff200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-14T18:19:20.886 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.697+0000 7f0278fff200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-14T18:19:20.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-14T18:19:20.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:21.346 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.890+0000 7f0278fff200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-14T18:19:21.346 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:20.975+0000 7f0278fff200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-14T18:19:21.347 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:21.344+0000 7f0278fff200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-14T18:19:21.375 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:21.084+0000 7f499effe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T18:19:21.375 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:21.178+0000 7f499effe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T18:19:21.375 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:21.325+0000 7f499effe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T18:19:21.618 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: Reconfiguring mgr.x (unknown last config time)... 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: Reconfiguring daemon mgr.x on smithi069 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 -- 172.21.15.69:0/2830409537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f00ff1e0 msgr2=0x7f24f00ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 --2- 172.21.15.69:0/2830409537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f00ff1e0 0x7f24f00ff5f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009990 tx=0x7f24e0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 -- 172.21.15.69:0/2830409537 shutdown_connections 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 --2- 172.21.15.69:0/2830409537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f0100d70 0x7f24f0107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 --2- 172.21.15.69:0/2830409537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f00ff1e0 0x7f24f00ff5f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 --2- 172.21.15.69:0/2830409537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f01003e0 0x7f24f0100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 -- 172.21.15.69:0/2830409537 >> 172.21.15.69:0/2830409537 conn(0x7f24f00fa7f0 msgr2=0x7f24f00fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 -- 172.21.15.69:0/2830409537 shutdown_connections 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.715+0000 7f24f6079700 1 -- 172.21.15.69:0/2830409537 wait complete. 2023-12-14T18:19:21.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 Processor -- start 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 -- start start 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f00ff1e0 0x7f24f00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 0x7f24f019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f0100d70 0x7f24f019d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f019daa0 con 0x7f24f01003e0 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f019dc10 con 0x7f24f00ff1e0 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24f6079700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f019ddd0 con 0x7f24f0100d70 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24eeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 0x7f24f019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24eeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 0x7f24f019acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36818/0 (socket says 172.21.15.69:36818) 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24eeffd700 1 -- 172.21.15.69:0/1224721340 learned_addr learned my addr 172.21.15.69:0/1224721340 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24ef7fe700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f00ff1e0 0x7f24f00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.716+0000 7f24effff700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f0100d70 0x7f24f019d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24eeffd700 1 -- 172.21.15.69:0/1224721340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f0100d70 msgr2=0x7f24f019d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24eeffd700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f0100d70 0x7f24f019d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24eeffd700 1 -- 172.21.15.69:0/1224721340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f00ff1e0 msgr2=0x7f24f00699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:21.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24eeffd700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f00ff1e0 0x7f24f00699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24eeffd700 1 -- 172.21.15.69:0/1224721340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00095f0 con 0x7f24f01003e0 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24eeffd700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 0x7f24f019acc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24e400e9a0 tx=0x7f24e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4009790 con 0x7f24f01003e0 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e4010430 con 0x7f24f01003e0 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400cea0 con 0x7f24f01003e0 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f010a9e0 con 0x7f24f01003e0 2023-12-14T18:19:21.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.717+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f010a850 con 0x7f24f01003e0 2023-12-14T18:19:21.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.718+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f24e4018680 con 0x7f24f01003e0 2023-12-14T18:19:21.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.718+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f01061b0 con 0x7f24f01003e0 2023-12-14T18:19:21.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.718+0000 7f24ecff9700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d80389e0 0x7f24d803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:21.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.718+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f24e4014070 con 0x7f24f01003e0 2023-12-14T18:19:21.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.718+0000 7f24ef7fe700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d80389e0 0x7f24d803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:21.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.718+0000 7f24ef7fe700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d80389e0 0x7f24d803ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005910 tx=0x7f24e0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:21.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.724+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f24e401fd30 con 0x7f24f01003e0 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: Reconfiguring mgr.x (unknown last config time)... 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: Reconfiguring daemon mgr.x on smithi069 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:21.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:21.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:21.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.886 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:21.616+0000 7f0278fff200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-14T18:19:21.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:21.917+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f24f0061c60 con 0x7f24d80389e0 2023-12-14T18:19:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: Reconfiguring mgr.x (unknown last config time)... 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: Reconfiguring daemon mgr.x on smithi069 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:22.326 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:21.951+0000 7f499effe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T18:19:22.326 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:22.131+0000 7f499effe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T18:19:22.326 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:22.323+0000 7f499effe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T18:19:22.386 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:21.897+0000 7f0278fff200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-14T18:19:22.386 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:21.989+0000 7f0278fff200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-14T18:19:22.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:22.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:22.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:22.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:22.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:22.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:22.695 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:22 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:22.695 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:22 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:22.695 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:22 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:22.695 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:22.695 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:22.695 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:22.827 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:22.732+0000 7f0278fff200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-14T18:19:22.827 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:22.825+0000 7f0278fff200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-14T18:19:22.828 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:22.828 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:22.828 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:22.828 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:22.828 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:22.828 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:23.136 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:22 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:22.971+0000 7f0278fff200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-14T18:19:23.375 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:23.025+0000 7f499effe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T18:19:23.773 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:23 smithi091 ceph-mon[43601]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:23.773 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:23 smithi091 ceph-mon[43601]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:23.773 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:23.591+0000 7f0278fff200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-14T18:19:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:23 smithi119 ceph-mon[43973]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:23.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:23 smithi119 ceph-mon[43973]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:23.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:23.494+0000 7f499effe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:19:23.774 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:23.582+0000 7f499effe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T18:19:23.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:23 smithi069 ceph-mon[42047]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:23.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:23 smithi069 ceph-mon[42047]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:24.125 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:19:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z[45838]: 2023-12-14T18:19:23.772+0000 7f499effe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T18:19:24.136 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:23.771+0000 7f0278fff200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-14T18:19:24.136 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:23.964+0000 7f0278fff200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-14T18:19:24.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:24.783+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 14) v1 ==== 90599+0+0 (secure 0 0 0) 0x7f24e4017750 con 0x7f24f01003e0 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4137572946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56f72c81-c108-4731-8724-00763a3933d9"}]: dispatch 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4137572946' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56f72c81-c108-4731-8724-00763a3933d9"}]': finished 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: osdmap e5: 1 total, 0 up, 1 in 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: Standby manager daemon z started 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T18:19:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T18:19:24.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T18:19:24.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:24 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3743109084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:24.672+0000 7f0278fff200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4137572946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56f72c81-c108-4731-8724-00763a3933d9"}]: dispatch 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4137572946' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56f72c81-c108-4731-8724-00763a3933d9"}]': finished 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: osdmap e5: 1 total, 0 up, 1 in 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: Standby manager daemon z started 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T18:19:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T18:19:24.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T18:19:24.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:24 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3743109084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:19:24.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4137572946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56f72c81-c108-4731-8724-00763a3933d9"}]: dispatch 2023-12-14T18:19:24.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4137572946' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56f72c81-c108-4731-8724-00763a3933d9"}]': finished 2023-12-14T18:19:24.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: osdmap e5: 1 total, 0 up, 1 in 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: Standby manager daemon z started 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.119:0/398607840' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T18:19:24.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:24 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3743109084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:19:25.421 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:25.145+0000 7f0278fff200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-14T18:19:25.421 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:25.231+0000 7f0278fff200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-14T18:19:25.422 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y[45079]: 2023-12-14T18:19:25.419+0000 7f0278fff200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: mgrmap e14: x(active, since 58s), standbys: z 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: Standby manager daemon y started 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T18:19:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T18:19:25.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:25 smithi119 ceph-mon[43973]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: mgrmap e14: x(active, since 58s), standbys: z 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: Standby manager daemon y started 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T18:19:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:25 smithi091 ceph-mon[43601]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T18:19:25.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: mgrmap e14: x(active, since 58s), standbys: z 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: Standby manager daemon y started 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-14T18:19:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:25 smithi069 ceph-mon[42047]: from='mgr.? 172.21.15.91:0/3803846543' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-14T18:19:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:26.106+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f24e400ca10 con 0x7f24f01003e0 2023-12-14T18:19:27.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:27 smithi119 ceph-mon[43973]: mgrmap e15: x(active, since 59s), standbys: z, y 2023-12-14T18:19:27.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T18:19:27.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:27 smithi119 ceph-mon[43973]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:27.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:27 smithi091 ceph-mon[43601]: mgrmap e15: x(active, since 59s), standbys: z, y 2023-12-14T18:19:27.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T18:19:27.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:27 smithi091 ceph-mon[43601]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:27.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:27 smithi069 ceph-mon[42047]: mgrmap e15: x(active, since 59s), standbys: z, y 2023-12-14T18:19:27.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-14T18:19:27.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:27 smithi069 ceph-mon[42047]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:29.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:29 smithi069 ceph-mon[42047]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:29 smithi119 ceph-mon[43973]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:29.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:29 smithi091 ceph-mon[43601]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:30.521 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:30 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-14T18:19:30.522 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:30 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:30.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:30 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-14T18:19:30.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:30 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:30.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:30 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-14T18:19:30.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:30 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:31.355 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:31 smithi069 ceph-mon[42047]: Deploying daemon osd.0 on smithi069 2023-12-14T18:19:31.355 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:31 smithi069 ceph-mon[42047]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:31 smithi119 ceph-mon[43973]: Deploying daemon osd.0 on smithi069 2023-12-14T18:19:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:31 smithi119 ceph-mon[43973]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:31.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:31 smithi091 ceph-mon[43601]: Deploying daemon osd.0 on smithi069 2023-12-14T18:19:31.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:31 smithi091 ceph-mon[43601]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:33.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:33 smithi119 ceph-mon[43973]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:33.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:33 smithi091 ceph-mon[43601]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:33.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:33 smithi069 ceph-mon[42047]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:34.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:34.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:34.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:35 smithi069 ceph-mon[42047]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.867 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 0 on host 'smithi069' 2023-12-14T18:19:35.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.866+0000 7f24ecff9700 1 -- 172.21.15.69:0/1224721340 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f24f0061c60 con 0x7f24d80389e0 2023-12-14T18:19:35.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d80389e0 msgr2=0x7f24d803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d80389e0 0x7f24d803ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005910 tx=0x7f24e0005960 comp rx=0 tx=0).stop 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 msgr2=0x7f24f019acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 0x7f24f019acc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24e400e9a0 tx=0x7f24e400ecb0 comp rx=0 tx=0).stop 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 shutdown_connections 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d80389e0 0x7f24d803ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f0100d70 0x7f24f019d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f00ff1e0 0x7f24f00699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 --2- 172.21.15.69:0/1224721340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24f01003e0 0x7f24f019acc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 >> 172.21.15.69:0/1224721340 conn(0x7f24f00fa7f0 msgr2=0x7f24f00fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 shutdown_connections 2023-12-14T18:19:35.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:19:35.868+0000 7f24f6079700 1 -- 172.21.15.69:0/1224721340 wait complete. 2023-12-14T18:19:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:35 smithi119 ceph-mon[43973]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:35 smithi091 ceph-mon[43601]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.261 DEBUG:teuthology.orchestra.run.smithi069:osd.0> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.0.service 2023-12-14T18:19:36.263 INFO:tasks.cephadm:Deploying osd.1 on smithi091 with /dev/vg_nvme/lv_4... 2023-12-14T18:19:36.263 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-14T18:19:36.295 INFO:journalctl@ceph.osd.0.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:19:36.577 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:19:36.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:36 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:36.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:36 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:36.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:36 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:36.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:36.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:36 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:36.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:36 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:36.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:36 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:36.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:36 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:36 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:36 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:37.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:37 smithi091 ceph-mon[43601]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:37.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:37 smithi091 ceph-mon[43601]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-14T18:19:37.708 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:19:37 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0[54728]: 2023-12-14T18:19:37.423+0000 7fdf4e3f6640 -1 osd.0 0 log_to_monitors true 2023-12-14T18:19:37.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:37 smithi069 ceph-mon[42047]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:37.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:37 smithi069 ceph-mon[42047]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-14T18:19:37.799 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-14T18:19:37.799 INFO:teuthology.orchestra.run.smithi091.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-14T18:19:37.799 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10+0 records in 2023-12-14T18:19:37.800 INFO:teuthology.orchestra.run.smithi091.stderr:10+0 records out 2023-12-14T18:19:37.800 INFO:teuthology.orchestra.run.smithi091.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0161412 s, 650 MB/s 2023-12-14T18:19:37.800 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping successful for: 2023-12-14T18:19:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:37 smithi119 ceph-mon[43973]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:37 smithi119 ceph-mon[43973]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-14T18:19:38.215 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi091:vg_nvme/lv_4 2023-12-14T18:19:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: osdmap e6: 1 total, 0 up, 1 in 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi069 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi069 to 17113M 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:38.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:38.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:38.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:38.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:38.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:38.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:38 smithi091 ceph-mon[43601]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:39.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-14T18:19:39.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: osdmap e6: 1 total, 0 up, 1 in 2023-12-14T18:19:39.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:39.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi069 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi069 to 17113M 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:38 smithi119 ceph-mon[43973]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:39.208 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0[54728]: 2023-12-14T18:19:38.860+0000 7fdf4326c700 -1 osd.0 0 waiting for initial osdmap 2023-12-14T18:19:39.208 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0[54728]: 2023-12-14T18:19:38.866+0000 7fdf3f862700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:19:39.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: osdmap e6: 1 total, 0 up, 1 in 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi069 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi069 to 17113M 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:39.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:39.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:39.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:38 smithi069 ceph-mon[42047]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 -- 172.21.15.91:0/1991537371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 msgr2=0x7fda6c108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 --2- 172.21.15.91:0/1991537371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c108760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda6400b0a0 tx=0x7fda6400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 -- 172.21.15.91:0/1991537371 shutdown_connections 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 --2- 172.21.15.91:0/1991537371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c108760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 --2- 172.21.15.91:0/1991537371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda6c100310 0x7fda6c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 --2- 172.21.15.91:0/1991537371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 0x7fda6c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 -- 172.21.15.91:0/1991537371 >> 172.21.15.91:0/1991537371 conn(0x7fda6c0fb960 msgr2=0x7fda6c0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 -- 172.21.15.91:0/1991537371 shutdown_connections 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 -- 172.21.15.91:0/1991537371 wait complete. 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 Processor -- start 2023-12-14T18:19:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.557+0000 7fda728c6700 1 -- start start 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda728c6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda6c100310 0x7fda6c196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda728c6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 0x7fda6c196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda728c6700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c19d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda728c6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c19dbb0 con 0x7fda6c101510 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda728c6700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c19dcf0 con 0x7fda6c101ea0 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda728c6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c19de80 con 0x7fda6c100310 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c19d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c19d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53430/0 (socket says 172.21.15.91:53430) 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 -- 172.21.15.91:0/787468902 learned_addr learned my addr 172.21.15.91:0/787468902 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda6bfff700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda6c100310 0x7fda6c196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda6b7fe700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 0x7fda6c196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 -- 172.21.15.91:0/787468902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda6c100310 msgr2=0x7fda6c196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda6c100310 0x7fda6c196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 -- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 msgr2=0x7fda6c196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 0x7fda6c196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 -- 172.21.15.91:0/787468902 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64009d00 con 0x7fda6c101ea0 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda6b7fe700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 0x7fda6c196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda70e63700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c19d5e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda640062a0 tx=0x7fda64004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.558+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400e040 con 0x7fda6c101ea0 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.559+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda64003e90 con 0x7fda6c101ea0 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.559+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c10bb20 con 0x7fda6c101ea0 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.559+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64004020 con 0x7fda6c101ea0 2023-12-14T18:19:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.559+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c10b990 con 0x7fda6c101ea0 2023-12-14T18:19:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.560+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c1078c0 con 0x7fda6c101ea0 2023-12-14T18:19:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.561+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7fda6401d690 con 0x7fda6c101ea0 2023-12-14T18:19:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.561+0000 7fda697fa700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fda580a1140 0x7fda580a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.561+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7fda640cc610 con 0x7fda6c101ea0 2023-12-14T18:19:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.562+0000 7fda6bfff700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fda580a1140 0x7fda580a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.562+0000 7fda6bfff700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fda580a1140 0x7fda580a35f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda6c101370 tx=0x7fda5400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:39.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.566+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mon.2 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fda64097980 con 0x7fda6c101ea0 2023-12-14T18:19:39.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:39.761+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fda6c061c70 con 0x7fda580a1140 2023-12-14T18:19:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:19:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: osdmap e7: 1 total, 0 up, 1 in 2023-12-14T18:19:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:39 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:19:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: osdmap e7: 1 total, 0 up, 1 in 2023-12-14T18:19:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:39 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:40.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: from='osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:19:40.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: osdmap e7: 1 total, 0 up, 1 in 2023-12-14T18:19:40.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:40.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:40.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:40.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:40.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:39 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:41.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] boot 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: osdmap e8: 1 total, 1 up, 1 in 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:41.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:40 smithi091 ceph-mon[43601]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:41.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:19:41.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:19:41.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:41.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:41.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] boot 2023-12-14T18:19:41.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: osdmap e8: 1 total, 1 up, 1 in 2023-12-14T18:19:41.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:41.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:40 smithi069 ceph-mon[42047]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: osd.0 [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] boot 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: osdmap e8: 1 total, 1 up, 1 in 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-14T18:19:41.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:40 smithi119 ceph-mon[43973]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-14T18:19:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:41 smithi119 ceph-mon[43973]: osdmap e9: 1 total, 1 up, 1 in 2023-12-14T18:19:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:41 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/1028055507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]: dispatch 2023-12-14T18:19:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:41 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]: dispatch 2023-12-14T18:19:42.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:41 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]': finished 2023-12-14T18:19:42.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:41 smithi119 ceph-mon[43973]: osdmap e10: 2 total, 1 up, 2 in 2023-12-14T18:19:42.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:41 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:41 smithi091 ceph-mon[43601]: osdmap e9: 1 total, 1 up, 1 in 2023-12-14T18:19:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:41 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/1028055507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]: dispatch 2023-12-14T18:19:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:41 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]: dispatch 2023-12-14T18:19:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:41 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]': finished 2023-12-14T18:19:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:41 smithi091 ceph-mon[43601]: osdmap e10: 2 total, 1 up, 2 in 2023-12-14T18:19:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:41 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:42.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:41 smithi069 ceph-mon[42047]: osdmap e9: 1 total, 1 up, 1 in 2023-12-14T18:19:42.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:41 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/1028055507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]: dispatch 2023-12-14T18:19:42.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:41 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]: dispatch 2023-12-14T18:19:42.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:41 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f983667-4671-4b3b-9ae7-6f87d8fc3e60"}]': finished 2023-12-14T18:19:42.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:41 smithi069 ceph-mon[42047]: osdmap e10: 2 total, 1 up, 2 in 2023-12-14T18:19:42.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:41 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:43.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:42 smithi091 ceph-mon[43601]: pgmap v38: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:43.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:42 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/843738191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:19:43.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:42 smithi069 ceph-mon[42047]: pgmap v38: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:43.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:42 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/843738191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:19:43.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:42 smithi119 ceph-mon[43973]: pgmap v38: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:43.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:42 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/843738191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:19:45.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:45 smithi119 ceph-mon[43973]: pgmap v39: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:45.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:45 smithi091 ceph-mon[43601]: pgmap v39: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:45.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:45 smithi069 ceph-mon[42047]: pgmap v39: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:47.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:47 smithi091 ceph-mon[43601]: pgmap v40: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:47 smithi119 ceph-mon[43973]: pgmap v40: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:47 smithi069 ceph-mon[42047]: pgmap v40: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:48.578 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:48 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-14T18:19:48.578 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:48 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:48.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:48 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-14T18:19:48.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:48 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:48.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:48 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-14T18:19:48.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:48 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:49.581 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:49 smithi091 ceph-mon[43601]: Deploying daemon osd.1 on smithi091 2023-12-14T18:19:49.581 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:49 smithi091 ceph-mon[43601]: pgmap v41: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:49 smithi119 ceph-mon[43973]: Deploying daemon osd.1 on smithi091 2023-12-14T18:19:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:49 smithi119 ceph-mon[43973]: pgmap v41: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:49.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:49 smithi069 ceph-mon[42047]: Deploying daemon osd.1 on smithi091 2023-12-14T18:19:49.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:49 smithi069 ceph-mon[42047]: pgmap v41: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:51.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:51 smithi119 ceph-mon[43973]: pgmap v42: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:51 smithi091 ceph-mon[43601]: pgmap v42: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:51 smithi069 ceph-mon[42047]: pgmap v42: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:52.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:52.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:52.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:52.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:52.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:52.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:53 smithi119 ceph-mon[43973]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:53 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:53 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:53 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:53 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:53 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.881 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:53 smithi091 ceph-mon[43601]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:53.881 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:53 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.881 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:53 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.881 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:53 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:53.881 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:53 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:53.881 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:53 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.926+0000 7fda697fa700 1 -- 172.21.15.91:0/787468902 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fda6c061c70 con 0x7fda580a1140 2023-12-14T18:19:53.928 INFO:teuthology.orchestra.run.smithi091.stdout:Created osd(s) 1 on host 'smithi091' 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fda580a1140 msgr2=0x7fda580a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fda580a1140 0x7fda580a35f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda6c101370 tx=0x7fda5400b410 comp rx=0 tx=0).stop 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 msgr2=0x7fda6c19d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c19d5e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda640062a0 tx=0x7fda64004d00 comp rx=0 tx=0).stop 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 shutdown_connections 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fda580a1140 0x7fda580a35f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda6c101ea0 0x7fda6c19d5e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda6c100310 0x7fda6c196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 --2- 172.21.15.91:0/787468902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda6c101510 0x7fda6c196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:53.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 >> 172.21.15.91:0/787468902 conn(0x7fda6c0fb960 msgr2=0x7fda6c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:53.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 shutdown_connections 2023-12-14T18:19:53.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:19:53.928+0000 7fda728c6700 1 -- 172.21.15.91:0/787468902 wait complete. 2023-12-14T18:19:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:53 smithi069 ceph-mon[42047]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:53 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:53 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:53 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:53 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:53 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.406 DEBUG:teuthology.orchestra.run.smithi091:osd.1> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.1.service 2023-12-14T18:19:54.408 INFO:tasks.cephadm:Deploying osd.2 on smithi119 with /dev/vg_nvme/lv_4... 2023-12-14T18:19:54.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-14T18:19:54.440 INFO:journalctl@ceph.osd.1.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:19:54.725 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:19:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:54 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:54 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:54 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:54 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:54 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:54 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:54 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:54 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:54 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:54.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:19:55.834 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:19:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1[48546]: 2023-12-14T18:19:55.409+0000 7fcd2a424640 -1 osd.1 0 log_to_monitors true 2023-12-14T18:19:55.835 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:55 smithi091 ceph-mon[43601]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:55.835 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:55 smithi091 ceph-mon[43601]: from='osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T18:19:55.835 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:55 smithi091 ceph-mon[43601]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T18:19:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:55 smithi119 ceph-mon[43973]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:55 smithi119 ceph-mon[43973]: from='osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T18:19:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:55 smithi119 ceph-mon[43973]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T18:19:55.942 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-14T18:19:55.942 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-14T18:19:55.942 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T18:19:55.942 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T18:19:55.942 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108845 s, 963 MB/s 2023-12-14T18:19:55.942 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T18:19:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:55 smithi069 ceph-mon[42047]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:55 smithi069 ceph-mon[42047]: from='osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T18:19:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:55 smithi069 ceph-mon[42047]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-14T18:19:56.283 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2023-12-14T18:19:56.585 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi091 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi091 to 17113M 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:19:57.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-14T18:19:57.290 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: osdmap e11: 2 total, 1 up, 2 in 2023-12-14T18:19:57.290 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:57.290 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:19:57.290 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:19:57.290 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:57 smithi119 ceph-mon[43973]: pgmap v46: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:57.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1[48546]: 2023-12-14T18:19:57.114+0000 7fcd20a9d700 -1 osd.1 0 waiting for initial osdmap 2023-12-14T18:19:57.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1[48546]: 2023-12-14T18:19:57.118+0000 7fcd1b890700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:19:57.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi091 2023-12-14T18:19:57.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi091 to 17113M 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: osdmap e11: 2 total, 1 up, 2 in 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:57.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:19:57.388 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:19:57.388 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:57 smithi091 ceph-mon[43601]: pgmap v46: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:57.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi091 2023-12-14T18:19:57.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi091 to 17113M 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: osdmap e11: 2 total, 1 up, 2 in 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:19:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:57 smithi069 ceph-mon[42047]: pgmap v46: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:57.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 -- 172.21.15.119:0/2179756919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80103980 msgr2=0x7f6a80105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:57.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 --2- 172.21.15.119:0/2179756919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80103980 0x7f6a80105d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009990 tx=0x7f6a70009ca0 comp rx=0 tx=0).stop 2023-12-14T18:19:57.465 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 -- 172.21.15.119:0/2179756919 shutdown_connections 2023-12-14T18:19:57.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 --2- 172.21.15.119:0/2179756919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a801062a0 0x7f6a80108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:57.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 --2- 172.21.15.119:0/2179756919 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101060 0x7f6a80103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:57.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 --2- 172.21.15.119:0/2179756919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80103980 0x7f6a80105d60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:57.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 -- 172.21.15.119:0/2179756919 >> 172.21.15.119:0/2179756919 conn(0x7f6a800faa80 msgr2=0x7f6a800fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:19:57.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.463+0000 7f6a85853700 1 -- 172.21.15.119:0/2179756919 shutdown_connections 2023-12-14T18:19:57.466 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 -- 172.21.15.119:0/2179756919 wait complete. 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 Processor -- start 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 -- start start 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80101060 0x7f6a80196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80103980 0x7f6a801967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 0x7f6a8019d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8019de00 con 0x7f6a80101060 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8019df40 con 0x7f6a80103980 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a85853700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8019e0d0 con 0x7f6a801062a0 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.464+0000 7f6a7f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 0x7f6a8019d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:57.468 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 0x7f6a8019d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47084/0 (socket says 172.21.15.119:47084) 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 -- 172.21.15.119:0/3337653470 learned_addr learned my addr 172.21.15.119:0/3337653470 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7effd700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80101060 0x7f6a80196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7e7fc700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80103980 0x7f6a801967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 -- 172.21.15.119:0/3337653470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80103980 msgr2=0x7f6a801967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80103980 0x7f6a801967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 -- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80101060 msgr2=0x7f6a80196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80101060 0x7f6a80196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 -- 172.21.15.119:0/3337653470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700095f0 con 0x7f6a801062a0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7e7fc700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80103980 0x7f6a801967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a7f7fe700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 0x7f6a8019d830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a78007ee0 tx=0x7f6a7800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78004db0 con 0x7f6a801062a0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8010bdb0 con 0x7f6a801062a0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a7800f040 con 0x7f6a801062a0 2023-12-14T18:19:57.469 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78005870 con 0x7f6a801062a0 2023-12-14T18:19:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.465+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8010bc20 con 0x7f6a801062a0 2023-12-14T18:19:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.466+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a800fc5f0 con 0x7f6a801062a0 2023-12-14T18:19:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.467+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f6a78005000 con 0x7f6a801062a0 2023-12-14T18:19:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.468+0000 7f6a84851700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a10c0 0x7f6a680a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:19:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.468+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7f6a780cb1f0 con 0x7f6a801062a0 2023-12-14T18:19:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.468+0000 7f6a7effd700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a10c0 0x7f6a680a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:19:57.471 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.468+0000 7f6a7effd700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a10c0 0x7f6a680a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009a10 tx=0x7f6a74009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:19:57.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.471+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6a78096210 con 0x7f6a801062a0 2023-12-14T18:19:57.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:19:57.667+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a80060f30 con 0x7f6a680a10c0 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: osdmap e12: 2 total, 1 up, 2 in 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:58.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: osdmap e12: 2 total, 1 up, 2 in 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:58.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: osdmap e12: 2 total, 1 up, 2 in 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:19:58.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] boot 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: osdmap e13: 2 total, 2 up, 2 in 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:59.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:19:59 smithi119 ceph-mon[43973]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] boot 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: osdmap e13: 2 total, 2 up, 2 in 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:59.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:19:59 smithi091 ceph-mon[43601]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:19:59.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:19:59.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:19:59.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:19:59.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:59.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: osd.1 [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] boot 2023-12-14T18:19:59.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: osdmap e13: 2 total, 2 up, 2 in 2023-12-14T18:19:59.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-14T18:19:59.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:19:59 smithi069 ceph-mon[42047]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-12-14T18:20:00.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: osdmap e14: 2 total, 2 up, 2 in 2023-12-14T18:20:00.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/2603352918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]: dispatch 2023-12-14T18:20:00.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]: dispatch 2023-12-14T18:20:00.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]': finished 2023-12-14T18:20:00.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: osdmap e15: 3 total, 2 up, 3 in 2023-12-14T18:20:00.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:00.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:00 smithi119 ceph-mon[43973]: overall HEALTH_OK 2023-12-14T18:20:00.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: osdmap e14: 2 total, 2 up, 2 in 2023-12-14T18:20:00.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/2603352918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]: dispatch 2023-12-14T18:20:00.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]: dispatch 2023-12-14T18:20:00.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]': finished 2023-12-14T18:20:00.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: osdmap e15: 3 total, 2 up, 3 in 2023-12-14T18:20:00.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:00.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:00 smithi091 ceph-mon[43601]: overall HEALTH_OK 2023-12-14T18:20:00.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: osdmap e14: 2 total, 2 up, 2 in 2023-12-14T18:20:00.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/2603352918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]: dispatch 2023-12-14T18:20:00.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]: dispatch 2023-12-14T18:20:00.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bd26b89-5342-4e8a-8365-c47ce87f298d"}]': finished 2023-12-14T18:20:00.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: osdmap e15: 3 total, 2 up, 3 in 2023-12-14T18:20:00.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:00.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:00 smithi069 ceph-mon[42047]: overall HEALTH_OK 2023-12-14T18:20:01.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:01 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/4207430609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:01.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:01 smithi091 ceph-mon[43601]: pgmap v52: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:01.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:01 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/4207430609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:01.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:01 smithi069 ceph-mon[42047]: pgmap v52: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:01.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:01 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/4207430609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:01.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:01 smithi119 ceph-mon[43973]: pgmap v52: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:03.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:03 smithi119 ceph-mon[43973]: pgmap v53: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:03.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:03 smithi091 ceph-mon[43601]: pgmap v53: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:03 smithi069 ceph-mon[42047]: pgmap v53: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:05.284 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:05 smithi119 ceph-mon[43973]: pgmap v54: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:05.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:05 smithi091 ceph-mon[43601]: pgmap v54: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:05.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:05 smithi069 ceph-mon[42047]: pgmap v54: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:06.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:06 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-14T18:20:06.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:06 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:06.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:06 smithi119 ceph-mon[43973]: Deploying daemon osd.2 on smithi119 2023-12-14T18:20:06.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:06 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-14T18:20:06.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:06 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:06.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:06 smithi091 ceph-mon[43601]: Deploying daemon osd.2 on smithi119 2023-12-14T18:20:06.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:06 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-14T18:20:06.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:06 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:06.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:06 smithi069 ceph-mon[42047]: Deploying daemon osd.2 on smithi119 2023-12-14T18:20:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:07 smithi119 ceph-mon[43973]: pgmap v55: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:07.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:07 smithi091 ceph-mon[43601]: pgmap v55: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:07.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:07 smithi069 ceph-mon[42047]: pgmap v55: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:09.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:09 smithi119 ceph-mon[43973]: pgmap v56: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:09.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:09.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:09.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:09 smithi091 ceph-mon[43601]: pgmap v56: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:09.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:09 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:09.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:09 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:09.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:09 smithi069 ceph-mon[42047]: pgmap v56: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:09.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:09.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:10.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:10.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:10.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:11.571 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.570+0000 7f6a84851700 1 -- 172.21.15.119:0/3337653470 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a80060f30 con 0x7f6a680a10c0 2023-12-14T18:20:11.571 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 2 on host 'smithi119' 2023-12-14T18:20:11.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.572+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a10c0 msgr2=0x7f6a680a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.572+0000 7f6a85853700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a10c0 0x7f6a680a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009a10 tx=0x7f6a74009190 comp rx=0 tx=0).stop 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.572+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 msgr2=0x7f6a8019d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.572+0000 7f6a85853700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 0x7f6a8019d830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a78007ee0 tx=0x7f6a7800d3b0 comp rx=0 tx=0).stop 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 shutdown_connections 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a10c0 0x7f6a680a3570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a801062a0 0x7f6a8019d830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80101060 0x7f6a80196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 --2- 172.21.15.119:0/3337653470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80103980 0x7f6a801967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 >> 172.21.15.119:0/3337653470 conn(0x7f6a800faa80 msgr2=0x7f6a80101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 shutdown_connections 2023-12-14T18:20:11.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:11.573+0000 7f6a85853700 1 -- 172.21.15.119:0/3337653470 wait complete. 2023-12-14T18:20:11.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:11 smithi119 ceph-mon[43973]: pgmap v57: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:11 smithi091 ceph-mon[43601]: pgmap v57: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:11 smithi069 ceph-mon[42047]: pgmap v57: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:11.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:11.955 DEBUG:teuthology.orchestra.run.smithi119:osd.2> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.2.service 2023-12-14T18:20:11.958 INFO:tasks.cephadm:Deploying osd.3 on smithi069 with /dev/vg_nvme/lv_3... 2023-12-14T18:20:11.958 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-14T18:20:11.986 INFO:journalctl@ceph.osd.2.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:20:12.278 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:20:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:12 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:12 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:20:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:12 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:12 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:12 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:20:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:12 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:12.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:12.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:12.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:12 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:12.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:12 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:20:12.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:12 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:13.487 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:13 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2[49785]: 2023-12-14T18:20:13.182+0000 7fc60c199640 -1 osd.2 0 log_to_monitors true 2023-12-14T18:20:13.521 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-14T18:20:13.521 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-14T18:20:13.521 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T18:20:13.521 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T18:20:13.521 INFO:teuthology.orchestra.run.smithi069.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011166 s, 939 MB/s 2023-12-14T18:20:13.521 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T18:20:13.844 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:13 smithi069 ceph-mon[42047]: pgmap v58: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:13.844 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:13 smithi069 ceph-mon[42047]: from='osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T18:20:13.844 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:13 smithi069 ceph-mon[42047]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T18:20:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:13 smithi119 ceph-mon[43973]: pgmap v58: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:13 smithi119 ceph-mon[43973]: from='osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T18:20:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:13 smithi119 ceph-mon[43973]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T18:20:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:13 smithi091 ceph-mon[43601]: pgmap v58: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:13 smithi091 ceph-mon[43601]: from='osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T18:20:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:13 smithi091 ceph-mon[43601]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-14T18:20:13.908 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_3 2023-12-14T18:20:14.213 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:20:14.662 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-14T18:20:14.662 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: osdmap e16: 3 total, 2 up, 3 in 2023-12-14T18:20:14.662 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi119 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi119 to 17113M 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:14.663 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.875 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2[49785]: 2023-12-14T18:20:14.545+0000 7fc60100f700 -1 osd.2 0 waiting for initial osdmap 2023-12-14T18:20:14.875 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2[49785]: 2023-12-14T18:20:14.551+0000 7fc5fb601700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:20:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-14T18:20:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: osdmap e16: 3 total, 2 up, 3 in 2023-12-14T18:20:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi119 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi119 to 17113M 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:14.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-14T18:20:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: osdmap e16: 3 total, 2 up, 3 in 2023-12-14T18:20:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:20:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:20:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi119 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi119 to 17113M 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:15.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/3767828884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 msgr2=0x7fc3f40ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/3767828884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f40ff5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009990 tx=0x7fc3e8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/3767828884 shutdown_connections 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/3767828884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3f4100d70 0x7fc3f4107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/3767828884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f40ff5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/3767828884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f41003e0 0x7fc3f4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/3767828884 >> 172.21.15.69:0/3767828884 conn(0x7fc3f40fa7f0 msgr2=0x7fc3f40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:20:15.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/3767828884 shutdown_connections 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.190+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/3767828884 wait complete. 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 Processor -- start 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 -- start start 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f4195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3f41003e0 0x7fc3f41964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f4100d70 0x7fc3f419d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f419db40 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f419dc80 con 0x7fc3f4100d70 2023-12-14T18:20:15.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f8d0c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f419de10 con 0x7fc3f41003e0 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f4195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f4195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45378/0 (socket says 172.21.15.69:45378) 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 -- 172.21.15.69:0/1676942759 learned_addr learned my addr 172.21.15.69:0/1676942759 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f1d9b700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3f41003e0 0x7fc3f41964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f2d9d700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f4100d70 0x7fc3f419d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 -- 172.21.15.69:0/1676942759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3f41003e0 msgr2=0x7fc3f41964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3f41003e0 0x7fc3f41964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 -- 172.21.15.69:0/1676942759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f4100d70 msgr2=0x7fc3f419d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f4100d70 0x7fc3f419d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:15.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.191+0000 7fc3f259c700 1 -- 172.21.15.69:0/1676942759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80095f0 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.192+0000 7fc3f259c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f4195fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8004760 tx=0x7fc3e8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.192+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e801d070 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.192+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3e8004cc0 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.192+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f410aa40 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.192+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8005280 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.192+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f410a8b0 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.193+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4107370 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.194+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7fc3e8003b70 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.194+0000 7fc3e37fe700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3dc0a10c0 0x7fc3dc0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:15.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.194+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2571+0+0 (secure 0 0 0) 0x7fc3e80cc370 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.194+0000 7fc3f1d9b700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3dc0a10c0 0x7fc3dc0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:15.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.195+0000 7fc3f1d9b700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3dc0a10c0 0x7fc3dc0a3570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005950 tx=0x7fc3e400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:20:15.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.199+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc3e80972a0 con 0x7fc3f40ff1e0 2023-12-14T18:20:15.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:15.394+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3f4061a50 con 0x7fc3dc0a10c0 2023-12-14T18:20:15.844 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:15.844 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:20:15.844 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: pgmap v60: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: osdmap e17: 3 total, 2 up, 3 in 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:15.845 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:20:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: pgmap v60: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:20:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: osdmap e17: 3 total, 2 up, 3 in 2023-12-14T18:20:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:20:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: pgmap v60: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:20:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: osdmap e17: 3 total, 2 up, 3 in 2023-12-14T18:20:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:20:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:20:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:16.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] boot 2023-12-14T18:20:16.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: osdmap e18: 3 total, 3 up, 3 in 2023-12-14T18:20:16.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:16.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:20:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:20:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:20:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] boot 2023-12-14T18:20:16.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: osdmap e18: 3 total, 3 up, 3 in 2023-12-14T18:20:16.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:16.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:20:16.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:20:16.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:20:16.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:16.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: osd.2 [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] boot 2023-12-14T18:20:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: osdmap e18: 3 total, 3 up, 3 in 2023-12-14T18:20:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-14T18:20:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:20:17.765 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58003]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T18:20:17.765 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58003]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:17.765 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58003]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:17.765 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58003]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:17.765 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: pgmap v63: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:17.765 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-14T18:20:17.765 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: osdmap e19: 3 total, 3 up, 3 in 2023-12-14T18:20:17.765 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:20:17.766 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3877787551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f23d99f-7851-4905-8583-6cdd9fb6f75f"}]: dispatch 2023-12-14T18:20:17.766 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-14T18:20:17.766 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3877787551' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f23d99f-7851-4905-8583-6cdd9fb6f75f"}]': finished 2023-12-14T18:20:17.766 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: osdmap e20: 4 total, 3 up, 4 in 2023-12-14T18:20:17.766 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: pgmap v63: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-14T18:20:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: osdmap e19: 3 total, 3 up, 3 in 2023-12-14T18:20:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:20:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3877787551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f23d99f-7851-4905-8583-6cdd9fb6f75f"}]: dispatch 2023-12-14T18:20:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-14T18:20:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3877787551' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f23d99f-7851-4905-8583-6cdd9fb6f75f"}]': finished 2023-12-14T18:20:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: osdmap e20: 4 total, 3 up, 4 in 2023-12-14T18:20:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: pgmap v63: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: osdmap e19: 3 total, 3 up, 3 in 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3877787551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f23d99f-7851-4905-8583-6cdd9fb6f75f"}]: dispatch 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3877787551' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f23d99f-7851-4905-8583-6cdd9fb6f75f"}]': finished 2023-12-14T18:20:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: osdmap e20: 4 total, 3 up, 4 in 2023-12-14T18:20:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:18.208 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58026]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T18:20:18.209 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58026]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:18.209 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58026]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:18.209 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:20:17 smithi069 sudo[58026]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:18.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50930]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T18:20:18.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50930]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:18.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50930]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:18.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50930]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:18.386 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50933]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T18:20:18.387 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:18.387 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50933]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:18.387 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:20:18 smithi091 sudo[50933]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:18.800 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51922]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51922]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51922]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51922]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51925]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51925]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51925]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:18.801 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:20:18 smithi119 sudo[51925]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:19.061 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:19.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:18 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2338866324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:19.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:18 smithi069 ceph-mon[42047]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:19.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:18 smithi069 ceph-mon[42047]: osdmap e21: 4 total, 3 up, 4 in 2023-12-14T18:20:19.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:19.062 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:18 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2338866324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:18 smithi119 ceph-mon[43973]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:18 smithi119 ceph-mon[43973]: osdmap e21: 4 total, 3 up, 4 in 2023-12-14T18:20:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:19.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:19.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:18 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2338866324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:19.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:18 smithi091 ceph-mon[43601]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:19.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:18 smithi091 ceph-mon[43601]: osdmap e21: 4 total, 3 up, 4 in 2023-12-14T18:20:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58455]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58455]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58455]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58455]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58460]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58460]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58460]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:19.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:19 smithi069 sudo[58460]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51928]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T18:20:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51928]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51928]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51928]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51931]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T18:20:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51931]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:19.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51931]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:19.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:19 smithi119 sudo[51931]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:20.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:20.289+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc3e8097670 con 0x7fc3f40ff1e0 2023-12-14T18:20:20.293 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50936]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-14T18:20:20.293 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:20.293 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50936]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:20.293 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50936]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:20.294 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50939]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-14T18:20:20.294 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-14T18:20:20.294 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50939]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-14T18:20:20.294 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 sudo[50939]: pam_unix(sudo:session): session closed for user root 2023-12-14T18:20:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:20.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:20.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:20.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:20.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:20.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:20.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-14T18:20:20.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-14T18:20:21.448 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:21 smithi069 ceph-mon[42047]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:21.448 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:21 smithi069 ceph-mon[42047]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:21.448 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:21 smithi069 ceph-mon[42047]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:21.448 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:21 smithi069 ceph-mon[42047]: mgrmap e16: x(active, since 114s), standbys: z, y 2023-12-14T18:20:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:21 smithi119 ceph-mon[43973]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:21 smithi119 ceph-mon[43973]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:21 smithi119 ceph-mon[43973]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:21 smithi119 ceph-mon[43973]: mgrmap e16: x(active, since 114s), standbys: z, y 2023-12-14T18:20:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:21 smithi091 ceph-mon[43601]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-14T18:20:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:21 smithi091 ceph-mon[43601]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:21 smithi091 ceph-mon[43601]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-14T18:20:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:21 smithi091 ceph-mon[43601]: mgrmap e16: x(active, since 114s), standbys: z, y 2023-12-14T18:20:23.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:23 smithi119 ceph-mon[43973]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:23.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:23 smithi091 ceph-mon[43601]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:23.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:23 smithi069 ceph-mon[42047]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-12-14T18:20:24.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-14T18:20:24.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:24.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:24 smithi069 ceph-mon[42047]: Deploying daemon osd.3 on smithi069 2023-12-14T18:20:24.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-14T18:20:24.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:24.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:24 smithi119 ceph-mon[43973]: Deploying daemon osd.3 on smithi069 2023-12-14T18:20:24.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-14T18:20:24.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:24.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:24 smithi091 ceph-mon[43601]: Deploying daemon osd.3 on smithi069 2023-12-14T18:20:25.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:25 smithi069 ceph-mon[42047]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-12-14T18:20:25.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:25 smithi119 ceph-mon[43973]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-12-14T18:20:25.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:25 smithi091 ceph-mon[43601]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-12-14T18:20:27.581 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:27 smithi069 ceph-mon[42047]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-14T18:20:27.581 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:27.581 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:27.581 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:27 smithi119 ceph-mon[43973]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-14T18:20:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:27 smithi091 ceph-mon[43601]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-14T18:20:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:29.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.286+0000 7fc3e37fe700 1 -- 172.21.15.69:0/1676942759 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc3f4061a50 con 0x7fc3dc0a10c0 2023-12-14T18:20:29.288 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 3 on host 'smithi069' 2023-12-14T18:20:29.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3dc0a10c0 msgr2=0x7fc3dc0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:29.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3dc0a10c0 0x7fc3dc0a3570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005950 tx=0x7fc3e400a300 comp rx=0 tx=0).stop 2023-12-14T18:20:29.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 msgr2=0x7fc3f4195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:29.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f4195fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8004760 tx=0x7fc3e8004790 comp rx=0 tx=0).stop 2023-12-14T18:20:29.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 shutdown_connections 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3dc0a10c0 0x7fc3dc0a3570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f4100d70 0x7fc3f419d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f40ff1e0 0x7fc3f4195fb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 --2- 172.21.15.69:0/1676942759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3f41003e0 0x7fc3f41964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 >> 172.21.15.69:0/1676942759 conn(0x7fc3f40fa7f0 msgr2=0x7fc3f40fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 shutdown_connections 2023-12-14T18:20:29.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:20:29.289+0000 7fc3f8d0c700 1 -- 172.21.15.69:0/1676942759 wait complete. 2023-12-14T18:20:29.703 DEBUG:teuthology.orchestra.run.smithi069:osd.3> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.3.service 2023-12-14T18:20:29.705 INFO:tasks.cephadm:Deploying osd.4 on smithi091 with /dev/vg_nvme/lv_3... 2023-12-14T18:20:29.705 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-14T18:20:29.737 INFO:journalctl@ceph.osd.3.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:20:29.850 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:29.851 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.851 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.851 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:20:29.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:29.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-14T18:20:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:20:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:30.025 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:20:31.208 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:20:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3[60253]: 2023-12-14T18:20:30.948+0000 7f2d6830b640 -1 osd.3 0 log_to_monitors true 2023-12-14T18:20:31.311 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-14T18:20:31.311 INFO:teuthology.orchestra.run.smithi091.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-14T18:20:31.311 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10+0 records in 2023-12-14T18:20:31.311 INFO:teuthology.orchestra.run.smithi091.stderr:10+0 records out 2023-12-14T18:20:31.311 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117812 s, 890 MB/s 2023-12-14T18:20:31.311 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping successful for: 2023-12-14T18:20:31.689 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi091:vg_nvme/lv_3 2023-12-14T18:20:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T18:20:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-14T18:20:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:31.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:31.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:31.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T18:20:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-14T18:20:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:31.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:31.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:31.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T18:20:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-14T18:20:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:31.993 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:20:32.760 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi069 2023-12-14T18:20:32.760 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi069 to 8556M 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: osdmap e22: 4 total, 3 up, 4 in 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: osdmap e23: 4 total, 3 up, 4 in 2023-12-14T18:20:32.761 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi069 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi069 to 8556M 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: osdmap e22: 4 total, 3 up, 4 in 2023-12-14T18:20:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:32.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:20:32.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:20:32.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: osdmap e23: 4 total, 3 up, 4 in 2023-12-14T18:20:32.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:32.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- 172.21.15.91:0/3726161925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c0ff1e0 msgr2=0x7f296c0ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- 172.21.15.91:0/3726161925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c0ff1e0 0x7f296c0ff5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2968009990 tx=0x7f2968009ca0 comp rx=0 tx=0).stop 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- 172.21.15.91:0/3726161925 shutdown_connections 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- 172.21.15.91:0/3726161925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f296c100d70 0x7f296c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- 172.21.15.91:0/3726161925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c0ff1e0 0x7f296c0ff5f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- 172.21.15.91:0/3726161925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c1003e0 0x7f296c100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- 172.21.15.91:0/3726161925 >> 172.21.15.91:0/3726161925 conn(0x7f296c0fa7f0 msgr2=0x7f296c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- 172.21.15.91:0/3726161925 shutdown_connections 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- 172.21.15.91:0/3726161925 wait complete. 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 Processor -- start 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- start start 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ff1e0 0x7f296c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f296c1003e0 0x7f296c196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:32.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 0x7f296c19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c19dba0 con 0x7f296c1003e0 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c19dce0 con 0x7f296c100d70 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.927+0000 7f2973d21700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c19de70 con 0x7f296c0ff1e0 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 0x7f296c19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 0x7f296c19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58238/0 (socket says 172.21.15.91:58238) 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 -- 172.21.15.91:0/3446685726 learned_addr learned my addr 172.21.15.91:0/3446685726 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29712bc700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f296c1003e0 0x7f296c196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2971abd700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ff1e0 0x7f296c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 -- 172.21.15.91:0/3446685726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ff1e0 msgr2=0x7f296c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ff1e0 0x7f296c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 -- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f296c1003e0 msgr2=0x7f296c196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f296c1003e0 0x7f296c196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:32.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 -- 172.21.15.91:0/3446685726 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680095f0 con 0x7f296c100d70 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2971abd700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ff1e0 0x7f296c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f29722be700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 0x7f296c19d5d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f296400ef30 tx=0x7f296400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964018070 con 0x7f296c100d70 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f296400f040 con 0x7f296c100d70 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c10aa60 con 0x7f296c100d70 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400cc90 con 0x7f296c100d70 2023-12-14T18:20:32.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.928+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c10a8d0 con 0x7f296c100d70 2023-12-14T18:20:32.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.929+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c19e570 con 0x7f296c100d70 2023-12-14T18:20:32.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.930+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2964003a00 con 0x7f296c100d70 2023-12-14T18:20:32.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.931+0000 7f2962ffd700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29580a11d0 0x7f29580a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:32.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.931+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3389+0+0 (secure 0 0 0) 0x7f29640cb670 con 0x7f296c100d70 2023-12-14T18:20:32.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.931+0000 7f2971abd700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29580a11d0 0x7f29580a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:32.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.931+0000 7f2971abd700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29580a11d0 0x7f29580a3680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2968006010 tx=0x7f2968005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:20:32.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:32.934+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mon.2 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2964096190 con 0x7f296c100d70 2023-12-14T18:20:32.958 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3[60253]: 2023-12-14T18:20:32.622+0000 7f2d5d181700 -1 osd.3 0 waiting for initial osdmap 2023-12-14T18:20:32.958 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3[60253]: 2023-12-14T18:20:32.632+0000 7f2d57773700 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:20:32.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi069 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi069 to 8556M 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: osdmap e22: 4 total, 3 up, 4 in 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: from='osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: osdmap e23: 4 total, 3 up, 4 in 2023-12-14T18:20:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:33.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:33.131+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f296c068d00 con 0x7f29580a11d0 2023-12-14T18:20:33.868 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T18:20:33.868 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:33.868 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:33.868 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:33.868 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:33.868 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] boot 2023-12-14T18:20:33.869 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: osdmap e24: 4 total, 4 up, 4 in 2023-12-14T18:20:33.869 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:33.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] boot 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: osdmap e24: 4 total, 4 up, 4 in 2023-12-14T18:20:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-14T18:20:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: osd.3 [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] boot 2023-12-14T18:20:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: osdmap e24: 4 total, 4 up, 4 in 2023-12-14T18:20:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-14T18:20:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:34 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:20:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:34 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:20:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:34 smithi091 ceph-mon[43601]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:34 smithi091 ceph-mon[43601]: osdmap e25: 4 total, 4 up, 4 in 2023-12-14T18:20:34.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:34 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:20:34.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:34 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:20:34.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:34 smithi069 ceph-mon[42047]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:34.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:34 smithi069 ceph-mon[42047]: osdmap e25: 4 total, 4 up, 4 in 2023-12-14T18:20:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:34 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:20:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:34 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:20:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:34 smithi119 ceph-mon[43973]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:34 smithi119 ceph-mon[43973]: osdmap e25: 4 total, 4 up, 4 in 2023-12-14T18:20:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: pgmap v78: 1 pgs: 1 remapped+peering; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/4045088006' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]: dispatch 2023-12-14T18:20:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]: dispatch 2023-12-14T18:20:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]': finished 2023-12-14T18:20:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: osdmap e26: 5 total, 4 up, 5 in 2023-12-14T18:20:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/775267605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: pgmap v78: 1 pgs: 1 remapped+peering; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/4045088006' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]: dispatch 2023-12-14T18:20:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]: dispatch 2023-12-14T18:20:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]': finished 2023-12-14T18:20:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: osdmap e26: 5 total, 4 up, 5 in 2023-12-14T18:20:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/775267605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: pgmap v78: 1 pgs: 1 remapped+peering; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/4045088006' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]: dispatch 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]: dispatch 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad340870-d572-419a-9812-e22954c498b0"}]': finished 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: osdmap e26: 5 total, 4 up, 5 in 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/775267605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:37.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:36 smithi119 ceph-mon[43973]: osdmap e27: 5 total, 4 up, 5 in 2023-12-14T18:20:37.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:37.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:36 smithi119 ceph-mon[43973]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:37.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:36 smithi091 ceph-mon[43601]: osdmap e27: 5 total, 4 up, 5 in 2023-12-14T18:20:37.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:37.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:36 smithi091 ceph-mon[43601]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:37.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:36 smithi069 ceph-mon[42047]: osdmap e27: 5 total, 4 up, 5 in 2023-12-14T18:20:37.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:37.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:36 smithi069 ceph-mon[42047]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:38.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:37 smithi119 ceph-mon[43973]: osdmap e28: 5 total, 4 up, 5 in 2023-12-14T18:20:38.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:37 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:38.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:37 smithi091 ceph-mon[43601]: osdmap e28: 5 total, 4 up, 5 in 2023-12-14T18:20:38.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:37 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:38.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:37 smithi069 ceph-mon[42047]: osdmap e28: 5 total, 4 up, 5 in 2023-12-14T18:20:38.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:37 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:39.203 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:38 smithi091 ceph-mon[43601]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:39.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:38 smithi119 ceph-mon[43973]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:39.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:38 smithi069 ceph-mon[42047]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:41.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:41 smithi091 ceph-mon[43601]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-12-14T18:20:41.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:41 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-14T18:20:41.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:41 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:41.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:41 smithi119 ceph-mon[43973]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-12-14T18:20:41.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:41 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-14T18:20:41.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:41 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:41.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:41 smithi069 ceph-mon[42047]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-12-14T18:20:41.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:41 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-14T18:20:41.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:41 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:42.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:42 smithi119 ceph-mon[43973]: Deploying daemon osd.4 on smithi091 2023-12-14T18:20:42.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:42 smithi091 ceph-mon[43601]: Deploying daemon osd.4 on smithi091 2023-12-14T18:20:42.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:42 smithi069 ceph-mon[42047]: Deploying daemon osd.4 on smithi091 2023-12-14T18:20:43.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:43 smithi091 ceph-mon[43601]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-12-14T18:20:43.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:43 smithi119 ceph-mon[43973]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-12-14T18:20:43.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:43 smithi069 ceph-mon[42047]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-12-14T18:20:45.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:45 smithi091 ceph-mon[43601]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-12-14T18:20:45.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:45 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:45.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:45 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:45.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:45 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:45.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:45 smithi119 ceph-mon[43973]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-12-14T18:20:45.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:45 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:45.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:45 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:45.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:45 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:45 smithi069 ceph-mon[42047]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-12-14T18:20:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.085+0000 7f2962ffd700 1 -- 172.21.15.91:0/3446685726 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f296c068d00 con 0x7f29580a11d0 2023-12-14T18:20:47.087 INFO:teuthology.orchestra.run.smithi091.stdout:Created osd(s) 4 on host 'smithi091' 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29580a11d0 msgr2=0x7f29580a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29580a11d0 0x7f29580a3680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2968006010 tx=0x7f2968005ab0 comp rx=0 tx=0).stop 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 msgr2=0x7f296c19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 0x7f296c19d5d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f296400ef30 tx=0x7f296400c3a0 comp rx=0 tx=0).stop 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 shutdown_connections 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29580a11d0 0x7f29580a3680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f296c100d70 0x7f296c19d5d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f296c0ff1e0 0x7f296c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 --2- 172.21.15.91:0/3446685726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f296c1003e0 0x7f296c196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 >> 172.21.15.91:0/3446685726 conn(0x7f296c0fa7f0 msgr2=0x7f296c0685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 shutdown_connections 2023-12-14T18:20:47.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:20:47.087+0000 7f2973d21700 1 -- 172.21.15.91:0/3446685726 wait complete. 2023-12-14T18:20:47.508 DEBUG:teuthology.orchestra.run.smithi091:osd.4> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.4.service 2023-12-14T18:20:47.511 INFO:tasks.cephadm:Deploying osd.5 on smithi119 with /dev/vg_nvme/lv_3... 2023-12-14T18:20:47.511 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-14T18:20:47.543 INFO:journalctl@ceph.osd.4.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:47.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:20:47.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:47.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:20:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:20:47.829 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:20:49.018 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-14T18:20:49.018 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-14T18:20:49.018 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T18:20:49.018 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T18:20:49.018 INFO:teuthology.orchestra.run.smithi119.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117015 s, 896 MB/s 2023-12-14T18:20:49.018 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T18:20:49.136 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:20:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4[54006]: 2023-12-14T18:20:48.758+0000 7fc6201ae640 -1 osd.4 0 log_to_monitors true 2023-12-14T18:20:49.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2023-12-14T18:20:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:49 smithi119 ceph-mon[43973]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-12-14T18:20:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:49 smithi119 ceph-mon[43973]: from='osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T18:20:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:49 smithi119 ceph-mon[43973]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T18:20:49.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:49 smithi091 ceph-mon[43601]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-12-14T18:20:49.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:49 smithi091 ceph-mon[43601]: from='osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T18:20:49.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:49 smithi091 ceph-mon[43601]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T18:20:49.708 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:20:49.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:49 smithi069 ceph-mon[42047]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-12-14T18:20:49.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:49 smithi069 ceph-mon[42047]: from='osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T18:20:49.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:49 smithi069 ceph-mon[42047]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-14T18:20:50.462 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: osdmap e29: 5 total, 4 up, 5 in 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi091 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi091 to 8556M 2023-12-14T18:20:50.463 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.464 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:50.464 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:50.464 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:50.464 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.464 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:20:50.464 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:50 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:20:50.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 -- 172.21.15.119:0/2309479425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67800ff1e0 msgr2=0x7f67800ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:50.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 --2- 172.21.15.119:0/2309479425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67800ff1e0 0x7f67800ff5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6770009990 tx=0x7f6770009ca0 comp rx=0 tx=0).stop 2023-12-14T18:20:50.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 -- 172.21.15.119:0/2309479425 shutdown_connections 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 --2- 172.21.15.119:0/2309479425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6780100d70 0x7f6780107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 --2- 172.21.15.119:0/2309479425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67800ff1e0 0x7f67800ff5f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 --2- 172.21.15.119:0/2309479425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67801003e0 0x7f6780100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 -- 172.21.15.119:0/2309479425 >> 172.21.15.119:0/2309479425 conn(0x7f67800fa7f0 msgr2=0x7f67800fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 -- 172.21.15.119:0/2309479425 shutdown_connections 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.628+0000 7f67885ed700 1 -- 172.21.15.119:0/2309479425 wait complete. 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 Processor -- start 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 -- start start 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800ff1e0 0x7f6780194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67801003e0 0x7f67801954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 0x7f678019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678019cb30 con 0x7f67801003e0 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678019cc70 con 0x7f67800ff1e0 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67885ed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678019ce00 con 0x7f6780100d70 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 0x7f678019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 0x7f678019c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46600/0 (socket says 172.21.15.119:46600) 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 -- 172.21.15.119:0/1113930760 learned_addr learned my addr 172.21.15.119:0/1113930760 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786389700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800ff1e0 0x7f6780194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:50.634 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6785b88700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67801003e0 0x7f67801954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 -- 172.21.15.119:0/1113930760 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800ff1e0 msgr2=0x7f6780194fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800ff1e0 0x7f6780194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 -- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67801003e0 msgr2=0x7f67801954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67801003e0 0x7f67801954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 -- 172.21.15.119:0/1113930760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700095f0 con 0x7f6780100d70 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6785b88700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67801003e0 0x7f67801954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f6786b8a700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 0x7f678019c560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f677800b9a0 tx=0x7f677800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.629+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800c9b0 con 0x7f6780100d70 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.630+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6778014440 con 0x7f6780100d70 2023-12-14T18:20:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.630+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678010aae0 con 0x7f6780100d70 2023-12-14T18:20:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.630+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780075d0 con 0x7f6780100d70 2023-12-14T18:20:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.630+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678010a950 con 0x7f6780100d70 2023-12-14T18:20:50.636 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.630+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678019d570 con 0x7f6780100d70 2023-12-14T18:20:50.637 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4[54006]: 2023-12-14T18:20:50.322+0000 7fc615024700 -1 osd.4 0 waiting for initial osdmap 2023-12-14T18:20:50.637 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4[54006]: 2023-12-14T18:20:50.330+0000 7fc60f616700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:20:50.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-14T18:20:50.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: osdmap e29: 5 total, 4 up, 5 in 2023-12-14T18:20:50.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi091 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi091 to 8556M 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:50.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:50.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:50.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:20:50.639 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:50 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:20:50.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.632+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f67780145b0 con 0x7f6780100d70 2023-12-14T18:20:50.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.632+0000 7f67777fe700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f676c0a1150 0x7f676c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:20:50.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.632+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f6778006e40 con 0x7f6780100d70 2023-12-14T18:20:50.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.632+0000 7f6786389700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f676c0a1150 0x7f676c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:20:50.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.633+0000 7f6786389700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f676c0a1150 0x7f676c0a3600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6770006010 tx=0x7f6770000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:20:50.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.637+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f67780960e0 con 0x7f6780100d70 2023-12-14T18:20:50.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: osdmap e29: 5 total, 4 up, 5 in 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi091 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:50.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi091 to 8556M 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:20:50.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:50 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:20:50.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:20:50.831+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f678019dbe0 con 0x7f676c0a1150 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: osdmap e30: 5 total, 4 up, 5 in 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:51.594 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:51.595 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:20:51.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: osdmap e30: 5 total, 4 up, 5 in 2023-12-14T18:20:51.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:51.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:51.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:51.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:51.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: osdmap e30: 5 total, 4 up, 5 in 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:20:51.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:52.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:52 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:20:52.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:52 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:20:52.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:52 smithi119 ceph-mon[43973]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:52.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:52 smithi119 ceph-mon[43973]: osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] boot 2023-12-14T18:20:52.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:52 smithi119 ceph-mon[43973]: osdmap e31: 5 total, 5 up, 5 in 2023-12-14T18:20:52.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:52.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:52 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:20:52.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:52 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:20:52.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:52 smithi091 ceph-mon[43601]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:52.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:52 smithi091 ceph-mon[43601]: osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] boot 2023-12-14T18:20:52.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:52 smithi091 ceph-mon[43601]: osdmap e31: 5 total, 5 up, 5 in 2023-12-14T18:20:52.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:52 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:20:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:52 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:20:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:52 smithi069 ceph-mon[42047]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:20:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:52 smithi069 ceph-mon[42047]: osd.4 [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] boot 2023-12-14T18:20:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:52 smithi069 ceph-mon[42047]: osdmap e31: 5 total, 5 up, 5 in 2023-12-14T18:20:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-14T18:20:53.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:53.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: osdmap e32: 5 total, 5 up, 5 in 2023-12-14T18:20:53.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/829269712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]: dispatch 2023-12-14T18:20:53.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]: dispatch 2023-12-14T18:20:53.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]': finished 2023-12-14T18:20:53.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: osdmap e33: 6 total, 5 up, 6 in 2023-12-14T18:20:53.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:20:53.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:53 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/3035910078' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: osdmap e32: 5 total, 5 up, 5 in 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/829269712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]: dispatch 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]: dispatch 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]': finished 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: osdmap e33: 6 total, 5 up, 6 in 2023-12-14T18:20:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:20:53.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:53 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/3035910078' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-12-14T18:20:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: osdmap e32: 5 total, 5 up, 5 in 2023-12-14T18:20:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/829269712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]: dispatch 2023-12-14T18:20:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]: dispatch 2023-12-14T18:20:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ebe12f3-7661-4ca7-a325-44590e2cbe37"}]': finished 2023-12-14T18:20:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: osdmap e33: 6 total, 5 up, 6 in 2023-12-14T18:20:53.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:20:53.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:53 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/3035910078' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:20:55.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:55 smithi119 ceph-mon[43973]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:55.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:55 smithi091 ceph-mon[43601]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:55.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:55 smithi069 ceph-mon[42047]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:57.619 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:57 smithi119 ceph-mon[43973]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:57.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:57 smithi091 ceph-mon[43601]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:57.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:57 smithi069 ceph-mon[42047]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:59.518 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:59 smithi119 ceph-mon[43973]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:59.518 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:59 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-14T18:20:59.519 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:20:59 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:59.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:59 smithi091 ceph-mon[43601]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:59.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:59 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-14T18:20:59.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:20:59 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:20:59.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:59 smithi069 ceph-mon[42047]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:20:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:59 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-14T18:20:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:20:59 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:00.513 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:00 smithi119 ceph-mon[43973]: Deploying daemon osd.5 on smithi119 2023-12-14T18:21:00.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:00 smithi091 ceph-mon[43601]: Deploying daemon osd.5 on smithi119 2023-12-14T18:21:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:00 smithi069 ceph-mon[42047]: Deploying daemon osd.5 on smithi119 2023-12-14T18:21:01.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:01 smithi119 ceph-mon[43973]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:01.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:01 smithi091 ceph-mon[43601]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:01.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:01 smithi069 ceph-mon[42047]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:03.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:03 smithi119 ceph-mon[43973]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:03.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:03.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:03.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:03.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:03 smithi091 ceph-mon[43601]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:03.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:03.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:03 smithi069 ceph-mon[42047]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:03.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:03.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:03.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:04.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.636+0000 7f67777fe700 1 -- 172.21.15.119:0/1113930760 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f678019dbe0 con 0x7f676c0a1150 2023-12-14T18:21:04.639 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 5 on host 'smithi119' 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f676c0a1150 msgr2=0x7f676c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f676c0a1150 0x7f676c0a3600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6770006010 tx=0x7f6770000bc0 comp rx=0 tx=0).stop 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 msgr2=0x7f678019c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 0x7f678019c560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f677800b9a0 tx=0x7f677800bd60 comp rx=0 tx=0).stop 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 shutdown_connections 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f676c0a1150 0x7f676c0a3600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6780100d70 0x7f678019c560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:04.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800ff1e0 0x7f6780194fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:04.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 --2- 172.21.15.119:0/1113930760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67801003e0 0x7f67801954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:04.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 >> 172.21.15.119:0/1113930760 conn(0x7f67800fa7f0 msgr2=0x7f67800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:04.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 shutdown_connections 2023-12-14T18:21:04.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:04.639+0000 7f67885ed700 1 -- 172.21.15.119:0/1113930760 wait complete. 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:05.107 DEBUG:teuthology.orchestra.run.smithi119:osd.5> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.5.service 2023-12-14T18:21:05.110 INFO:tasks.cephadm:Deploying osd.6 on smithi069 with /dev/vg_nvme/lv_2... 2023-12-14T18:21:05.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-14T18:21:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:05.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:05.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:05.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:05.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:05.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:05.139 INFO:journalctl@ceph.osd.5.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:21:05.431 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:21:05.851 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:05 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:05.852 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:05 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:05.852 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:05 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:05.852 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:05 smithi119 ceph-mon[43973]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:05.896 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:05 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:05.897 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:05 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:05.897 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:05 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:05.897 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:05 smithi069 ceph-mon[42047]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:06.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:05 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:06.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:05 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:06.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:05 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:06.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:05 smithi091 ceph-mon[43601]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:06.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:21:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:21:06.336+0000 7f6f3729e640 -1 osd.5 0 log_to_monitors true 2023-12-14T18:21:06.711 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-14T18:21:06.711 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-14T18:21:06.712 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T18:21:06.712 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T18:21:06.712 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0150676 s, 696 MB/s 2023-12-14T18:21:06.712 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T18:21:06.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:06 smithi069 ceph-mon[42047]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:06.946 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:06 smithi069 ceph-mon[42047]: from='osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T18:21:06.946 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:06 smithi069 ceph-mon[42047]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T18:21:07.084 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_2 2023-12-14T18:21:07.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:06 smithi119 ceph-mon[43973]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:07.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:06 smithi119 ceph-mon[43973]: from='osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T18:21:07.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:06 smithi119 ceph-mon[43973]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T18:21:07.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:06 smithi091 ceph-mon[43601]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:07.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:06 smithi091 ceph-mon[43601]: from='osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T18:21:07.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:06 smithi091 ceph-mon[43601]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-14T18:21:07.392 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:21:07.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-14T18:21:07.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: osdmap e34: 6 total, 5 up, 6 in 2023-12-14T18:21:07.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:07.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:21:07.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:21:07.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi119 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi119 to 8556M 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:07.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:07 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:08.125 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:21:07.682+0000 7f6f2c114700 -1 osd.5 0 waiting for initial osdmap 2023-12-14T18:21:08.125 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:21:07.690+0000 7f6f27f09700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: osdmap e34: 6 total, 5 up, 6 in 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi119 2023-12-14T18:21:08.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi119 to 8556M 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:08.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:07 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:08.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: osdmap e34: 6 total, 5 up, 6 in 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi119 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi119 to 8556M 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:08.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:07 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 -- 172.21.15.69:0/3310550063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 msgr2=0x7ffb780fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 --2- 172.21.15.69:0/3310550063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb780fe9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009990 tx=0x7ffb68009ca0 comp rx=0 tx=0).stop 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 -- 172.21.15.69:0/3310550063 shutdown_connections 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 --2- 172.21.15.69:0/3310550063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb78101f10 0x7ffb781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 --2- 172.21.15.69:0/3310550063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb780fe9b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 --2- 172.21.15.69:0/3310550063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb78101580 0x7ffb781019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 -- 172.21.15.69:0/3310550063 >> 172.21.15.69:0/3310550063 conn(0x7ffb780f9f70 msgr2=0x7ffb780fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 -- 172.21.15.69:0/3310550063 shutdown_connections 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.357+0000 7ffb801f8700 1 -- 172.21.15.69:0/3310550063 wait complete. 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 Processor -- start 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 -- start start 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb781960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb78101580 0x7ffb781965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb78101f10 0x7ffb7819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7819dc40 con 0x7ffb780fe5a0 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7819dd80 con 0x7ffb78101f10 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb801f8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7819df10 con 0x7ffb78101580 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb781960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb781960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36828/0 (socket says 172.21.15.69:36828) 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 -- 172.21.15.69:0/1469402816 learned_addr learned my addr 172.21.15.69:0/1469402816 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7d793700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb78101580 0x7ffb781965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 -- 172.21.15.69:0/1469402816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb78101580 msgr2=0x7ffb781965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb78101580 0x7ffb781965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 -- 172.21.15.69:0/1469402816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb78101f10 msgr2=0x7ffb7819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb78101f10 0x7ffb7819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 -- 172.21.15.69:0/1469402816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680095f0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.358+0000 7ffb7df94700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb781960b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb68004760 tx=0x7ffb680038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.359+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6801d070 con 0x7ffb780fe5a0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.359+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb68022470 con 0x7ffb780fe5a0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.359+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7810bbe0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.359+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800f6c0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.359+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7810ba50 con 0x7ffb780fe5a0 2023-12-14T18:21:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.360+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb78107ab0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.361+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ffb680225e0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.362+0000 7ffb6effd700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb640a11d0 0x7ffb640a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.362+0000 7ffb7d793700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb640a11d0 0x7ffb640a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.362+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4253+0+0 (secure 0 0 0) 0x7ffb680cd3a0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.362+0000 7ffb7d793700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb640a11d0 0x7ffb640a3680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb74006fd0 tx=0x7ffb74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:21:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.366+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ffb68097ac0 con 0x7ffb780fe5a0 2023-12-14T18:21:08.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:08.565+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb78061c10 con 0x7ffb640a11d0 2023-12-14T18:21:08.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: osdmap e35: 6 total, 5 up, 6 in 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:21:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: osdmap e35: 6 total, 5 up, 6 in 2023-12-14T18:21:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:09.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: osdmap e35: 6 total, 5 up, 6 in 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:09.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:21:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:21:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] boot 2023-12-14T18:21:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: osdmap e36: 6 total, 6 up, 6 in 2023-12-14T18:21:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:09 smithi069 ceph-mon[42047]: osdmap e37: 6 total, 6 up, 6 in 2023-12-14T18:21:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:21:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:21:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] boot 2023-12-14T18:21:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: osdmap e36: 6 total, 6 up, 6 in 2023-12-14T18:21:10.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:10.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:09 smithi119 ceph-mon[43973]: osdmap e37: 6 total, 6 up, 6 in 2023-12-14T18:21:10.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:21:10.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:21:10.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:10.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: osd.5 [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] boot 2023-12-14T18:21:10.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: osdmap e36: 6 total, 6 up, 6 in 2023-12-14T18:21:10.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-14T18:21:10.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:09 smithi091 ceph-mon[43601]: osdmap e37: 6 total, 6 up, 6 in 2023-12-14T18:21:11.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:11.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: osdmap e38: 6 total, 6 up, 6 in 2023-12-14T18:21:11.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1033647387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc1bee25-8cfc-47b3-bee5-df0c011fb92a"}]: dispatch 2023-12-14T18:21:11.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1033647387' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc1bee25-8cfc-47b3-bee5-df0c011fb92a"}]': finished 2023-12-14T18:21:11.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: osdmap e39: 7 total, 6 up, 7 in 2023-12-14T18:21:11.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:11.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:11 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2491805831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: osdmap e38: 6 total, 6 up, 6 in 2023-12-14T18:21:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1033647387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc1bee25-8cfc-47b3-bee5-df0c011fb92a"}]: dispatch 2023-12-14T18:21:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1033647387' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc1bee25-8cfc-47b3-bee5-df0c011fb92a"}]': finished 2023-12-14T18:21:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: osdmap e39: 7 total, 6 up, 7 in 2023-12-14T18:21:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:11.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:11 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2491805831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: osdmap e38: 6 total, 6 up, 6 in 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1033647387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc1bee25-8cfc-47b3-bee5-df0c011fb92a"}]: dispatch 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1033647387' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc1bee25-8cfc-47b3-bee5-df0c011fb92a"}]': finished 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: osdmap e39: 7 total, 6 up, 7 in 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:11.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:11 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2491805831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:12.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:12 smithi069 ceph-mon[42047]: osdmap e40: 7 total, 6 up, 7 in 2023-12-14T18:21:12.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:12 smithi119 ceph-mon[43973]: osdmap e40: 7 total, 6 up, 7 in 2023-12-14T18:21:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:12.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:12 smithi091 ceph-mon[43601]: osdmap e40: 7 total, 6 up, 7 in 2023-12-14T18:21:12.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:13.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:13 smithi069 ceph-mon[42047]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:13 smithi119 ceph-mon[43973]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:13 smithi091 ceph-mon[43601]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:15 smithi069 ceph-mon[42047]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 118 KiB/s, 0 objects/s recovering 2023-12-14T18:21:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:15 smithi119 ceph-mon[43973]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 118 KiB/s, 0 objects/s recovering 2023-12-14T18:21:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:15 smithi091 ceph-mon[43601]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 118 KiB/s, 0 objects/s recovering 2023-12-14T18:21:17.636 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:17 smithi069 ceph-mon[42047]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-14T18:21:17.637 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-14T18:21:17.637 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:17.637 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:17 smithi069 ceph-mon[42047]: Deploying daemon osd.6 on smithi069 2023-12-14T18:21:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:17 smithi119 ceph-mon[43973]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-14T18:21:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-14T18:21:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:17 smithi119 ceph-mon[43973]: Deploying daemon osd.6 on smithi069 2023-12-14T18:21:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:17 smithi091 ceph-mon[43601]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-14T18:21:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-14T18:21:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:17 smithi091 ceph-mon[43601]: Deploying daemon osd.6 on smithi069 2023-12-14T18:21:19.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:19 smithi069 ceph-mon[42047]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-14T18:21:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:19 smithi119 ceph-mon[43973]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-14T18:21:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:19 smithi091 ceph-mon[43601]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-14T18:21:21.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:21 smithi069 ceph-mon[42047]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-12-14T18:21:21.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:21.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:21.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:21 smithi119 ceph-mon[43973]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-12-14T18:21:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:21 smithi091 ceph-mon[43601]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-12-14T18:21:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:22.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.358+0000 7ffb6effd700 1 -- 172.21.15.69:0/1469402816 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffb78061c10 con 0x7ffb640a11d0 2023-12-14T18:21:22.361 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 6 on host 'smithi069' 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.360+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb640a11d0 msgr2=0x7ffb640a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.360+0000 7ffb801f8700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb640a11d0 0x7ffb640a3680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb74006fd0 tx=0x7ffb74008040 comp rx=0 tx=0).stop 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.360+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 msgr2=0x7ffb781960b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.360+0000 7ffb801f8700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb781960b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb68004760 tx=0x7ffb680038d0 comp rx=0 tx=0).stop 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.360+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 shutdown_connections 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.360+0000 7ffb801f8700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb640a11d0 0x7ffb640a3680 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.361+0000 7ffb801f8700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb78101f10 0x7ffb7819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.361+0000 7ffb801f8700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb780fe5a0 0x7ffb781960b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.361+0000 7ffb801f8700 1 --2- 172.21.15.69:0/1469402816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb78101580 0x7ffb781965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:22.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.361+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 >> 172.21.15.69:0/1469402816 conn(0x7ffb780f9f70 msgr2=0x7ffb78104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:22.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.361+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 shutdown_connections 2023-12-14T18:21:22.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:21:22.361+0000 7ffb801f8700 1 -- 172.21.15.69:0/1469402816 wait complete. 2023-12-14T18:21:22.751 DEBUG:teuthology.orchestra.run.smithi069:osd.6> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.6.service 2023-12-14T18:21:22.754 INFO:tasks.cephadm:Deploying osd.7 on smithi091 with /dev/vg_nvme/lv_2... 2023-12-14T18:21:22.754 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-14T18:21:22.788 INFO:journalctl@ceph.osd.6.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:21:23.072 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:21:23.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:23.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:23.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-12-14T18:21:23.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:24.350 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-14T18:21:24.350 INFO:teuthology.orchestra.run.smithi091.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-14T18:21:24.350 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10+0 records in 2023-12-14T18:21:24.350 INFO:teuthology.orchestra.run.smithi091.stderr:10+0 records out 2023-12-14T18:21:24.350 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0158339 s, 662 MB/s 2023-12-14T18:21:24.350 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping successful for: 2023-12-14T18:21:24.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:24 smithi069 ceph-mon[42047]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-14T18:21:24.447 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:21:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:21:24.197+0000 7f3a50269640 -1 osd.6 0 log_to_monitors true 2023-12-14T18:21:24.523 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:24 smithi091 ceph-mon[43601]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-14T18:21:24.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:24 smithi119 ceph-mon[43973]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-14T18:21:24.744 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi091:vg_nvme/lv_2 2023-12-14T18:21:25.049 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:21:25.529 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-14T18:21:25.529 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-14T18:21:25.529 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: osdmap e41: 7 total, 6 up, 7 in 2023-12-14T18:21:25.529 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi069 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi069 to 5704M 2023-12-14T18:21:25.530 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: osdmap e42: 7 total, 6 up, 7 in 2023-12-14T18:21:25.531 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:25.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-14T18:21:25.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-14T18:21:25.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: osdmap e41: 7 total, 6 up, 7 in 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi069 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi069 to 5704M 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:21:25.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: osdmap e42: 7 total, 6 up, 7 in 2023-12-14T18:21:25.628 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:25.709 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:21:25.261+0000 7f3a450df700 -1 osd.6 0 waiting for initial osdmap 2023-12-14T18:21:25.709 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:21:25.274+0000 7f3a3f6d1700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:21:25.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-14T18:21:25.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-14T18:21:25.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: osdmap e41: 7 total, 6 up, 7 in 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi069 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi069 to 5704M 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:25.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:25.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:25.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:21:25.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: osdmap e42: 7 total, 6 up, 7 in 2023-12-14T18:21:25.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:26.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 -- 172.21.15.91:0/2863152172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a01036f0 msgr2=0x7f43a0105ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:26.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 --2- 172.21.15.91:0/2863152172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a01036f0 0x7f43a0105ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4390009990 tx=0x7f4390009ca0 comp rx=0 tx=0).stop 2023-12-14T18:21:26.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 -- 172.21.15.91:0/2863152172 shutdown_connections 2023-12-14T18:21:26.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 --2- 172.21.15.91:0/2863152172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0106010 0x7f43a0108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 --2- 172.21.15.91:0/2863152172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a0100dd0 0x7f43a01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 --2- 172.21.15.91:0/2863152172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a01036f0 0x7f43a0105ad0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 -- 172.21.15.91:0/2863152172 >> 172.21.15.91:0/2863152172 conn(0x7f43a00fa7f0 msgr2=0x7f43a00fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 -- 172.21.15.91:0/2863152172 shutdown_connections 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.024+0000 7f43a64d1700 1 -- 172.21.15.91:0/2863152172 wait complete. 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 Processor -- start 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 -- start start 2023-12-14T18:21:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0100dd0 0x7f43a0196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a01036f0 0x7f43a01965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 0x7f43a019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a019dc00 con 0x7f43a01036f0 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a019dd40 con 0x7f43a0106010 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a64d1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a019ded0 con 0x7f43a0100dd0 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 0x7f43a019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 0x7f43a019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:42720/0 (socket says 172.21.15.91:42720) 2023-12-14T18:21:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 -- 172.21.15.91:0/275375997 learned_addr learned my addr 172.21.15.91:0/275375997 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f439ffff700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0100dd0 0x7f43a0196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f439f7fe700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a01036f0 0x7f43a01965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 -- 172.21.15.91:0/275375997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0100dd0 msgr2=0x7f43a0196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0100dd0 0x7f43a0196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 -- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a01036f0 msgr2=0x7f43a01965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a01036f0 0x7f43a01965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 -- 172.21.15.91:0/275375997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900095f0 con 0x7f43a0106010 2023-12-14T18:21:26.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f439ffff700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0100dd0 0x7f43a0196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.025+0000 7f43a4a6e700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 0x7f43a019d630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f439800b9e0 tx=0x7f439800bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.026+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439800c9b0 con 0x7f43a0106010 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.026+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4398014440 con 0x7f43a0106010 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.026+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a010bc00 con 0x7f43a0106010 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.026+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43980125a0 con 0x7f43a0106010 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.026+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a010ba70 con 0x7f43a0106010 2023-12-14T18:21:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.027+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a00fc360 con 0x7f43a0106010 2023-12-14T18:21:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.028+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f43980145b0 con 0x7f43a0106010 2023-12-14T18:21:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.028+0000 7f439d7fa700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43880a1150 0x7f43880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.029+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f4398006e40 con 0x7f43a0106010 2023-12-14T18:21:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.029+0000 7f439ffff700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43880a1150 0x7f43880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.029+0000 7f439ffff700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43880a1150 0x7f43880a3600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4394007900 tx=0x7f4394008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:21:26.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.033+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mon.2 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4398095940 con 0x7f43a0106010 2023-12-14T18:21:26.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:26.230+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f43a0061c20 con 0x7f43880a1150 2023-12-14T18:21:26.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:26.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:26.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:26.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:26.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:26.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:26.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:26.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:26.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:26.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:26.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:26.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:21:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:21:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] boot 2023-12-14T18:21:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: osdmap e43: 7 total, 7 up, 7 in 2023-12-14T18:21:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] boot 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: osdmap e43: 7 total, 7 up, 7 in 2023-12-14T18:21:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:27.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: osd.6 [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] boot 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: osdmap e43: 7 total, 7 up, 7 in 2023-12-14T18:21:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-14T18:21:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:28 smithi119 ceph-mon[43973]: osdmap e44: 7 total, 7 up, 7 in 2023-12-14T18:21:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:28 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/617693582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]: dispatch 2023-12-14T18:21:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:28 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]: dispatch 2023-12-14T18:21:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:28 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]': finished 2023-12-14T18:21:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:28 smithi119 ceph-mon[43973]: osdmap e45: 8 total, 7 up, 8 in 2023-12-14T18:21:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:28.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:28 smithi091 ceph-mon[43601]: osdmap e44: 7 total, 7 up, 7 in 2023-12-14T18:21:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:28 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/617693582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]: dispatch 2023-12-14T18:21:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:28 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]: dispatch 2023-12-14T18:21:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:28 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]': finished 2023-12-14T18:21:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:28 smithi091 ceph-mon[43601]: osdmap e45: 8 total, 7 up, 8 in 2023-12-14T18:21:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:28 smithi069 ceph-mon[42047]: osdmap e44: 7 total, 7 up, 7 in 2023-12-14T18:21:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:28 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/617693582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]: dispatch 2023-12-14T18:21:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:28 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]: dispatch 2023-12-14T18:21:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:28 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a855d88-a81c-4556-9e92-30d841fbc57d"}]': finished 2023-12-14T18:21:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:28 smithi069 ceph-mon[42047]: osdmap e45: 8 total, 7 up, 8 in 2023-12-14T18:21:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:29 smithi119 ceph-mon[43973]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:29 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/698860805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:29.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:29 smithi091 ceph-mon[43601]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:29.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:29 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/698860805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:29.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:29 smithi069 ceph-mon[42047]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:29 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/698860805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:31 smithi119 ceph-mon[43973]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:31.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:31 smithi091 ceph-mon[43601]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:31.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:31 smithi069 ceph-mon[42047]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:33.589 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:33 smithi091 ceph-mon[43601]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:33.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:33 smithi119 ceph-mon[43973]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:33.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:33 smithi069 ceph-mon[42047]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:35.522 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:35 smithi091 ceph-mon[43601]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:35.522 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-14T18:21:35.522 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:35.522 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:35 smithi091 ceph-mon[43601]: Deploying daemon osd.7 on smithi091 2023-12-14T18:21:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:35 smithi119 ceph-mon[43973]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-14T18:21:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:35 smithi119 ceph-mon[43973]: Deploying daemon osd.7 on smithi091 2023-12-14T18:21:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:35 smithi069 ceph-mon[42047]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-14T18:21:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:35 smithi069 ceph-mon[42047]: Deploying daemon osd.7 on smithi091 2023-12-14T18:21:37.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:37 smithi119 ceph-mon[43973]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:37.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:37 smithi091 ceph-mon[43601]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:37.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:37 smithi069 ceph-mon[42047]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:39.291 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:39.291 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:39.291 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:39.291 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:38 smithi091 ceph-mon[43601]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:39.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:39.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:39.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:39.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:38 smithi119 ceph-mon[43973]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:39.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:39.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:39.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:39.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:38 smithi069 ceph-mon[42047]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:40.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.385+0000 7f439d7fa700 1 -- 172.21.15.91:0/275375997 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f43a0061c20 con 0x7f43880a1150 2023-12-14T18:21:40.387 INFO:teuthology.orchestra.run.smithi091.stdout:Created osd(s) 7 on host 'smithi091' 2023-12-14T18:21:40.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.387+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43880a1150 msgr2=0x7f43880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:40.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.387+0000 7f43a64d1700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43880a1150 0x7f43880a3600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4394007900 tx=0x7f4394008040 comp rx=0 tx=0).stop 2023-12-14T18:21:40.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 msgr2=0x7f43a019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:40.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 0x7f43a019d630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f439800b9e0 tx=0x7f439800bda0 comp rx=0 tx=0).stop 2023-12-14T18:21:40.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 shutdown_connections 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43880a1150 0x7f43880a3600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43a0106010 0x7f43a019d630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a0100dd0 0x7f43a0196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 --2- 172.21.15.91:0/275375997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a01036f0 0x7f43a01965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 >> 172.21.15.91:0/275375997 conn(0x7f43a00fa7f0 msgr2=0x7f43a0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 shutdown_connections 2023-12-14T18:21:40.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:21:40.388+0000 7f43a64d1700 1 -- 172.21.15.91:0/275375997 wait complete. 2023-12-14T18:21:40.603 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.604 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.605 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:40 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:40.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.711 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:40 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:40.782 DEBUG:teuthology.orchestra.run.smithi091:osd.7> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.7.service 2023-12-14T18:21:40.785 INFO:tasks.cephadm:Deploying osd.8 on smithi119 with /dev/vg_nvme/lv_2... 2023-12-14T18:21:40.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-14T18:21:40.818 INFO:journalctl@ceph.osd.7.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.819 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:40.820 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:40.820 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.820 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:40.820 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:40 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:41.104 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:21:41.586 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:41 smithi119 ceph-mon[43973]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:41.627 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:41 smithi091 ceph-mon[43601]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:41.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:41 smithi069 ceph-mon[42047]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:42.303 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:21:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:21:41.986+0000 7f2b5884f640 -1 osd.7 0 log_to_monitors true 2023-12-14T18:21:42.465 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-14T18:21:42.465 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-14T18:21:42.465 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T18:21:42.465 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T18:21:42.466 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114623 s, 915 MB/s 2023-12-14T18:21:42.466 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T18:21:42.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:42 smithi091 ceph-mon[43601]: from='osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T18:21:42.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:42 smithi091 ceph-mon[43601]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T18:21:42.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:42 smithi069 ceph-mon[42047]: from='osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T18:21:42.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:42 smithi069 ceph-mon[42047]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T18:21:42.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:42 smithi119 ceph-mon[43973]: from='osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T18:21:42.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:42 smithi119 ceph-mon[43973]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-14T18:21:42.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2023-12-14T18:21:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: osdmap e46: 8 total, 7 up, 8 in 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi091 2023-12-14T18:21:43.611 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi091 to 5704M 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.612 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:43.613 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:43 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:43.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: osdmap e46: 8 total, 7 up, 8 in 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi091 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi091 to 5704M 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:43.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:43 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:43.886 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:21:43.439+0000 7f2b4d6c5700 -1 osd.7 0 waiting for initial osdmap 2023-12-14T18:21:43.887 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:21:43.452+0000 7f2b45cb3700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: osdmap e46: 8 total, 7 up, 8 in 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:21:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi091 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi091 to 5704M 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:43.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:43.889 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:43.889 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:43 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:44.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 -- 172.21.15.119:0/1339916536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 msgr2=0x7f1464100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 --2- 172.21.15.119:0/1339916536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464100830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1458009990 tx=0x7f1458009ca0 comp rx=0 tx=0).stop 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 -- 172.21.15.119:0/1339916536 shutdown_connections 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 --2- 172.21.15.119:0/1339916536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1464100d70 0x7f1464107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 --2- 172.21.15.119:0/1339916536 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14640ff1e0 0x7f14640ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 --2- 172.21.15.119:0/1339916536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464100830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 -- 172.21.15.119:0/1339916536 >> 172.21.15.119:0/1339916536 conn(0x7f14640fa7f0 msgr2=0x7f14640fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 -- 172.21.15.119:0/1339916536 shutdown_connections 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.095+0000 7f1469223700 1 -- 172.21.15.119:0/1339916536 wait complete. 2023-12-14T18:21:44.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.096+0000 7f1469223700 1 Processor -- start 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.096+0000 7f1469223700 1 -- start start 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.096+0000 7f1469223700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14640ff1e0 0x7f1464195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.096+0000 7f1469223700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.096+0000 7f1469223700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1464100d70 0x7f146419d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f1469223700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146419dad0 con 0x7f1464100d70 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f1469223700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146419dc10 con 0x7f14640ff1e0 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f1469223700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146419dda0 con 0x7f14641003e0 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:44.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35164/0 (socket says 172.21.15.119:35164) 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 -- 172.21.15.119:0/1212583110 learned_addr learned my addr 172.21.15.119:0/1212583110 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f1462d9d700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14640ff1e0 0x7f1464195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146359e700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1464100d70 0x7f146419d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 -- 172.21.15.119:0/1212583110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14640ff1e0 msgr2=0x7f1464195f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14640ff1e0 0x7f1464195f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 -- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1464100d70 msgr2=0x7f146419d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1464100d70 0x7f146419d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 -- 172.21.15.119:0/1212583110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580095f0 con 0x7f14641003e0 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f146259c700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464196480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1458004800 tx=0x7f1458003900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:21:44.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145801d070 con 0x7f14641003e0 2023-12-14T18:21:44.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146410a9f0 con 0x7f14641003e0 2023-12-14T18:21:44.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1458004830 con 0x7f14641003e0 2023-12-14T18:21:44.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458005350 con 0x7f14641003e0 2023-12-14T18:21:44.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.097+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146410a860 con 0x7f14641003e0 2023-12-14T18:21:44.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.098+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1464101a30 con 0x7f14641003e0 2023-12-14T18:21:44.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.099+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f14580049a0 con 0x7f14641003e0 2023-12-14T18:21:44.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.100+0000 7f144bfff700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f144c0a1150 0x7f144c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:21:44.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.100+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5117+0+0 (secure 0 0 0) 0x7f14580cd520 con 0x7f14641003e0 2023-12-14T18:21:44.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.100+0000 7f1462d9d700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f144c0a1150 0x7f144c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:21:44.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.101+0000 7f1462d9d700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f144c0a1150 0x7f144c0a3600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1454005fd0 tx=0x7f1454005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:21:44.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.103+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1458097980 con 0x7f14641003e0 2023-12-14T18:21:44.299 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:44.298+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1464068d60 con 0x7f144c0a1150 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: osdmap e47: 8 total, 7 up, 8 in 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:44.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] boot 2023-12-14T18:21:44.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: osdmap e48: 8 total, 8 up, 8 in 2023-12-14T18:21:44.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:44 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: osdmap e47: 8 total, 7 up, 8 in 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:44.766 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] boot 2023-12-14T18:21:44.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: osdmap e48: 8 total, 8 up, 8 in 2023-12-14T18:21:44.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:44 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:21:44.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: osdmap e47: 8 total, 7 up, 8 in 2023-12-14T18:21:44.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: osd.7 [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] boot 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: osdmap e48: 8 total, 8 up, 8 in 2023-12-14T18:21:44.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:44 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-14T18:21:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:45 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:21:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:45 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:21:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:45 smithi069 ceph-mon[42047]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:45 smithi069 ceph-mon[42047]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:45 smithi069 ceph-mon[42047]: osdmap e49: 8 total, 8 up, 8 in 2023-12-14T18:21:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:45 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:21:45.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:45 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:21:45.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:45 smithi119 ceph-mon[43973]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:45.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:45 smithi119 ceph-mon[43973]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:45.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:45 smithi119 ceph-mon[43973]: osdmap e49: 8 total, 8 up, 8 in 2023-12-14T18:21:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:45 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:21:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:45 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:21:45.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:45 smithi091 ceph-mon[43601]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-12-14T18:21:45.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:45 smithi091 ceph-mon[43601]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:21:45.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:45 smithi091 ceph-mon[43601]: osdmap e49: 8 total, 8 up, 8 in 2023-12-14T18:21:46.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:46 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/3135279271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]: dispatch 2023-12-14T18:21:46.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:46 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]: dispatch 2023-12-14T18:21:46.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:46 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]': finished 2023-12-14T18:21:46.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:46 smithi069 ceph-mon[42047]: osdmap e50: 9 total, 8 up, 9 in 2023-12-14T18:21:46.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:46 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:46.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:46 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/3135279271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]: dispatch 2023-12-14T18:21:46.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:46 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]: dispatch 2023-12-14T18:21:46.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:46 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]': finished 2023-12-14T18:21:46.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:46 smithi119 ceph-mon[43973]: osdmap e50: 9 total, 8 up, 9 in 2023-12-14T18:21:46.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:46 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:46.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:46 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/3135279271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]: dispatch 2023-12-14T18:21:46.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:46 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]: dispatch 2023-12-14T18:21:46.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:46 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b512b899-9be2-4fc9-a305-589642b320e5"}]': finished 2023-12-14T18:21:46.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:46 smithi091 ceph-mon[43601]: osdmap e50: 9 total, 8 up, 9 in 2023-12-14T18:21:46.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:46 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:47 smithi069 ceph-mon[42047]: pgmap v140: 1 pgs: 1 remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:47 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/4257421807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:47 smithi069 ceph-mon[42047]: osdmap e51: 9 total, 8 up, 9 in 2023-12-14T18:21:47.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:47 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:47 smithi119 ceph-mon[43973]: pgmap v140: 1 pgs: 1 remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:47 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/4257421807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:47 smithi119 ceph-mon[43973]: osdmap e51: 9 total, 8 up, 9 in 2023-12-14T18:21:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:47 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:47 smithi091 ceph-mon[43601]: pgmap v140: 1 pgs: 1 remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:47 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/4257421807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:21:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:47 smithi091 ceph-mon[43601]: osdmap e51: 9 total, 8 up, 9 in 2023-12-14T18:21:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:47 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:49.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:49 smithi069 ceph-mon[42047]: osdmap e52: 9 total, 8 up, 9 in 2023-12-14T18:21:49.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:49 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:49.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:49 smithi069 ceph-mon[42047]: pgmap v143: 1 pgs: 1 remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:49 smithi119 ceph-mon[43973]: osdmap e52: 9 total, 8 up, 9 in 2023-12-14T18:21:49.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:49 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:49.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:49 smithi119 ceph-mon[43973]: pgmap v143: 1 pgs: 1 remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:49.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:49 smithi091 ceph-mon[43601]: osdmap e52: 9 total, 8 up, 9 in 2023-12-14T18:21:49.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:49 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:21:49.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:49 smithi091 ceph-mon[43601]: pgmap v143: 1 pgs: 1 remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:51.585 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:51 smithi119 ceph-mon[43973]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:51 smithi091 ceph-mon[43601]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:51 smithi069 ceph-mon[42047]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:52.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-14T18:21:52.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:52.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-14T18:21:52.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-14T18:21:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:53.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:53 smithi119 ceph-mon[43973]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:53.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:53 smithi119 ceph-mon[43973]: Deploying daemon osd.8 on smithi119 2023-12-14T18:21:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:53 smithi091 ceph-mon[43601]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:53.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:53 smithi091 ceph-mon[43601]: Deploying daemon osd.8 on smithi119 2023-12-14T18:21:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:53 smithi069 ceph-mon[42047]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:53 smithi069 ceph-mon[42047]: Deploying daemon osd.8 on smithi119 2023-12-14T18:21:55.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:55 smithi119 ceph-mon[43973]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:55.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:55 smithi091 ceph-mon[43601]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:55.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:55 smithi069 ceph-mon[42047]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:56 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:56 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:56 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:57.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:56 smithi119 ceph-mon[43973]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:57.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:56 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:57.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:56 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:57.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:56 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:57.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:56 smithi091 ceph-mon[43601]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:57.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:56 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:57.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:56 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:56 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:57.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:56 smithi069 ceph-mon[42047]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:58.203 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 8 on host 'smithi119' 2023-12-14T18:21:58.203 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.200+0000 7f144bfff700 1 -- 172.21.15.119:0/1212583110 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1464068d60 con 0x7f144c0a1150 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f144c0a1150 msgr2=0x7f144c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f144c0a1150 0x7f144c0a3600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1454005fd0 tx=0x7f1454005dd0 comp rx=0 tx=0).stop 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 msgr2=0x7f1464196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464196480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1458004800 tx=0x7f1458003900 comp rx=0 tx=0).stop 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 shutdown_connections 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f144c0a1150 0x7f144c0a3600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:58.205 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1464100d70 0x7f146419d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:58.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14640ff1e0 0x7f1464195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:58.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 --2- 172.21.15.119:0/1212583110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641003e0 0x7f1464196480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:21:58.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.202+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 >> 172.21.15.119:0/1212583110 conn(0x7f14640fa7f0 msgr2=0x7f1464068650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:21:58.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.203+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 shutdown_connections 2023-12-14T18:21:58.206 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:21:58.203+0000 7f1469223700 1 -- 172.21.15.119:0/1212583110 wait complete. 2023-12-14T18:21:58.621 DEBUG:teuthology.orchestra.run.smithi119:osd.8> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.8.service 2023-12-14T18:21:58.623 INFO:tasks.cephadm:Deploying osd.9 on smithi069 with /dev/vg_nvme/lv_1... 2023-12-14T18:21:58.624 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-14T18:21:58.667 INFO:journalctl@ceph.osd.8.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:21:58.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.791 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:58 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:58.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:58 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:58.956 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:21:58.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:21:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:58 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:21:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:21:59 smithi069 ceph-mon[42047]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:21:59 smithi119 ceph-mon[43973]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:21:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:21:59 smithi091 ceph-mon[43601]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:00.245 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:21:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:21:59.955+0000 7ff8652ed640 -1 osd.8 0 log_to_monitors true 2023-12-14T18:22:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-14T18:22:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-14T18:22:00.265 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2023-12-14T18:22:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2023-12-14T18:22:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0149675 s, 701 MB/s 2023-12-14T18:22:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2023-12-14T18:22:00.603 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi069:vg_nvme/lv_1 2023-12-14T18:22:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T18:22:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T18:22:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:00.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:00.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:00 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:00.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:00 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.912 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:00.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:00.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:00.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:00.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:00 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1649707447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 msgr2=0x7fd1a4107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1649707447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a4107630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00b0a0 tx=0x7fd19c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:22:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1649707447 shutdown_connections 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1649707447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a4107630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1649707447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 0x7fd1a40ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1649707447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a41003e0 0x7fd1a4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1649707447 >> 172.21.15.69:0/1649707447 conn(0x7fd1a40fa7f0 msgr2=0x7fd1a40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1649707447 shutdown_connections 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.872+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1649707447 wait complete. 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 Processor -- start 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 -- start start 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 0x7fd1a4069130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a41003e0 0x7fd1a419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a419d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a419dbc0 con 0x7fd1a4100d70 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a419dd30 con 0x7fd1a40ff1e0 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1aaa63700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a419def0 con 0x7fd1a41003e0 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1a9000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a419d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1a9000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a419d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38830/0 (socket says 172.21.15.69:38830) 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1a9000700 1 -- 172.21.15.69:0/1284496081 learned_addr learned my addr 172.21.15.69:0/1284496081 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1a37fe700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a41003e0 0x7fd1a419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.873+0000 7fd1a3fff700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 0x7fd1a4069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a9000700 1 -- 172.21.15.69:0/1284496081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a41003e0 msgr2=0x7fd1a419add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a9000700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a41003e0 0x7fd1a419add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a9000700 1 -- 172.21.15.69:0/1284496081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 msgr2=0x7fd1a4069130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a9000700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 0x7fd1a4069130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a9000700 1 -- 172.21.15.69:0/1284496081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c009d00 con 0x7fd1a4100d70 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a3fff700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 0x7fd1a4069130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a9000700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a419d420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00b780 tx=0x7fd19c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00e040 con 0x7fd1a4100d70 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a410a9a0 con 0x7fd1a4100d70 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd19c0094a0 con 0x7fd1a4100d70 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c01dea0 con 0x7fd1a4100d70 2023-12-14T18:22:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.874+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a410a810 con 0x7fd1a4100d70 2023-12-14T18:22:01.880 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:22:01.617+0000 7ff85a163700 -1 osd.8 0 waiting for initial osdmap 2023-12-14T18:22:01.880 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:22:01.632+0000 7ff852751700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:22:01.880 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:01.880 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi119 2023-12-14T18:22:01.880 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi119 to 5704M 2023-12-14T18:22:01.880 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:01.880 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:01.881 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:01.881 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-14T18:22:01.881 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: osdmap e53: 9 total, 8 up, 9 in 2023-12-14T18:22:01.881 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:01.881 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: from='osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:01.881 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:01 smithi119 ceph-mon[43973]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.875+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a419e4e0 con 0x7fd1a4100d70 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.876+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd19c01d470 con 0x7fd1a4100d70 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.877+0000 7fd1a17fa700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd18c0a11d0 0x7fd18c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.877+0000 7fd1a3fff700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd18c0a11d0 0x7fd18c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.877+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fd19c0cd750 con 0x7fd1a4100d70 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.877+0000 7fd1a3fff700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd18c0a11d0 0x7fd18c0a3680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4100240 tx=0x7fd194009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:01.880+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd19c097960 con 0x7fd1a4100d70 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi119 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi119 to 5704M 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-14T18:22:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: osdmap e53: 9 total, 8 up, 9 in 2023-12-14T18:22:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: from='osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:01 smithi091 ceph-mon[43601]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi119 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi119 to 5704M 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: osdmap e53: 9 total, 8 up, 9 in 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: from='osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:01 smithi069 ceph-mon[42047]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:02.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:02.077+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1a419ea90 con 0x7fd18c0a11d0 2023-12-14T18:22:02.837 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:22:02.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: osdmap e54: 9 total, 8 up, 9 in 2023-12-14T18:22:02.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:02.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:02.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:02.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:02.838 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:02 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:02.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:22:02.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: osdmap e54: 9 total, 8 up, 9 in 2023-12-14T18:22:02.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:02.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:02.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:02.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:02.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:02 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:02.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:22:02.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: osdmap e54: 9 total, 8 up, 9 in 2023-12-14T18:22:02.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:02.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:02.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:02.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:02.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:02 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:22:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:22:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] boot 2023-12-14T18:22:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: osdmap e55: 9 total, 9 up, 9 in 2023-12-14T18:22:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] boot 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: osdmap e55: 9 total, 9 up, 9 in 2023-12-14T18:22:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: osd.8 [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] boot 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: osdmap e55: 9 total, 9 up, 9 in 2023-12-14T18:22:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: osdmap e56: 9 total, 9 up, 9 in 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4166662310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4"}]: dispatch 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4166662310' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4"}]': finished 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: osdmap e57: 10 total, 9 up, 10 in 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: osdmap e58: 10 total, 9 up, 10 in 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:04.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:04 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1545868479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: osdmap e56: 9 total, 9 up, 9 in 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4166662310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4"}]: dispatch 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4166662310' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4"}]': finished 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: osdmap e57: 10 total, 9 up, 10 in 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: osdmap e58: 10 total, 9 up, 10 in 2023-12-14T18:22:05.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:05.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:04 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1545868479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: osdmap e56: 9 total, 9 up, 9 in 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4166662310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4"}]: dispatch 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4166662310' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4"}]': finished 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: osdmap e57: 10 total, 9 up, 10 in 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: osdmap e58: 10 total, 9 up, 10 in 2023-12-14T18:22:05.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:05.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:04 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1545868479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:05.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:05 smithi069 ceph-mon[42047]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:05.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:05 smithi069 ceph-mon[42047]: osdmap e59: 10 total, 9 up, 10 in 2023-12-14T18:22:05.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:06.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:05 smithi119 ceph-mon[43973]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:06.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:05 smithi119 ceph-mon[43973]: osdmap e59: 10 total, 9 up, 10 in 2023-12-14T18:22:06.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:06.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:05 smithi091 ceph-mon[43601]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:06.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:05 smithi091 ceph-mon[43601]: osdmap e59: 10 total, 9 up, 10 in 2023-12-14T18:22:06.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:06.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:06 smithi069 ceph-mon[42047]: pgmap v159: 1 pgs: 1 peering; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 160 KiB/s, 0 objects/s recovering 2023-12-14T18:22:07.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:06 smithi119 ceph-mon[43973]: pgmap v159: 1 pgs: 1 peering; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 160 KiB/s, 0 objects/s recovering 2023-12-14T18:22:07.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:06 smithi091 ceph-mon[43601]: pgmap v159: 1 pgs: 1 peering; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 160 KiB/s, 0 objects/s recovering 2023-12-14T18:22:09.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:09 smithi069 ceph-mon[42047]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-12-14T18:22:09.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:09 smithi119 ceph-mon[43973]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-12-14T18:22:09.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:09 smithi091 ceph-mon[43601]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-12-14T18:22:10.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-14T18:22:10.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:10.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-14T18:22:10.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:10.669 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-14T18:22:10.669 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:11.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:11 smithi119 ceph-mon[43973]: Deploying daemon osd.9 on smithi069 2023-12-14T18:22:11.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:11 smithi119 ceph-mon[43973]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-12-14T18:22:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:11 smithi091 ceph-mon[43601]: Deploying daemon osd.9 on smithi069 2023-12-14T18:22:11.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:11 smithi091 ceph-mon[43601]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-12-14T18:22:11.706 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:11 smithi069 ceph-mon[42047]: Deploying daemon osd.9 on smithi069 2023-12-14T18:22:11.706 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:11 smithi069 ceph-mon[42047]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-12-14T18:22:13.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:13 smithi119 ceph-mon[43973]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T18:22:13.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:13 smithi091 ceph-mon[43601]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T18:22:13.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:13 smithi069 ceph-mon[42047]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T18:22:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:14.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:14.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:15 smithi119 ceph-mon[43973]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:22:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:15.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:15 smithi069 ceph-mon[42047]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:22:15.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:15.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:15.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:15 smithi091 ceph-mon[43601]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:22:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:15.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:15.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.976+0000 7fd1a17fa700 1 -- 172.21.15.69:0/1284496081 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd1a419ea90 con 0x7fd18c0a11d0 2023-12-14T18:22:15.979 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 9 on host 'smithi069' 2023-12-14T18:22:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd18c0a11d0 msgr2=0x7fd18c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd18c0a11d0 0x7fd18c0a3680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4100240 tx=0x7fd194009260 comp rx=0 tx=0).stop 2023-12-14T18:22:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 msgr2=0x7fd1a419d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a419d420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00b780 tx=0x7fd19c00bd60 comp rx=0 tx=0).stop 2023-12-14T18:22:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 shutdown_connections 2023-12-14T18:22:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd18c0a11d0 0x7fd18c0a3680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a4100d70 0x7fd1a419d420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1a40ff1e0 0x7fd1a4069130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 --2- 172.21.15.69:0/1284496081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1a41003e0 0x7fd1a419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 >> 172.21.15.69:0/1284496081 conn(0x7fd1a40fa7f0 msgr2=0x7fd1a40fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 shutdown_connections 2023-12-14T18:22:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:15.979+0000 7fd1aaa63700 1 -- 172.21.15.69:0/1284496081 wait complete. 2023-12-14T18:22:16.383 DEBUG:teuthology.orchestra.run.smithi069:osd.9> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.9.service 2023-12-14T18:22:16.386 INFO:tasks.cephadm:Deploying osd.10 on smithi091 with /dev/vg_nvme/lv_1... 2023-12-14T18:22:16.386 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-14T18:22:16.417 INFO:journalctl@ceph.osd.9.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:22:16.716 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:22:16.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:16 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:16.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:16 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:16.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:16 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:16.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:16.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:16.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:16.826 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:16 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:16.826 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:16 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:16.826 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:16 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:16.826 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:16.826 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:16.826 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:16 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:16 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:16 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:17.756 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:17 smithi069 ceph-mon[42047]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:17.756 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:17 smithi069 ceph-mon[42047]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-14T18:22:17.756 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:22:17 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:22:17.502+0000 7ff5773ea640 -1 osd.9 0 log_to_monitors true 2023-12-14T18:22:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:17 smithi119 ceph-mon[43973]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:17 smithi119 ceph-mon[43973]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-14T18:22:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:17 smithi091 ceph-mon[43601]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:17 smithi091 ceph-mon[43601]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-14T18:22:17.997 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-14T18:22:17.997 INFO:teuthology.orchestra.run.smithi091.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-14T18:22:17.997 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10+0 records in 2023-12-14T18:22:17.997 INFO:teuthology.orchestra.run.smithi091.stderr:10+0 records out 2023-12-14T18:22:17.997 INFO:teuthology.orchestra.run.smithi091.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112185 s, 935 MB/s 2023-12-14T18:22:17.997 INFO:teuthology.orchestra.run.smithi091.stderr:--> Zapping successful for: 2023-12-14T18:22:18.391 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi091:vg_nvme/lv_1 2023-12-14T18:22:18.698 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: osdmap e60: 10 total, 9 up, 10 in 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi069 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.095 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi069 to 4278M 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.096 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:19.097 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:19.097 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:18 smithi091 ceph-mon[43601]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:19.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:22:18.941+0000 7ff56c260700 -1 osd.9 0 waiting for initial osdmap 2023-12-14T18:22:19.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:22:18.956+0000 7ff566852700 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: osdmap e60: 10 total, 9 up, 10 in 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi069 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi069 to 4278M 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:19.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:18 smithi069 ceph-mon[42047]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: osdmap e60: 10 total, 9 up, 10 in 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi069 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi069 to 4278M 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:19.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:19.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:19.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:19.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:19.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:19.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:18 smithi119 ceph-mon[43973]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:19.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 -- 172.21.15.91:0/625783689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c105fb0 msgr2=0x7f933c108410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 --2- 172.21.15.91:0/625783689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c105fb0 0x7f933c108410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f933400b0a0 tx=0x7f933400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 -- 172.21.15.91:0/625783689 shutdown_connections 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 --2- 172.21.15.91:0/625783689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c105fb0 0x7f933c108410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 --2- 172.21.15.91:0/625783689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f933c100d70 0x7f933c103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 --2- 172.21.15.91:0/625783689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c103690 0x7f933c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 -- 172.21.15.91:0/625783689 >> 172.21.15.91:0/625783689 conn(0x7f933c0fa7f0 msgr2=0x7f933c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:19.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 -- 172.21.15.91:0/625783689 shutdown_connections 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 -- 172.21.15.91:0/625783689 wait complete. 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.638+0000 7f9342cc2700 1 Processor -- start 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 -- start start 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 0x7f933c1006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f933c103690 0x7f933c0fed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c105fb0 0x7f933c0ff260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ff9e0 con 0x7f933c105fb0 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ffb50 con 0x7f933c100d70 2023-12-14T18:22:19.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1a01a0 con 0x7f933c103690 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 0x7f933c1006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 0x7f933c1006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38792/0 (socket says 172.21.15.91:38792) 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 -- 172.21.15.91:0/2947994600 learned_addr learned my addr 172.21.15.91:0/2947994600 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f933bfff700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f933c103690 0x7f933c0fed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f934125f700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c105fb0 0x7f933c0ff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 -- 172.21.15.91:0/2947994600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f933c103690 msgr2=0x7f933c0fed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f933c103690 0x7f933c0fed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 -- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c105fb0 msgr2=0x7f933c0ff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c105fb0 0x7f933c0ff260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:19.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 -- 172.21.15.91:0/2947994600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334009d00 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f934125f700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c105fb0 0x7f933c0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9340a5e700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 0x7f933c1006d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f933000b530 tx=0x7f933000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330011830 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9330011e20 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.639+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c10bb60 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.640+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933000f2e0 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.640+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c10b9d0 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.641+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c066ea0 con 0x7f933c100d70 2023-12-14T18:22:19.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.642+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9330011990 con 0x7f933c100d70 2023-12-14T18:22:19.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.642+0000 7f9339ffb700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f932c0a1150 0x7f932c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:19.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.642+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f93300cbb30 con 0x7f933c100d70 2023-12-14T18:22:19.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.643+0000 7f933bfff700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f932c0a1150 0x7f932c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:19.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.643+0000 7f933bfff700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f932c0a1150 0x7f932c0a3600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9328005950 tx=0x7f932800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:19.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.647+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mon.2 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9330095ba0 con 0x7f933c100d70 2023-12-14T18:22:19.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:19.843+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f933c1a0d80 con 0x7f932c0a1150 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: osdmap e61: 10 total, 9 up, 10 in 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:20.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:20.292 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:22:20.292 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: osdmap e61: 10 total, 9 up, 10 in 2023-12-14T18:22:20.292 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:20.292 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:20.292 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:20.293 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:20.293 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:20.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: from='osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2023-12-14T18:22:20.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: osdmap e61: 10 total, 9 up, 10 in 2023-12-14T18:22:20.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:20.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:20.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:20.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:20.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:21.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:22:21.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:22:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] boot 2023-12-14T18:22:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: osdmap e62: 10 total, 10 up, 10 in 2023-12-14T18:22:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:20 smithi069 ceph-mon[42047]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:21.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:22:21.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:22:21.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:21.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:21.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] boot 2023-12-14T18:22:21.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: osdmap e62: 10 total, 10 up, 10 in 2023-12-14T18:22:21.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:21.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:20 smithi119 ceph-mon[43973]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi091:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: osd.9 [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] boot 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: osdmap e62: 10 total, 10 up, 10 in 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-14T18:22:21.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:20 smithi091 ceph-mon[43601]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-12-14T18:22:22.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:21 smithi119 ceph-mon[43973]: osdmap e63: 10 total, 10 up, 10 in 2023-12-14T18:22:22.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:21 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/1366699580' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]: dispatch 2023-12-14T18:22:22.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:21 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]: dispatch 2023-12-14T18:22:22.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:21 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]': finished 2023-12-14T18:22:22.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:21 smithi119 ceph-mon[43973]: osdmap e64: 11 total, 10 up, 11 in 2023-12-14T18:22:22.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:22.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:21 smithi091 ceph-mon[43601]: osdmap e63: 10 total, 10 up, 10 in 2023-12-14T18:22:22.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:21 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/1366699580' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]: dispatch 2023-12-14T18:22:22.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:21 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]: dispatch 2023-12-14T18:22:22.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:21 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]': finished 2023-12-14T18:22:22.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:21 smithi091 ceph-mon[43601]: osdmap e64: 11 total, 10 up, 11 in 2023-12-14T18:22:22.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:22.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:21 smithi069 ceph-mon[42047]: osdmap e63: 10 total, 10 up, 10 in 2023-12-14T18:22:22.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:21 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/1366699580' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]: dispatch 2023-12-14T18:22:22.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:21 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]: dispatch 2023-12-14T18:22:22.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:21 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17daa9d6-173d-42ba-99d5-bf6b9e235efa"}]': finished 2023-12-14T18:22:22.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:21 smithi069 ceph-mon[42047]: osdmap e64: 11 total, 10 up, 11 in 2023-12-14T18:22:22.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:22 smithi119 ceph-mon[43973]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:22 smithi119 ceph-mon[43973]: from='client.? 172.21.15.91:0/1137624905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:23.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:22 smithi091 ceph-mon[43601]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:23.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:22 smithi091 ceph-mon[43601]: from='client.? 172.21.15.91:0/1137624905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:23.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:22 smithi069 ceph-mon[42047]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:23.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:22 smithi069 ceph-mon[42047]: from='client.? 172.21.15.91:0/1137624905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:25.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:25 smithi119 ceph-mon[43973]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:25.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:25 smithi091 ceph-mon[43601]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:25.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:25 smithi069 ceph-mon[42047]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:27.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:27 smithi091 ceph-mon[43601]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:27 smithi119 ceph-mon[43973]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:27.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:27 smithi069 ceph-mon[42047]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:28.618 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-14T18:22:28.618 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-14T18:22:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-14T18:22:28.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:29 smithi119 ceph-mon[43973]: Deploying daemon osd.10 on smithi091 2023-12-14T18:22:29.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:29 smithi119 ceph-mon[43973]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:29.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:29 smithi091 ceph-mon[43601]: Deploying daemon osd.10 on smithi091 2023-12-14T18:22:29.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:29 smithi091 ceph-mon[43601]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:29.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:29 smithi069 ceph-mon[42047]: Deploying daemon osd.10 on smithi091 2023-12-14T18:22:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:29 smithi069 ceph-mon[42047]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:31 smithi119 ceph-mon[43973]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:31.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:31 smithi091 ceph-mon[43601]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:31.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:31 smithi069 ceph-mon[42047]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:32.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:32.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:32.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:32.734 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:32.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:32.735 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:33.537 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:33 smithi091 ceph-mon[43601]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:33.537 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.537 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.537 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:33.537 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:33.537 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.645+0000 7f9339ffb700 1 -- 172.21.15.91:0/2947994600 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f933c1a0d80 con 0x7f932c0a1150 2023-12-14T18:22:33.647 INFO:teuthology.orchestra.run.smithi091.stdout:Created osd(s) 10 on host 'smithi091' 2023-12-14T18:22:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f932c0a1150 msgr2=0x7f932c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f932c0a1150 0x7f932c0a3600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9328005950 tx=0x7f932800a300 comp rx=0 tx=0).stop 2023-12-14T18:22:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 msgr2=0x7f933c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 0x7f933c1006d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f933000b530 tx=0x7f933000b840 comp rx=0 tx=0).stop 2023-12-14T18:22:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 shutdown_connections 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f932c0a1150 0x7f932c0a3600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f933c105fb0 0x7f933c0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f933c100d70 0x7f933c1006d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 --2- 172.21.15.91:0/2947994600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f933c103690 0x7f933c0fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 >> 172.21.15.91:0/2947994600 conn(0x7f933c0fa7f0 msgr2=0x7f933c1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 shutdown_connections 2023-12-14T18:22:33.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-14T18:22:33.648+0000 7f9342cc2700 1 -- 172.21.15.91:0/2947994600 wait complete. 2023-12-14T18:22:33.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:33 smithi069 ceph-mon[42047]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:33 smithi119 ceph-mon[43973]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:33.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:33.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:33.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.021 DEBUG:teuthology.orchestra.run.smithi091:osd.10> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.10.service 2023-12-14T18:22:34.024 INFO:tasks.cephadm:Deploying osd.11 on smithi119 with /dev/vg_nvme/lv_1... 2023-12-14T18:22:34.024 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-14T18:22:34.056 INFO:journalctl@ceph.osd.10.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:22:34.341 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:22:34.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:34 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:34.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:34 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:34.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:34 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:34.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:34.850 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:34 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:34.851 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:34 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:34.851 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:34 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:34.851 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.851 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.851 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:34.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:34 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:34.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:34 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:34 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:35.584 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-14T18:22:35.584 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-14T18:22:35.584 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-14T18:22:35.584 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-14T18:22:35.584 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114336 s, 917 MB/s 2023-12-14T18:22:35.584 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-14T18:22:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:35 smithi119 ceph-mon[43973]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:35 smithi119 ceph-mon[43973]: from='osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T18:22:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:35 smithi119 ceph-mon[43973]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T18:22:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:35 smithi091 ceph-mon[43601]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:35 smithi091 ceph-mon[43601]: from='osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T18:22:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:35 smithi091 ceph-mon[43601]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T18:22:35.886 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:22:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:22:35.394+0000 7f1089238640 -1 osd.10 0 log_to_monitors true 2023-12-14T18:22:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:35 smithi069 ceph-mon[42047]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:35 smithi069 ceph-mon[42047]: from='osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T18:22:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:35 smithi069 ceph-mon[42047]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-14T18:22:36.006 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2023-12-14T18:22:36.311 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: osdmap e65: 11 total, 10 up, 11 in 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.736 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.737 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.737 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:36.737 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:36.737 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.887 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:22:36.635+0000 7f107e0ae700 -1 osd.10 0 waiting for initial osdmap 2023-12-14T18:22:36.887 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:22:36.653+0000 7f107669c700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: osdmap e65: 11 total, 10 up, 11 in 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:36.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-14T18:22:36.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: osdmap e65: 11 total, 10 up, 11 in 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:37.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 -- 172.21.15.119:0/3678624488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198101eb0 msgr2=0x7f8198108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:37.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 --2- 172.21.15.119:0/3678624488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198101eb0 0x7f8198108770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f819000b0a0 tx=0x7f819000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:22:37.222 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 -- 172.21.15.119:0/3678624488 shutdown_connections 2023-12-14T18:22:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 --2- 172.21.15.119:0/3678624488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198101eb0 0x7f8198108770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 --2- 172.21.15.119:0/3678624488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8198100320 0x7f8198100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 --2- 172.21.15.119:0/3678624488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101520 0x7f8198101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 -- 172.21.15.119:0/3678624488 >> 172.21.15.119:0/3678624488 conn(0x7f81980fb970 msgr2=0x7f81980fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 -- 172.21.15.119:0/3678624488 shutdown_connections 2023-12-14T18:22:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.221+0000 7f819e1b4700 1 -- 172.21.15.119:0/3678624488 wait complete. 2023-12-14T18:22:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 Processor -- start 2023-12-14T18:22:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 -- start start 2023-12-14T18:22:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 0x7f8198196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8198101520 0x7f8198196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101eb0 0x7f819819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819819dbd0 con 0x7f8198101520 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819819dd10 con 0x7f8198101eb0 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f819e1b4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819819dea0 con 0x7f8198100320 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.222+0000 7f81977fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 0x7f8198196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 0x7f8198196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36662/0 (socket says 172.21.15.119:36662) 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 -- 172.21.15.119:0/2626293433 learned_addr learned my addr 172.21.15.119:0/2626293433 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f8196ffd700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8198101520 0x7f8198196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f8197fff700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101eb0 0x7f819819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 -- 172.21.15.119:0/2626293433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101eb0 msgr2=0x7f819819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101eb0 0x7f819819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 -- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8198101520 msgr2=0x7f8198196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8198101520 0x7f8198196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 -- 172.21.15.119:0/2626293433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009d00 con 0x7f8198100320 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f8197fff700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101eb0 0x7f819819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f81977fe700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 0x7f8198196040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f818c00d9b0 tx=0x7f818c00dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c00be80 con 0x7f8198100320 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819810bb40 con 0x7f8198100320 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f818c0044b0 con 0x7f8198100320 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c003aa0 con 0x7f8198100320 2023-12-14T18:22:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.223+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819810b9b0 con 0x7f8198100320 2023-12-14T18:22:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.224+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81981078f0 con 0x7f8198100320 2023-12-14T18:22:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.225+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f818c009940 con 0x7f8198100320 2023-12-14T18:22:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.226+0000 7f8194ff9700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f81800a1150 0x7f81800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.226+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f818c0cbf80 con 0x7f8198100320 2023-12-14T18:22:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.226+0000 7f8196ffd700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f81800a1150 0x7f81800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.226+0000 7f8196ffd700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f81800a1150 0x7f81800a3600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8188005950 tx=0x7f81880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.230+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f818c095da0 con 0x7f8198100320 2023-12-14T18:22:37.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:37.426+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8198061a50 con 0x7f81800a1150 2023-12-14T18:22:37.641 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi091 2023-12-14T18:22:37.641 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi091 to 4278M 2023-12-14T18:22:37.641 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:37.642 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:22:37.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: osdmap e66: 11 total, 10 up, 11 in 2023-12-14T18:22:37.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:37.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:37.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:37.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:37.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:37 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:37.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi091 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi091 to 4278M 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: osdmap e66: 11 total, 10 up, 11 in 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:37 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:38.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi091 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi091 to 4278M 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi091", "root=default"]}]': finished 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: osdmap e66: 11 total, 10 up, 11 in 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-14T18:22:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-14T18:22:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:37 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:38.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:22:38.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:22:38.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:38.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] boot 2023-12-14T18:22:38.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: osdmap e67: 11 total, 11 up, 11 in 2023-12-14T18:22:38.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:38.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:38 smithi119 ceph-mon[43973]: osdmap e68: 11 total, 11 up, 11 in 2023-12-14T18:22:38.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:22:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:22:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] boot 2023-12-14T18:22:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: osdmap e67: 11 total, 11 up, 11 in 2023-12-14T18:22:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:38 smithi069 ceph-mon[42047]: osdmap e68: 11 total, 11 up, 11 in 2023-12-14T18:22:39.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:22:39.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:22:39.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:22:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: osd.10 [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] boot 2023-12-14T18:22:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: osdmap e67: 11 total, 11 up, 11 in 2023-12-14T18:22:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-14T18:22:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:38 smithi091 ceph-mon[43601]: osdmap e68: 11 total, 11 up, 11 in 2023-12-14T18:22:39.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:39 smithi069 ceph-mon[42047]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T18:22:39.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:39 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/3144599100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]: dispatch 2023-12-14T18:22:39.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:39 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]: dispatch 2023-12-14T18:22:39.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:39 smithi069 ceph-mon[42047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]': finished 2023-12-14T18:22:39.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:39 smithi069 ceph-mon[42047]: osdmap e69: 12 total, 11 up, 12 in 2023-12-14T18:22:39.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:39 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:39 smithi119 ceph-mon[43973]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T18:22:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:39 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/3144599100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]: dispatch 2023-12-14T18:22:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:39 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]: dispatch 2023-12-14T18:22:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:39 smithi119 ceph-mon[43973]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]': finished 2023-12-14T18:22:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:39 smithi119 ceph-mon[43973]: osdmap e69: 12 total, 11 up, 12 in 2023-12-14T18:22:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:39 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:39 smithi091 ceph-mon[43601]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail 2023-12-14T18:22:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:39 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/3144599100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]: dispatch 2023-12-14T18:22:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:39 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]: dispatch 2023-12-14T18:22:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:39 smithi091 ceph-mon[43601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22a093d7-7882-4043-bbd4-396c85352b5c"}]': finished 2023-12-14T18:22:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:39 smithi091 ceph-mon[43601]: osdmap e69: 12 total, 11 up, 12 in 2023-12-14T18:22:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:39 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:40.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:40 smithi069 ceph-mon[42047]: from='client.? 172.21.15.119:0/2677598425' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:41.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:40 smithi119 ceph-mon[43973]: from='client.? 172.21.15.119:0/2677598425' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:41.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:40 smithi091 ceph-mon[43601]: from='client.? 172.21.15.119:0/2677598425' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-14T18:22:41.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:41 smithi069 ceph-mon[42047]: pgmap v186: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:41.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:41 smithi069 ceph-mon[42047]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-14T18:22:41.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:41 smithi069 ceph-mon[42047]: osdmap e70: 12 total, 11 up, 12 in 2023-12-14T18:22:41.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:41 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:41 smithi119 ceph-mon[43973]: pgmap v186: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:41 smithi119 ceph-mon[43973]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-14T18:22:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:41 smithi119 ceph-mon[43973]: osdmap e70: 12 total, 11 up, 12 in 2023-12-14T18:22:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:41 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:41 smithi091 ceph-mon[43601]: pgmap v186: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:41 smithi091 ceph-mon[43601]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-14T18:22:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:41 smithi091 ceph-mon[43601]: osdmap e70: 12 total, 11 up, 12 in 2023-12-14T18:22:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:41 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:42.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:42 smithi069 ceph-mon[42047]: osdmap e71: 12 total, 11 up, 12 in 2023-12-14T18:22:42.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:42 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:43.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:42 smithi119 ceph-mon[43973]: osdmap e71: 12 total, 11 up, 12 in 2023-12-14T18:22:43.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:42 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:43.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:42 smithi091 ceph-mon[43601]: osdmap e71: 12 total, 11 up, 12 in 2023-12-14T18:22:43.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:42 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:43 smithi119 ceph-mon[43973]: pgmap v189: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:43.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:43 smithi069 ceph-mon[42047]: pgmap v189: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:44.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:43 smithi091 ceph-mon[43601]: pgmap v189: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:45.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:45 smithi069 ceph-mon[42047]: pgmap v190: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-14T18:22:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:45 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:45.982 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:45 smithi119 ceph-mon[43973]: pgmap v190: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:45.982 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:45 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-14T18:22:45.982 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:45 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:46.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:45 smithi091 ceph-mon[43601]: pgmap v190: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-12-14T18:22:46.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:45 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-14T18:22:46.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:45 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:46.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:46 smithi069 ceph-mon[42047]: Deploying daemon osd.11 on smithi119 2023-12-14T18:22:47.052 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:46 smithi119 ceph-mon[43973]: Deploying daemon osd.11 on smithi119 2023-12-14T18:22:47.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:46 smithi091 ceph-mon[43601]: Deploying daemon osd.11 on smithi119 2023-12-14T18:22:47.938 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:47 smithi119 ceph-mon[43973]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-14T18:22:47.938 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:47 smithi119 ceph-mon[43973]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-14T18:22:47.938 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:47 smithi119 ceph-mon[43973]: Cluster is now healthy 2023-12-14T18:22:47.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:47 smithi069 ceph-mon[42047]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-14T18:22:47.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:47 smithi069 ceph-mon[42047]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-14T18:22:47.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:47 smithi069 ceph-mon[42047]: Cluster is now healthy 2023-12-14T18:22:48.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:47 smithi091 ceph-mon[43601]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-14T18:22:48.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:47 smithi091 ceph-mon[43601]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-14T18:22:48.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:47 smithi091 ceph-mon[43601]: Cluster is now healthy 2023-12-14T18:22:48.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:48 smithi069 ceph-mon[42047]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T18:22:49.043 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:48 smithi119 ceph-mon[43973]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T18:22:49.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:48 smithi091 ceph-mon[43601]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-14T18:22:50.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:50.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:50.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:50 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:50.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:50.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:50.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:50 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:50.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:50.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:50.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:50 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:51 smithi119 ceph-mon[43973]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-12-14T18:22:51.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:51.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:51.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:51 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.630 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.629+0000 7f8194ff9700 1 -- 172.21.15.119:0/2626293433 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f8198061a50 con 0x7f81800a1150 2023-12-14T18:22:51.630 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 11 on host 'smithi119' 2023-12-14T18:22:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f81800a1150 msgr2=0x7f81800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f81800a1150 0x7f81800a3600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8188005950 tx=0x7f81880058e0 comp rx=0 tx=0).stop 2023-12-14T18:22:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 msgr2=0x7f8198196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 0x7f8198196040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f818c00d9b0 tx=0x7f818c00dd70 comp rx=0 tx=0).stop 2023-12-14T18:22:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 shutdown_connections 2023-12-14T18:22:51.632 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f81800a1150 0x7f81800a3600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8198101eb0 0x7f819819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8198100320 0x7f8198196040 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 --2- 172.21.15.119:0/2626293433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8198101520 0x7f8198196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 >> 172.21.15.119:0/2626293433 conn(0x7f81980fb970 msgr2=0x7f8198104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 shutdown_connections 2023-12-14T18:22:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:22:51.630+0000 7f819e1b4700 1 -- 172.21.15.119:0/2626293433 wait complete. 2023-12-14T18:22:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:51 smithi091 ceph-mon[43601]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-12-14T18:22:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:51.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:51 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:51 smithi069 ceph-mon[42047]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-12-14T18:22:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:51 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.009 DEBUG:teuthology.orchestra.run.smithi119:osd.11> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.11.service 2023-12-14T18:22:52.011 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-12-14T18:22:52.011 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-14T18:22:52.043 INFO:journalctl@ceph.osd.11.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:22:52.333 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:22:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:52 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:52 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:52 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:52 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:52.859 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:52 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:52.859 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:52 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:52.859 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:52 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:52.859 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.859 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.859 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:52 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:52.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:52 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:52.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:52 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:52.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:52 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:52.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:52.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:52 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:22:53.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 -- 172.21.15.69:0/2007549846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d80ff1e0 msgr2=0x7f11d80ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:53.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2007549846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d80ff1e0 0x7f11d80ff5f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009990 tx=0x7f11cc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 -- 172.21.15.69:0/2007549846 shutdown_connections 2023-12-14T18:22:53.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2007549846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d8100d70 0x7f11d8107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2007549846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d80ff1e0 0x7f11d80ff5f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2007549846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d81003e0 0x7f11d8100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 -- 172.21.15.69:0/2007549846 >> 172.21.15.69:0/2007549846 conn(0x7f11d80fa7f0 msgr2=0x7f11d80fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:53.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 -- 172.21.15.69:0/2007549846 shutdown_connections 2023-12-14T18:22:53.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.302+0000 7f11dca1d700 1 -- 172.21.15.69:0/2007549846 wait complete. 2023-12-14T18:22:53.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.303+0000 7f11dca1d700 1 Processor -- start 2023-12-14T18:22:53.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.303+0000 7f11dca1d700 1 -- start start 2023-12-14T18:22:53.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d80ff1e0 0x7f11d8194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:53.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 0x7f11d81953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:53.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d8100d70 0x7f11d819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d819ca20 con 0x7f11d81003e0 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d819cb60 con 0x7f11d8100d70 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d819ccf0 con 0x7f11d80ff1e0 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 0x7f11d81953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 0x7f11d81953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33882/0 (socket says 172.21.15.69:33882) 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 -- 172.21.15.69:0/2024225338 learned_addr learned my addr 172.21.15.69:0/2024225338 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d659c700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d80ff1e0 0x7f11d8194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d6d9d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d8100d70 0x7f11d819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 -- 172.21.15.69:0/2024225338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d80ff1e0 msgr2=0x7f11d8194e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d80ff1e0 0x7f11d8194e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 -- 172.21.15.69:0/2024225338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d8100d70 msgr2=0x7f11d819c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d8100d70 0x7f11d819c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 -- 172.21.15.69:0/2024225338 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc0095f0 con 0x7f11d81003e0 2023-12-14T18:22:53.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11d5d9b700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 0x7f11d81953d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11c800d980 tx=0x7f11c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:53.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80098d0 con 0x7f11d81003e0 2023-12-14T18:22:53.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11c8010460 con 0x7f11d81003e0 2023-12-14T18:22:53.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800f620 con 0x7f11d81003e0 2023-12-14T18:22:53.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d810aa60 con 0x7f11d81003e0 2023-12-14T18:22:53.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.304+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d810a8d0 con 0x7f11d81003e0 2023-12-14T18:22:53.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.305+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d8106170 con 0x7f11d81003e0 2023-12-14T18:22:53.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.306+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f11c8009a30 con 0x7f11d81003e0 2023-12-14T18:22:53.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.307+0000 7f11c77fe700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c00a1150 0x7f11c00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:53.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.307+0000 7f11d659c700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c00a1150 0x7f11c00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:53.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.307+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f11c80cc050 con 0x7f11d81003e0 2023-12-14T18:22:53.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.307+0000 7f11d659c700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c00a1150 0x7f11c00a3600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00b5c0 tx=0x7f11cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:53.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.311+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f11c8095d60 con 0x7f11d81003e0 2023-12-14T18:22:53.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.503+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f11d8066f20 con 0x7f11d81003e0 2023-12-14T18:22:53.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.503+0000 7f11c77fe700 1 -- 172.21.15.69:0/2024225338 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) v1 ==== 74+0+133 (secure 0 0 0) 0x7f11c80200a0 con 0x7f11d81003e0 2023-12-14T18:22:53.505 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.505+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c00a1150 msgr2=0x7f11c00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.505+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c00a1150 0x7f11c00a3600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00b5c0 tx=0x7f11cc005fb0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.505+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 msgr2=0x7f11d81953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.505+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 0x7f11d81953d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11c800d980 tx=0x7f11c800dc90 comp rx=0 tx=0).stop 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 shutdown_connections 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11c00a1150 0x7f11c00a3600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d8100d70 0x7f11d819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d80ff1e0 0x7f11d8194e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 --2- 172.21.15.69:0/2024225338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11d81003e0 0x7f11d81953d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 >> 172.21.15.69:0/2024225338 conn(0x7f11d80fa7f0 msgr2=0x7f11d80fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:53.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 shutdown_connections 2023-12-14T18:22:53.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:53.506+0000 7f11dca1d700 1 -- 172.21.15.69:0/2024225338 wait complete. 2023-12-14T18:22:53.549 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:22:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:22:53.196+0000 7f288f6b2640 -1 osd.11 0 log_to_monitors true 2023-12-14T18:22:53.815 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:53 smithi069 ceph-mon[42047]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-14T18:22:53.815 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:53 smithi069 ceph-mon[42047]: from='osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T18:22:53.816 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:53 smithi069 ceph-mon[42047]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T18:22:53.816 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:53 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2024225338' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T18:22:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:53 smithi119 ceph-mon[43973]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-14T18:22:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:53 smithi119 ceph-mon[43973]: from='osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T18:22:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:53 smithi119 ceph-mon[43973]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T18:22:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:53 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2024225338' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T18:22:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:53 smithi091 ceph-mon[43601]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-14T18:22:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:53 smithi091 ceph-mon[43601]: from='osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T18:22:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:53 smithi091 ceph-mon[43601]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-14T18:22:53.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:53 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2024225338' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T18:22:53.908 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1702578157,"num_in_osds":12,"osd_in_since":1702578159,"num_remapped_pgs":0} 2023-12-14T18:22:54.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:22:54.622+0000 7f2884528700 -1 osd.11 0 waiting for initial osdmap 2023-12-14T18:22:54.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:22:54.639+0000 7f2880b1e700 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-14T18:22:54.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-14T18:22:54.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: osdmap e72: 12 total, 11 up, 12 in 2023-12-14T18:22:54.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.878 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:54.878 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:54.878 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:54 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: osdmap e72: 12 total, 11 up, 12 in 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:54.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:54.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:54 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.910 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: osdmap e72: 12 total, 11 up, 12 in 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:22:54.943 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:54 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:22:55.229 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:22:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: Detected new or changed devices on smithi119 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: Adjusting osd_memory_target on smithi119 to 4278M 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: osdmap e73: 12 total, 11 up, 12 in 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:55 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: Detected new or changed devices on smithi119 2023-12-14T18:22:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: Adjusting osd_memory_target on smithi119 to 4278M 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: osdmap e73: 12 total, 11 up, 12 in 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:55.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:55 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:56.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: Detected new or changed devices on smithi119 2023-12-14T18:22:56.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: Adjusting osd_memory_target on smithi119 to 4278M 2023-12-14T18:22:56.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: osdmap e73: 12 total, 11 up, 12 in 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:56.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:55 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:56.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 -- 172.21.15.69:0/970025504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b600ff1e0 msgr2=0x7f9b600ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/970025504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b600ff1e0 0x7f9b600ff5f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009990 tx=0x7f9b54009ca0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 -- 172.21.15.69:0/970025504 shutdown_connections 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/970025504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b60100d70 0x7f9b60107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/970025504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b600ff1e0 0x7f9b600ff5f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/970025504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b601003e0 0x7f9b60100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 -- 172.21.15.69:0/970025504 >> 172.21.15.69:0/970025504 conn(0x7f9b600fa7f0 msgr2=0x7f9b600fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 -- 172.21.15.69:0/970025504 shutdown_connections 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 -- 172.21.15.69:0/970025504 wait complete. 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 Processor -- start 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.186+0000 7f9b66ea3700 1 -- start start 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b600ff1e0 0x7f9b60194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 0x7f9b60195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b60100d70 0x7f9b6019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:56.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6019c9d0 con 0x7f9b601003e0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6019cb10 con 0x7f9b60100d70 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6019cca0 con 0x7f9b600ff1e0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 0x7f9b60195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 0x7f9b60195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52498/0 (socket says 172.21.15.69:52498) 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 -- 172.21.15.69:0/3841469610 learned_addr learned my addr 172.21.15.69:0/3841469610 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b65440700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b60100d70 0x7f9b6019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b64c3f700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b600ff1e0 0x7f9b60194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 -- 172.21.15.69:0/3841469610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b600ff1e0 msgr2=0x7f9b60194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b600ff1e0 0x7f9b60194e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 -- 172.21.15.69:0/3841469610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b60100d70 msgr2=0x7f9b6019c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b60100d70 0x7f9b6019c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 -- 172.21.15.69:0/3841469610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540095f0 con 0x7f9b601003e0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5ffff700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 0x7f9b60195380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00d980 tx=0x7f9b4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c009b40 con 0x7f9b601003e0 2023-12-14T18:22:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6010a9e0 con 0x7f9b601003e0 2023-12-14T18:22:56.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b4c00b6e0 con 0x7f9b601003e0 2023-12-14T18:22:56.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.187+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00f3c0 con 0x7f9b601003e0 2023-12-14T18:22:56.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.188+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6010a850 con 0x7f9b601003e0 2023-12-14T18:22:56.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.189+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b60069a70 con 0x7f9b601003e0 2023-12-14T18:22:56.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.189+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9b4c010460 con 0x7f9b601003e0 2023-12-14T18:22:56.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.190+0000 7f9b5dffb700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9b500a1150 0x7f9b500a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:56.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.190+0000 7f9b64c3f700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9b500a1150 0x7f9b500a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:56.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.190+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9b4c0cc320 con 0x7f9b601003e0 2023-12-14T18:22:56.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.190+0000 7f9b64c3f700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9b500a1150 0x7f9b500a3600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400b5c0 tx=0x7f9b54005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:56.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.194+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9b4c095f10 con 0x7f9b601003e0 2023-12-14T18:22:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.385+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9b60069c30 con 0x7f9b601003e0 2023-12-14T18:22:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.386+0000 7f9b5dffb700 1 -- 172.21.15.69:0/3841469610 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9b4c099530 con 0x7f9b601003e0 2023-12-14T18:22:56.388 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9b500a1150 msgr2=0x7f9b500a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9b500a1150 0x7f9b500a3600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400b5c0 tx=0x7f9b54005fb0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 msgr2=0x7f9b60195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 0x7f9b60195380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00d980 tx=0x7f9b4c00dc90 comp rx=0 tx=0).stop 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 shutdown_connections 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9b500a1150 0x7f9b500a3600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b60100d70 0x7f9b6019c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b600ff1e0 0x7f9b60194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 --2- 172.21.15.69:0/3841469610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b601003e0 0x7f9b60195380 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:56.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 >> 172.21.15.69:0/3841469610 conn(0x7f9b600fa7f0 msgr2=0x7f9b601039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:56.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 shutdown_connections 2023-12-14T18:22:56.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:56.388+0000 7f9b66ea3700 1 -- 172.21.15.69:0/3841469610 wait complete. 2023-12-14T18:22:56.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:56 smithi069 ceph-mon[42047]: purged_snaps scrub starts 2023-12-14T18:22:56.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:56 smithi069 ceph-mon[42047]: purged_snaps scrub ok 2023-12-14T18:22:56.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:56 smithi069 ceph-mon[42047]: osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] boot 2023-12-14T18:22:56.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:56 smithi069 ceph-mon[42047]: osdmap e74: 12 total, 12 up, 12 in 2023-12-14T18:22:56.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:56 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:56.682 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:56 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3841469610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T18:22:56.758 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1702578175,"num_in_osds":12,"osd_in_since":1702578159,"num_remapped_pgs":0} 2023-12-14T18:22:56.758 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-14T18:22:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:22:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:56 smithi119 ceph-mon[43973]: purged_snaps scrub starts 2023-12-14T18:22:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:56 smithi119 ceph-mon[43973]: purged_snaps scrub ok 2023-12-14T18:22:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:56 smithi119 ceph-mon[43973]: osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] boot 2023-12-14T18:22:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:56 smithi119 ceph-mon[43973]: osdmap e74: 12 total, 12 up, 12 in 2023-12-14T18:22:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:56 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:57.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:56 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3841469610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T18:22:57.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:56 smithi091 ceph-mon[43601]: purged_snaps scrub starts 2023-12-14T18:22:57.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:56 smithi091 ceph-mon[43601]: purged_snaps scrub ok 2023-12-14T18:22:57.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:56 smithi091 ceph-mon[43601]: osd.11 [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] boot 2023-12-14T18:22:57.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:56 smithi091 ceph-mon[43601]: osdmap e74: 12 total, 12 up, 12 in 2023-12-14T18:22:57.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:56 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-14T18:22:57.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:56 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3841469610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-14T18:22:57.913 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:57 smithi069 ceph-mon[42047]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-12-14T18:22:57.913 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:57 smithi069 ceph-mon[42047]: osdmap e75: 12 total, 12 up, 12 in 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 -- 172.21.15.69:0/2583021889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 msgr2=0x7f1a200ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/2583021889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a200ff840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a100099c0 tx=0x7f1a10009cd0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 -- 172.21.15.69:0/2583021889 shutdown_connections 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/2583021889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a20104510 0x7f1a2010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/2583021889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a200ff840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/2583021889 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a200ffe10 0x7f1a20103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 -- 172.21.15.69:0/2583021889 >> 172.21.15.69:0/2583021889 conn(0x7f1a200770d0 msgr2=0x7f1a200774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:58.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 -- 172.21.15.69:0/2583021889 shutdown_connections 2023-12-14T18:22:58.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 -- 172.21.15.69:0/2583021889 wait complete. 2023-12-14T18:22:58.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.085+0000 7f1a24b5b700 1 Processor -- start 2023-12-14T18:22:58.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 -- start start 2023-12-14T18:22:58.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a20100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:58.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a200ffe10 0x7f1a201013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a20104510 0x7f1a20101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201a46d0 con 0x7f1a200ff470 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201a4840 con 0x7f1a20104510 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a24b5b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201a4a00 con 0x7f1a200ffe10 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a20100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a20100e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52526/0 (socket says 172.21.15.69:52526) 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 -- 172.21.15.69:0/206574704 learned_addr learned my addr 172.21.15.69:0/206574704 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1dd9b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a200ffe10 0x7f1a201013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1ed9d700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a20104510 0x7f1a20101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 -- 172.21.15.69:0/206574704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a200ffe10 msgr2=0x7f1a201013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a200ffe10 0x7f1a201013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 -- 172.21.15.69:0/206574704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a20104510 msgr2=0x7f1a20101940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a20104510 0x7f1a20101940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 -- 172.21.15.69:0/206574704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100095f0 con 0x7f1a200ff470 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.086+0000 7f1a1e59c700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a20100e80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a10005910 tx=0x7f1a1000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:58.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.087+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1001d070 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.087+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a100054e0 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.087+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2010f100 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.087+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10004ab0 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.087+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2010ef70 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.088+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2010f290 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.089+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1a1000fb80 con 0x7f1a200ff470 2023-12-14T18:22:58.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.089+0000 7f1a0f7fe700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1a080a1150 0x7f1a080a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:58.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.089+0000 7f1a1dd9b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1a080a1150 0x7f1a080a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:58.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.089+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1a100cd2b0 con 0x7f1a200ff470 2023-12-14T18:22:58.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.090+0000 7f1a1dd9b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1a080a1150 0x7f1a080a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a20102670 tx=0x7f1a14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:58.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.093+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1a10096f30 con 0x7f1a200ff470 2023-12-14T18:22:58.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:57 smithi119 ceph-mon[43973]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-12-14T18:22:58.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:57 smithi119 ceph-mon[43973]: osdmap e75: 12 total, 12 up, 12 in 2023-12-14T18:22:58.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:57 smithi091 ceph-mon[43601]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-12-14T18:22:58.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:57 smithi091 ceph-mon[43601]: osdmap e75: 12 total, 12 up, 12 in 2023-12-14T18:22:58.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.284+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a20066ea0 con 0x7f1a200ff470 2023-12-14T18:22:58.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.285+0000 7f1a0f7fe700 1 -- 172.21.15.69:0/206574704 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18385 (secure 0 0 0) 0x7f1a1009a550 con 0x7f1a200ff470 2023-12-14T18:22:58.287 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:22:58.287 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":75,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:22:56.628514+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:22:58.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1a080a1150 msgr2=0x7f1a080a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:58.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1a080a1150 0x7f1a080a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a20102670 tx=0x7f1a14009260 comp rx=0 tx=0).stop 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 msgr2=0x7f1a20100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a20100e80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a10005910 tx=0x7f1a1000f690 comp rx=0 tx=0).stop 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 shutdown_connections 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1a080a1150 0x7f1a080a3600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a20104510 0x7f1a20101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a200ff470 0x7f1a20100e80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 --2- 172.21.15.69:0/206574704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a200ffe10 0x7f1a201013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 >> 172.21.15.69:0/206574704 conn(0x7f1a200770d0 msgr2=0x7f1a20068ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 shutdown_connections 2023-12-14T18:22:58.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:58.287+0000 7f1a24b5b700 1 -- 172.21.15.69:0/206574704 wait complete. 2023-12-14T18:22:58.682 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:22:58.682 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-14T18:22:58.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:58 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/206574704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:22:58.989 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:22:59.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:58 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/206574704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:22:59.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:58 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/206574704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:22:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:22:59 smithi069 ceph-mon[42047]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 -- 172.21.15.69:0/175370224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 msgr2=0x7feae00ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 --2- 172.21.15.69:0/175370224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae00ff840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fead00099c0 tx=0x7fead0009cd0 comp rx=0 tx=0).stop 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 -- 172.21.15.69:0/175370224 shutdown_connections 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 --2- 172.21.15.69:0/175370224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae0104510 0x7feae010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 --2- 172.21.15.69:0/175370224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae00ff840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 --2- 172.21.15.69:0/175370224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae00ffe10 0x7feae0103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 -- 172.21.15.69:0/175370224 >> 172.21.15.69:0/175370224 conn(0x7feae00770d0 msgr2=0x7feae00774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.970+0000 7feae642b700 1 -- 172.21.15.69:0/175370224 shutdown_connections 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.971+0000 7feae642b700 1 -- 172.21.15.69:0/175370224 wait complete. 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.971+0000 7feae642b700 1 Processor -- start 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.971+0000 7feae642b700 1 -- start start 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:59.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae00ffe10 0x7feae01977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae0104510 0x7feae01a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01a2830 con 0x7feae00ff470 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01a2970 con 0x7feae0104510 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01a2ab0 con 0x7feae00ffe10 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae0197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52538/0 (socket says 172.21.15.69:52538) 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 -- 172.21.15.69:0/4230388513 learned_addr learned my addr 172.21.15.69:0/4230388513 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadf7fe700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae00ffe10 0x7feae01977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae49c8700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae0104510 0x7feae01a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 -- 172.21.15.69:0/4230388513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae00ffe10 msgr2=0x7feae01977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae00ffe10 0x7feae01977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 -- 172.21.15.69:0/4230388513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae0104510 msgr2=0x7feae01a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae0104510 0x7feae01a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 -- 172.21.15.69:0/4230388513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00095f0 con 0x7feae00ff470 2023-12-14T18:22:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadf7fe700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae00ffe10 0x7feae01977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:22:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadffff700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae0197270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fead0009990 tx=0x7fead00038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead001d070 con 0x7feae00ff470 2023-12-14T18:22:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fead0004210 con 0x7feae00ff470 2023-12-14T18:22:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae010f1f0 con 0x7feae00ff470 2023-12-14T18:22:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0022e30 con 0x7feae00ff470 2023-12-14T18:22:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.972+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae010f060 con 0x7feae00ff470 2023-12-14T18:22:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.973+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae010f380 con 0x7feae00ff470 2023-12-14T18:22:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.974+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fead0022600 con 0x7feae00ff470 2023-12-14T18:22:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.975+0000 7feadd7fa700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feac80a11d0 0x7feac80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:22:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.975+0000 7feadf7fe700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feac80a11d0 0x7feac80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:22:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.975+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fead00cdf00 con 0x7feae00ff470 2023-12-14T18:22:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.975+0000 7feadf7fe700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feac80a11d0 0x7feac80a3680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feae0069f20 tx=0x7fead4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:22:59.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:22:59.978+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fead0097ae0 con 0x7feae00ff470 2023-12-14T18:23:00.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:22:59 smithi119 ceph-mon[43973]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:00.224 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:22:59 smithi091 ceph-mon[43601]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:00.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.164+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feae01a33e0 con 0x7feae00ff470 2023-12-14T18:23:00.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.164+0000 7feadd7fa700 1 -- 172.21.15.69:0/4230388513 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fead009b100 con 0x7feae00ff470 2023-12-14T18:23:00.224 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feac80a11d0 msgr2=0x7feac80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feac80a11d0 0x7feac80a3680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feae0069f20 tx=0x7fead4008040 comp rx=0 tx=0).stop 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 msgr2=0x7feae0197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae0197270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fead0009990 tx=0x7fead00038d0 comp rx=0 tx=0).stop 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 shutdown_connections 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feac80a11d0 0x7feac80a3680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae0104510 0x7feae01a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae00ff470 0x7feae0197270 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 --2- 172.21.15.69:0/4230388513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feae00ffe10 0x7feae01977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 >> 172.21.15.69:0/4230388513 conn(0x7feae00770d0 msgr2=0x7feae00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 shutdown_connections 2023-12-14T18:23:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:00.166+0000 7feae642b700 1 -- 172.21.15.69:0/4230388513 wait complete. 2023-12-14T18:23:00.499 INFO:tasks.cephadm:Adding mds.a on smithi069 2023-12-14T18:23:00.499 INFO:tasks.cephadm:Adding mds.d on smithi069 2023-12-14T18:23:00.499 INFO:tasks.cephadm:Adding mds.g on smithi069 2023-12-14T18:23:00.499 INFO:tasks.cephadm:Adding mds.j on smithi069 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.b on smithi091 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.e on smithi091 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.h on smithi091 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.k on smithi091 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.c on smithi119 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.f on smithi119 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.i on smithi119 2023-12-14T18:23:00.500 INFO:tasks.cephadm:Adding mds.l on smithi119 2023-12-14T18:23:00.500 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph orch apply mds all '12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l' 2023-12-14T18:23:00.830 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:23:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:00 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4230388513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:00.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:00 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4230388513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:01.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:00 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4230388513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:01.930 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.926+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3906828150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb140ff1e0 msgr2=0x7ffb140ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.926+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3906828150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb140ff1e0 0x7ffb140ff5f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009990 tx=0x7ffb10009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3906828150 shutdown_connections 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3906828150 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb14100d70 0x7ffb14107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3906828150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb140ff1e0 0x7ffb140ff5f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3906828150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb141003e0 0x7ffb14100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3906828150 >> 172.21.15.119:0/3906828150 conn(0x7ffb140fa7f0 msgr2=0x7ffb140fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3906828150 shutdown_connections 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3906828150 wait complete. 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 Processor -- start 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- start start 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb140ff1e0 0x7ffb14194c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:01.931 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb141003e0 0x7ffb14195190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 0x7ffb1419c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1419c7a0 con 0x7ffb141003e0 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1419c8e0 con 0x7ffb140ff1e0 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.927+0000 7ffb1c3ed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1419caa0 con 0x7ffb14100d70 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 0x7ffb1419c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 0x7ffb1419c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41812/0 (socket says 172.21.15.119:41812) 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 -- 172.21.15.119:0/3563010935 learned_addr learned my addr 172.21.15.119:0/3563010935 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb19988700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb141003e0 0x7ffb14195190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a189700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb140ff1e0 0x7ffb14194c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 -- 172.21.15.119:0/3563010935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb140ff1e0 msgr2=0x7ffb14194c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:01.932 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb140ff1e0 0x7ffb14194c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 -- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb141003e0 msgr2=0x7ffb14195190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb141003e0 0x7ffb14195190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 -- 172.21.15.119:0/3563010935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100095f0 con 0x7ffb14100d70 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1a98a700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 0x7ffb1419c1d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00cfb0 tx=0x7ffb0c00e330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c011070 con 0x7ffb14100d70 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1410a9e0 con 0x7ffb14100d70 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb0c007b30 con 0x7ffb14100d70 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00ace0 con 0x7ffb14100d70 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.928+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1410a850 con 0x7ffb14100d70 2023-12-14T18:23:01.933 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.929+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb140692a0 con 0x7ffb14100d70 2023-12-14T18:23:01.934 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.930+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ffb0c00e980 con 0x7ffb14100d70 2023-12-14T18:23:01.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.931+0000 7ffb0b7fe700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb000a1150 0x7ffb000a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:01.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.931+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffb0c0ce680 con 0x7ffb14100d70 2023-12-14T18:23:01.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.931+0000 7ffb1a189700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb000a1150 0x7ffb000a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:01.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.931+0000 7ffb1a189700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb000a1150 0x7ffb000a3600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006010 tx=0x7ffb1000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:01.935 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:01.934+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ffb0c098270 con 0x7ffb14100d70 2023-12-14T18:23:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:01 smithi069 ceph-mon[42047]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:02.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:01 smithi119 ceph-mon[43973]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:02.131 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.130+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb14060f30 con 0x7ffb000a1150 2023-12-14T18:23:02.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:01 smithi091 ceph-mon[43601]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:02.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.138+0000 7ffb0b7fe700 1 -- 172.21.15.119:0/3563010935 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ffb14060f30 con 0x7ffb000a1150 2023-12-14T18:23:02.139 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mds.all update... 2023-12-14T18:23:02.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb000a1150 msgr2=0x7ffb000a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb000a1150 0x7ffb000a3600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006010 tx=0x7ffb1000b540 comp rx=0 tx=0).stop 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 msgr2=0x7ffb1419c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 0x7ffb1419c1d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00cfb0 tx=0x7ffb0c00e330 comp rx=0 tx=0).stop 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 shutdown_connections 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ffb000a1150 0x7ffb000a3600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb14100d70 0x7ffb1419c1d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb140ff1e0 0x7ffb14194c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 --2- 172.21.15.119:0/3563010935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb141003e0 0x7ffb14195190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.140+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 >> 172.21.15.119:0/3563010935 conn(0x7ffb140fa7f0 msgr2=0x7ffb140fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:02.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.141+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 shutdown_connections 2023-12-14T18:23:02.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-14T18:23:02.141+0000 7ffb1c3ed700 1 -- 172.21.15.119:0/3563010935 wait complete. 2023-12-14T18:23:02.560 DEBUG:teuthology.orchestra.run.smithi069:mds.a> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.a.service 2023-12-14T18:23:02.563 DEBUG:teuthology.orchestra.run.smithi069:mds.d> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.d.service 2023-12-14T18:23:02.592 INFO:journalctl@ceph.mds.a.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:23:02.593 DEBUG:teuthology.orchestra.run.smithi069:mds.g> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.g.service 2023-12-14T18:23:02.621 INFO:journalctl@ceph.mds.d.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:23:02.622 DEBUG:teuthology.orchestra.run.smithi069:mds.j> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.j.service 2023-12-14T18:23:02.647 INFO:journalctl@ceph.mds.g.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:23:02.648 DEBUG:teuthology.orchestra.run.smithi091:mds.b> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.b.service 2023-12-14T18:23:02.651 DEBUG:teuthology.orchestra.run.smithi091:mds.e> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.e.service 2023-12-14T18:23:02.675 INFO:journalctl@ceph.mds.j.smithi069.stdout:-- Logs begin at Thu 2023-12-14 18:04:56 UTC. -- 2023-12-14T18:23:02.689 INFO:journalctl@ceph.mds.b.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:23:02.690 DEBUG:teuthology.orchestra.run.smithi091:mds.h> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.h.service 2023-12-14T18:23:02.720 INFO:journalctl@ceph.mds.e.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:23:02.721 DEBUG:teuthology.orchestra.run.smithi091:mds.k> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.k.service 2023-12-14T18:23:02.748 INFO:journalctl@ceph.mds.h.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:23:02.750 DEBUG:teuthology.orchestra.run.smithi119:mds.c> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.c.service 2023-12-14T18:23:02.752 DEBUG:teuthology.orchestra.run.smithi119:mds.f> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.f.service 2023-12-14T18:23:02.776 INFO:journalctl@ceph.mds.k.smithi091.stdout:-- Logs begin at Thu 2023-12-14 18:04:45 UTC. -- 2023-12-14T18:23:02.784 INFO:journalctl@ceph.mds.c.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:23:02.785 DEBUG:teuthology.orchestra.run.smithi119:mds.i> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.i.service 2023-12-14T18:23:02.811 INFO:journalctl@ceph.mds.f.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:23:02.812 DEBUG:teuthology.orchestra.run.smithi119:mds.l> sudo journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.l.service 2023-12-14T18:23:02.838 INFO:journalctl@ceph.mds.i.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:23:02.839 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-12-14T18:23:02.840 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:23:02.864 INFO:journalctl@ceph.mds.l.smithi119.stdout:-- Logs begin at Thu 2023-12-14 18:04:47 UTC. -- 2023-12-14T18:23:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 -- 172.21.15.69:0/3788582625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac500fe330 msgr2=0x7fac500fe780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 --2- 172.21.15.69:0/3788582625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac500fe330 0x7fac500fe780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac44009990 tx=0x7fac44009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 -- 172.21.15.69:0/3788582625 shutdown_connections 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 --2- 172.21.15.69:0/3788582625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac500fecc0 0x7fac501088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 --2- 172.21.15.69:0/3788582625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac501018c0 0x7fac50101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 --2- 172.21.15.69:0/3788582625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac500fe330 0x7fac500fe780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 -- 172.21.15.69:0/3788582625 >> 172.21.15.69:0/3788582625 conn(0x7fac500f9f80 msgr2=0x7fac500fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 -- 172.21.15.69:0/3788582625 shutdown_connections 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 -- 172.21.15.69:0/3788582625 wait complete. 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.969+0000 7fac55a12700 1 Processor -- start 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 -- start start 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac500fe330 0x7fac50195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac500fecc0 0x7fac50196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac501018c0 0x7fac5019d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5019da90 con 0x7fac501018c0 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5019dbd0 con 0x7fac500fe330 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5019dd60 con 0x7fac500fecc0 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac500fecc0 0x7fac50196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac501018c0 0x7fac5019d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac500fecc0 0x7fac50196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:37512/0 (socket says 172.21.15.69:37512) 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4e7fc700 1 -- 172.21.15.69:0/1104706618 learned_addr learned my addr 172.21.15.69:0/1104706618 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4effd700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac500fe330 0x7fac50195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 -- 172.21.15.69:0/1104706618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac500fecc0 msgr2=0x7fac50196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac500fecc0 0x7fac50196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 -- 172.21.15.69:0/1104706618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac500fe330 msgr2=0x7fac50195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac500fe330 0x7fac50195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:02.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 -- 172.21.15.69:0/1104706618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440095f0 con 0x7fac501018c0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac4f7fe700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac501018c0 0x7fac5019d4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac4800be20 tx=0x7fac48009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800cb90 con 0x7fac501018c0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.970+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5010bb20 con 0x7fac501018c0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.971+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac4800ccf0 con 0x7fac501018c0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.971+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480125a0 con 0x7fac501018c0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.971+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5010b990 con 0x7fac501018c0 2023-12-14T18:23:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.971+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac50107390 con 0x7fac501018c0 2023-12-14T18:23:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.973+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fac48014440 con 0x7fac501018c0 2023-12-14T18:23:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.973+0000 7fac54a10700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac380a1150 0x7fac380a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.973+0000 7fac4effd700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac380a1150 0x7fac380a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.973+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fac48006e40 con 0x7fac501018c0 2023-12-14T18:23:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.974+0000 7fac4effd700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac380a1150 0x7fac380a3600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac50068d70 tx=0x7fac40007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:02.977+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fac48095d30 con 0x7fac501018c0 2023-12-14T18:23:03.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.169+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac50061700 con 0x7fac501018c0 2023-12-14T18:23:03.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.170+0000 7fac54a10700 1 -- 172.21.15.69:0/1104706618 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18385 (secure 0 0 0) 0x7fac4800ce60 con 0x7fac501018c0 2023-12-14T18:23:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:03.171 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":75,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:22:56.628514+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:03.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac380a1150 msgr2=0x7fac380a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac380a1150 0x7fac380a3600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac50068d70 tx=0x7fac40007400 comp rx=0 tx=0).stop 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac501018c0 msgr2=0x7fac5019d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac501018c0 0x7fac5019d4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac4800be20 tx=0x7fac48009ed0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 shutdown_connections 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac380a1150 0x7fac380a3600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac501018c0 0x7fac5019d4c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac500fe330 0x7fac50195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 --2- 172.21.15.69:0/1104706618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac500fecc0 0x7fac50196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 >> 172.21.15.69:0/1104706618 conn(0x7fac500f9f80 msgr2=0x7fac500fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.172+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 shutdown_connections 2023-12-14T18:23:03.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.173+0000 7fac55a12700 1 -- 172.21.15.69:0/1104706618 wait complete. 2023-12-14T18:23:03.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:23:03.186 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 -- 172.21.15.69:0/2232092894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba780ff120 msgr2=0x7fba780ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 --2- 172.21.15.69:0/2232092894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba780ff120 0x7fba780ff530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba68009990 tx=0x7fba68009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 -- 172.21.15.69:0/2232092894 shutdown_connections 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 --2- 172.21.15.69:0/2232092894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba78100ca0 0x7fba78107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 --2- 172.21.15.69:0/2232092894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba780ff120 0x7fba780ff530 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 --2- 172.21.15.69:0/2232092894 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba78100310 0x7fba78100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 -- 172.21.15.69:0/2232092894 >> 172.21.15.69:0/2232092894 conn(0x7fba780fa740 msgr2=0x7fba780fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 -- 172.21.15.69:0/2232092894 shutdown_connections 2023-12-14T18:23:03.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.310+0000 7fba7db6e700 1 -- 172.21.15.69:0/2232092894 wait complete. 2023-12-14T18:23:03.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 Processor -- start 2023-12-14T18:23:03.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 -- start start 2023-12-14T18:23:03.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba780ff120 0x7fba78068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 0x7fba7819ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba78100ca0 0x7fba7819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7819db10 con 0x7fba78100310 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7819dc80 con 0x7fba780ff120 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba7db6e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7819de40 con 0x7fba78100ca0 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 0x7fba7819ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 0x7fba7819ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52574/0 (socket says 172.21.15.69:52574) 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 -- 172.21.15.69:0/1260810079 learned_addr learned my addr 172.21.15.69:0/1260810079 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba77fff700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba78100ca0 0x7fba7819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba777fe700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba780ff120 0x7fba78068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 -- 172.21.15.69:0/1260810079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba78100ca0 msgr2=0x7fba7819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba78100ca0 0x7fba7819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 -- 172.21.15.69:0/1260810079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba780ff120 msgr2=0x7fba78068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba780ff120 0x7fba78068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 -- 172.21.15.69:0/1260810079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680095f0 con 0x7fba78100310 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba777fe700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba780ff120 0x7fba78068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.311+0000 7fba76ffd700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 0x7fba7819ad30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba6000e9a0 tx=0x7fba6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.312+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60009790 con 0x7fba78100310 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.312+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba6000cbd0 con 0x7fba78100310 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.312+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7810a9c0 con 0x7fba78100310 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.312+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60018680 con 0x7fba78100310 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.312+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7810a830 con 0x7fba78100310 2023-12-14T18:23:03.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.313+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba781067e0 con 0x7fba78100310 2023-12-14T18:23:03.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.314+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fba6000cd40 con 0x7fba78100310 2023-12-14T18:23:03.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.314+0000 7fba74ff9700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fba640a1150 0x7fba640a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.314+0000 7fba777fe700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fba640a1150 0x7fba640a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.314+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fba60014070 con 0x7fba78100310 2023-12-14T18:23:03.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.315+0000 7fba777fe700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fba640a1150 0x7fba640a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fba6800b2e0 tx=0x7fba68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:03.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.318+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fba60051730 con 0x7fba78100310 2023-12-14T18:23:03.439 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:03.439 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T18:23:03.439 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:03.439 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:03.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:03 smithi119 ceph-mon[43973]: Deploying daemon mds.l on smithi119 2023-12-14T18:23:03.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:03.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T18:23:03.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:03.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:03.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:03.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:03 smithi069 ceph-mon[42047]: Deploying daemon mds.l on smithi119 2023-12-14T18:23:03.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.505+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba780679f0 con 0x7fba78100310 2023-12-14T18:23:03.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.506+0000 7fba74ff9700 1 -- 172.21.15.69:0/1260810079 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba60099e30 con 0x7fba78100310 2023-12-14T18:23:03.507 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fba640a1150 msgr2=0x7fba640a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fba640a1150 0x7fba640a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fba6800b2e0 tx=0x7fba68005fb0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 msgr2=0x7fba7819ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 0x7fba7819ad30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba6000e9a0 tx=0x7fba6000ed60 comp rx=0 tx=0).stop 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 shutdown_connections 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fba640a1150 0x7fba640a3600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba78100ca0 0x7fba7819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba780ff120 0x7fba78068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 --2- 172.21.15.69:0/1260810079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba78100310 0x7fba7819ad30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 >> 172.21.15.69:0/1260810079 conn(0x7fba780fa740 msgr2=0x7fba78103920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 shutdown_connections 2023-12-14T18:23:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.508+0000 7fba7db6e700 1 -- 172.21.15.69:0/1260810079 wait complete. 2023-12-14T18:23:03.521 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:23:03.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:23:03.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:03.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:03.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:03.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:03.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:03 smithi091 ceph-mon[43601]: Deploying daemon mds.l on smithi119 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1920883807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4100ca0 msgr2=0x7f29b4103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1920883807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4100ca0 0x7f29b4103080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009990 tx=0x7f29b0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1920883807 shutdown_connections 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1920883807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b4105ee0 0x7f29b4108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1920883807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4100ca0 0x7f29b4103080 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1920883807 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29b41035c0 0x7f29b41059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1920883807 >> 172.21.15.69:0/1920883807 conn(0x7f29b40fa700 msgr2=0x7f29b40fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1920883807 shutdown_connections 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.641+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1920883807 wait complete. 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 Processor -- start 2023-12-14T18:23:03.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 -- start start 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b4100ca0 0x7f29b4100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29b41035c0 0x7f29b40fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 0x7f29b40ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ff930 con 0x7f29b4105ee0 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ffaa0 con 0x7f29b41035c0 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b419fee0 con 0x7f29b4100ca0 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 0x7f29b40ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 0x7f29b40ff190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52588/0 (socket says 172.21.15.69:52588) 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 -- 172.21.15.69:0/1332816518 learned_addr learned my addr 172.21.15.69:0/1332816518 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29b9bc6700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b4100ca0 0x7f29b4100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 -- 172.21.15.69:0/1332816518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b4100ca0 msgr2=0x7f29b4100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b4100ca0 0x7f29b4100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 -- 172.21.15.69:0/1332816518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29b41035c0 msgr2=0x7f29b40fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29b93c5700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29b41035c0 0x7f29b40fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29b41035c0 0x7f29b40fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 -- 172.21.15.69:0/1332816518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00095f0 con 0x7f29b4105ee0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29ba3c7700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 0x7f29b40ff190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00ef30 tx=0x7f29ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac018070 con 0x7f29b4105ee0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b410ba30 con 0x7f29b4105ee0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29ac00f040 con 0x7f29b4105ee0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.642+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00cc70 con 0x7f29b4105ee0 2023-12-14T18:23:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.643+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b410b8a0 con 0x7f29b4105ee0 2023-12-14T18:23:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.643+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40fc270 con 0x7f29b4105ee0 2023-12-14T18:23:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.644+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f29ac003a00 con 0x7f29b4105ee0 2023-12-14T18:23:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.645+0000 7f29aaffd700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29a00a1150 0x7f29a00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.645+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29ac0cc5c0 con 0x7f29b4105ee0 2023-12-14T18:23:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.645+0000 7f29b9bc6700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29a00a1150 0x7f29a00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.645+0000 7f29b9bc6700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29a00a1150 0x7f29a00a3600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29b0006010 tx=0x7f29b0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.648+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f29ac096240 con 0x7f29b4105ee0 2023-12-14T18:23:03.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.886+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b4061930 con 0x7f29b4105ee0 2023-12-14T18:23:03.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.886+0000 7f29aaffd700 1 -- 172.21.15.69:0/1332816518 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f29ac099860 con 0x7f29b4105ee0 2023-12-14T18:23:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:03.888 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29a00a1150 msgr2=0x7f29a00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29a00a1150 0x7f29a00a3600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29b0006010 tx=0x7f29b0005960 comp rx=0 tx=0).stop 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 msgr2=0x7f29b40ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 0x7f29b40ff190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00ef30 tx=0x7f29ac00c3a0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 shutdown_connections 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29a00a1150 0x7f29a00a3600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29b4105ee0 0x7f29b40ff190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b4100ca0 0x7f29b4100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 --2- 172.21.15.69:0/1332816518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29b41035c0 0x7f29b40fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 >> 172.21.15.69:0/1332816518 conn(0x7f29b40fa700 msgr2=0x7f29b4101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 shutdown_connections 2023-12-14T18:23:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:03.889+0000 7f29bbe2a700 1 -- 172.21.15.69:0/1332816518 wait complete. 2023-12-14T18:23:03.891 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 1 2023-12-14T18:23:04.126 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:23:03 smithi119 systemd[1]: Starting Ceph mds.l for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:04.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:04 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1104706618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:04.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:04 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1260810079' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:04.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:04 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1332816518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:04.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:04 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1104706618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:04.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:04 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1260810079' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:04.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:04 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1332816518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:04.626 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:23:04 smithi119 ceph-mds[68984]: -- 172.21.15.119:0/2754098419 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55af8ea51520 con 0x55af8ea26800 2023-12-14T18:23:04.626 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:23:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-l[68961]: starting mds.l at 2023-12-14T18:23:04.626 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:23:04 smithi119 bash[68946]: 03ed600b9839960c0dd8582996acd62128ef7035d39958629747bb9893c75893 2023-12-14T18:23:04.626 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:23:04 smithi119 systemd[1]: Started Ceph mds.l for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:04.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:04 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1104706618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:04.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:04 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1260810079' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:04.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:04 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1332816518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6832/4104371233,v1:172.21.15.119:6833/4104371233] up:boot 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: fsmap 1 up:standby 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.526 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.527 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:05.527 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:05.527 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:05.527 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:05 smithi091 ceph-mon[43601]: Deploying daemon mds.k on smithi091 2023-12-14T18:23:05.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:05.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6832/4104371233,v1:172.21.15.119:6833/4104371233] up:boot 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: fsmap 1 up:standby 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:05.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:05.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:05.627 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:05 smithi119 ceph-mon[43973]: Deploying daemon mds.k on smithi091 2023-12-14T18:23:05.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6832/4104371233,v1:172.21.15.119:6833/4104371233] up:boot 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: fsmap 1 up:standby 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:05.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:05 smithi069 ceph-mon[42047]: Deploying daemon mds.k on smithi091 2023-12-14T18:23:05.883 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:23:05 smithi091 systemd[1]: Starting Ceph mds.k for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:05.903 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 -- 172.21.15.69:0/955504897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66841035b0 msgr2=0x7f6684105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 --2- 172.21.15.69:0/955504897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66841035b0 0x7f6684105990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6680009990 tx=0x7f6680009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 -- 172.21.15.69:0/955504897 shutdown_connections 2023-12-14T18:23:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 --2- 172.21.15.69:0/955504897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6684105ed0 0x7f6684108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 --2- 172.21.15.69:0/955504897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6684100c90 0x7f6684103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 --2- 172.21.15.69:0/955504897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66841035b0 0x7f6684105990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 -- 172.21.15.69:0/955504897 >> 172.21.15.69:0/955504897 conn(0x7f66840fa6f0 msgr2=0x7f66840fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 -- 172.21.15.69:0/955504897 shutdown_connections 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.038+0000 7f668b846700 1 -- 172.21.15.69:0/955504897 wait complete. 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 Processor -- start 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 -- start start 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 0x7f6684195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66841035b0 0x7f6684196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6684105ed0 0x7f668419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668419d9c0 con 0x7f6684100c90 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668419db00 con 0x7f6684105ed0 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f668b846700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668419dc90 con 0x7f66841035b0 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 0x7f6684195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 0x7f6684195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51344/0 (socket says 172.21.15.69:51344) 2023-12-14T18:23:06.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 -- 172.21.15.69:0/3819493868 learned_addr learned my addr 172.21.15.69:0/3819493868 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f6689de3700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6684105ed0 0x7f668419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f6688de1700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66841035b0 0x7f6684196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 -- 172.21.15.69:0/3819493868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66841035b0 msgr2=0x7f6684196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66841035b0 0x7f6684196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 -- 172.21.15.69:0/3819493868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6684105ed0 msgr2=0x7f668419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6684105ed0 0x7f668419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.039+0000 7f66895e2700 1 -- 172.21.15.69:0/3819493868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800095f0 con 0x7f6684100c90 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.040+0000 7f66895e2700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 0x7f6684195e40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f667800c920 tx=0x7f667800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.040+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678007b00 con 0x7f6684100c90 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.040+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f667800ce70 con 0x7f6684100c90 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.040+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668410ba80 con 0x7f6684100c90 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.040+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678005440 con 0x7f6684100c90 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.040+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668410b8f0 con 0x7f6684100c90 2023-12-14T18:23:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.041+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840fc260 con 0x7f6684100c90 2023-12-14T18:23:06.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.042+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f66780055a0 con 0x7f6684100c90 2023-12-14T18:23:06.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.043+0000 7f66767fc700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f66700a11d0 0x7f66700a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:06.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.043+0000 7f6688de1700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f66700a11d0 0x7f66700a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:06.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.043+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f66780cc3c0 con 0x7f6684100c90 2023-12-14T18:23:06.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.043+0000 7f6688de1700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f66700a11d0 0x7f66700a3680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6680006010 tx=0x7f668000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:06.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.046+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6678096030 con 0x7f6684100c90 2023-12-14T18:23:06.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.294+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6684061900 con 0x7f6684100c90 2023-12-14T18:23:06.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.296+0000 7f66767fc700 1 -- 172.21.15.69:0/3819493868 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2014 (secure 0 0 0) 0x7f667801d090 con 0x7f6684100c90 2023-12-14T18:23:06.297 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:06.297 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.298+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f66700a11d0 msgr2=0x7f66700a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.298+0000 7f668b846700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f66700a11d0 0x7f66700a3680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6680006010 tx=0x7f668000b260 comp rx=0 tx=0).stop 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.298+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 msgr2=0x7f6684195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.298+0000 7f668b846700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 0x7f6684195e40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f667800c920 tx=0x7f667800cc30 comp rx=0 tx=0).stop 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 shutdown_connections 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f66700a11d0 0x7f66700a3680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6684105ed0 0x7f668419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6684100c90 0x7f6684195e40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 --2- 172.21.15.69:0/3819493868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66841035b0 0x7f6684196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 >> 172.21.15.69:0/3819493868 conn(0x7f66840fa6f0 msgr2=0x7f66841018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 shutdown_connections 2023-12-14T18:23:06.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:06.299+0000 7f668b846700 1 -- 172.21.15.69:0/3819493868 wait complete. 2023-12-14T18:23:06.301 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 3 2023-12-14T18:23:06.386 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:23:06 smithi091 ceph-mds[67672]: -- 172.21.15.91:0/1530699509 <== mon.2 v2:172.21.15.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561b86621520 con 0x561b865f7000 2023-12-14T18:23:06.386 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:23:06 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-k[67649]: starting mds.k at 2023-12-14T18:23:06.386 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:23:06 smithi091 bash[67634]: e650bc2d2d378d6f6c42692d2942f105c4e3e0d166fb9ec7848548ba0cabd63f 2023-12-14T18:23:06.387 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:23:06 smithi091 systemd[1]: Started Ceph mds.k for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: Deploying daemon mds.j on smithi069 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:07.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6832/653738912,v1:172.21.15.91:6833/653738912] up:boot 2023-12-14T18:23:07.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: fsmap 2 up:standby 2023-12-14T18:23:07.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T18:23:07.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3819493868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: Deploying daemon mds.j on smithi069 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:07.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6832/653738912,v1:172.21.15.91:6833/653738912] up:boot 2023-12-14T18:23:07.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: fsmap 2 up:standby 2023-12-14T18:23:07.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T18:23:07.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:07 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3819493868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:07.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:07.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:07.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: Deploying daemon mds.j on smithi069 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6832/653738912,v1:172.21.15.91:6833/653738912] up:boot 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: fsmap 2 up:standby 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-14T18:23:07.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:07 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3819493868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:07.602 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:23:07 smithi069 systemd[1]: Starting Ceph mds.j for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:08.208 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-mds[75242]: -- 172.21.15.69:0/2442292038 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558fc4513520 con 0x558fc44e8c00 2023-12-14T18:23:08.209 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:23:07 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-j[75219]: starting mds.j at 2023-12-14T18:23:08.209 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:23:07 smithi069 bash[75204]: f72978195056480e7a312d9c272aa6df11510f22619136119e718cfb7447bf8b 2023-12-14T18:23:08.209 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:23:07 smithi069 systemd[1]: Started Ceph mds.j for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:08.313 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:08.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 -- 172.21.15.69:0/3493076814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100300 msgr2=0x7f7358100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 --2- 172.21.15.69:0/3493076814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100300 0x7f7358100750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f734c009990 tx=0x7f734c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 -- 172.21.15.69:0/3493076814 shutdown_connections 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 --2- 172.21.15.69:0/3493076814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100c90 0x7f7358107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 --2- 172.21.15.69:0/3493076814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73580ff110 0x7f73580ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 --2- 172.21.15.69:0/3493076814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100300 0x7f7358100750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 -- 172.21.15.69:0/3493076814 >> 172.21.15.69:0/3493076814 conn(0x7f73580fa6f0 msgr2=0x7f73580fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 -- 172.21.15.69:0/3493076814 shutdown_connections 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.442+0000 7f735e8e9700 1 -- 172.21.15.69:0/3493076814 wait complete. 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 Processor -- start 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 -- start start 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73580ff110 0x7f7358194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100300 0x7f73581953b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 0x7f735819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735819c9f0 con 0x7f7358100c90 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735819cb30 con 0x7f7358100300 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735e8e9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735819ccc0 con 0x7f73580ff110 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.443+0000 7f735ce86700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 0x7f735819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 0x7f735819c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51384/0 (socket says 172.21.15.69:51384) 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 -- 172.21.15.69:0/2009205664 learned_addr learned my addr 172.21.15.69:0/2009205664 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f7357fff700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73580ff110 0x7f7358194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f73577fe700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100300 0x7f73581953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 -- 172.21.15.69:0/2009205664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73580ff110 msgr2=0x7f7358194e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73580ff110 0x7f7358194e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 -- 172.21.15.69:0/2009205664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100300 msgr2=0x7f73581953b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100300 0x7f73581953b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 -- 172.21.15.69:0/2009205664 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0095f0 con 0x7f7358100c90 2023-12-14T18:23:08.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f73577fe700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100300 0x7f73581953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735ce86700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 0x7f735819c420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f735000ef30 tx=0x7f735000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350018070 con 0x7f7358100c90 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735810a930 con 0x7f7358100c90 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f735000f040 con 0x7f7358100c90 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000cc70 con 0x7f7358100c90 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.444+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735810a7a0 con 0x7f7358100c90 2023-12-14T18:23:08.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.445+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7358106800 con 0x7f7358100c90 2023-12-14T18:23:08.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.447+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7350003a00 con 0x7f7358100c90 2023-12-14T18:23:08.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.448+0000 7f73557fa700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f73400a1150 0x7f73400a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:08.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.448+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f73500cc550 con 0x7f7358100c90 2023-12-14T18:23:08.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.448+0000 7f7357fff700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f73400a1150 0x7f73400a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:08.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.448+0000 7f7357fff700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f73400a1150 0x7f73400a3600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7358100160 tx=0x7f7348009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:08.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.451+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f73500961d0 con 0x7f7358100c90 2023-12-14T18:23:08.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.693+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f735802cfe0 con 0x7f7358100c90 2023-12-14T18:23:08.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.693+0000 7f73557fa700 1 -- 172.21.15.69:0/2009205664 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2771 (secure 0 0 0) 0x7f7350003cb0 con 0x7f7358100c90 2023-12-14T18:23:08.694 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:08.695 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-14T18:23:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f73400a1150 msgr2=0x7f73400a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f73400a1150 0x7f73400a3600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7358100160 tx=0x7f7348009260 comp rx=0 tx=0).stop 2023-12-14T18:23:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 msgr2=0x7f735819c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 0x7f735819c420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f735000ef30 tx=0x7f735000c3a0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 shutdown_connections 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f73400a1150 0x7f73400a3600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7358100c90 0x7f735819c420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73580ff110 0x7f7358194e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 --2- 172.21.15.69:0/2009205664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7358100300 0x7f73581953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.695+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 >> 172.21.15.69:0/2009205664 conn(0x7f73580fa6f0 msgr2=0x7f7358103940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.696+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 shutdown_connections 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:08.696+0000 7f735e8e9700 1 -- 172.21.15.69:0/2009205664 wait complete. 2023-12-14T18:23:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 4 2023-12-14T18:23:08.940 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:08.940 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: Deploying daemon mds.d on smithi069 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.69:6834/4151675388,v1:172.21.15.69:6835/4151675388] up:boot 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: fsmap 3 up:standby 2023-12-14T18:23:08.941 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T18:23:08.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:08.942 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:08 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2009205664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:09.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: Deploying daemon mds.d on smithi069 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.69:6834/4151675388,v1:172.21.15.69:6835/4151675388] up:boot 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: fsmap 3 up:standby 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:09.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:08 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2009205664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:09.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: Deploying daemon mds.d on smithi069 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.69:6834/4151675388,v1:172.21.15.69:6835/4151675388] up:boot 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: fsmap 3 up:standby 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:09.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:08 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2009205664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:09.208 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:23:09 smithi069 systemd[1]: Starting Ceph mds.d for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:09.958 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:23:09 smithi069 ceph-mds[75626]: -- 172.21.15.69:0/3560530227 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562a5b331520 con 0x562a5b307000 2023-12-14T18:23:09.959 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:23:09 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-d[75603]: starting mds.d at 2023-12-14T18:23:09.959 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:23:09 smithi069 bash[75588]: 3b101a575e5bd98c809848d778007289fe1705063677d791c12d63e4c1c1cc7d 2023-12-14T18:23:09.959 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:23:09 smithi069 systemd[1]: Started Ceph mds.d for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:10.709 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:10.819 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.819 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.819 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.819 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:10.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:10.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:10.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: Deploying daemon mds.e on smithi091 2023-12-14T18:23:10.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.69:6836/1672922586,v1:172.21.15.69:6837/1672922586] up:boot 2023-12-14T18:23:10.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: fsmap 4 up:standby 2023-12-14T18:23:10.820 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:10 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 -- 172.21.15.69:0/676438904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4100d50 msgr2=0x7f2ad4103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 --2- 172.21.15.69:0/676438904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4100d50 0x7f2ad4103130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00b0a0 tx=0x7f2acc00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 -- 172.21.15.69:0/676438904 shutdown_connections 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 --2- 172.21.15.69:0/676438904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4105f90 0x7f2ad4108390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 --2- 172.21.15.69:0/676438904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4100d50 0x7f2ad4103130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 --2- 172.21.15.69:0/676438904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4103670 0x7f2ad4105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:10.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 -- 172.21.15.69:0/676438904 >> 172.21.15.69:0/676438904 conn(0x7f2ad40fa7b0 msgr2=0x7f2ad40fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 -- 172.21.15.69:0/676438904 shutdown_connections 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 -- 172.21.15.69:0/676438904 wait complete. 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 Processor -- start 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 -- start start 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.850+0000 7f2adad03700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 0x7f2ad4196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2adad03700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4103670 0x7f2ad4196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2adad03700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 0x7f2ad419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2adad03700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad419db80 con 0x7f2ad4105f90 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2adad03700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad419dcc0 con 0x7f2ad4100d50 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2adad03700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad419de50 con 0x7f2ad4103670 2023-12-14T18:23:10.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 0x7f2ad419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad8a9f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 0x7f2ad4196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 0x7f2ad419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51414/0 (socket says 172.21.15.69:51414) 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad8a9f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 0x7f2ad4196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:45098/0 (socket says 172.21.15.69:45098) 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 -- 172.21.15.69:0/3057373852 learned_addr learned my addr 172.21.15.69:0/3057373852 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad3fff700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4103670 0x7f2ad4196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 -- 172.21.15.69:0/3057373852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4103670 msgr2=0x7f2ad4196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4103670 0x7f2ad4196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 -- 172.21.15.69:0/3057373852 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 msgr2=0x7f2ad4196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 0x7f2ad4196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:10.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 -- 172.21.15.69:0/3057373852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc009d00 con 0x7f2ad4105f90 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad3fff700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4103670 0x7f2ad4196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad8a9f700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 0x7f2ad4196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad92a0700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 0x7f2ad419d5b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c900 tx=0x7f2ac400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4007b00 con 0x7f2ad4105f90 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad410bad0 con 0x7f2ad4105f90 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ac400ce50 con 0x7f2ad4105f90 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.851+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4018400 con 0x7f2ad4105f90 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.852+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad410b940 con 0x7f2ad4105f90 2023-12-14T18:23:10.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.853+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40fc320 con 0x7f2ad4105f90 2023-12-14T18:23:10.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.854+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2ac400f450 con 0x7f2ad4105f90 2023-12-14T18:23:10.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.854+0000 7f2ad1ffb700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2ac00a1150 0x7f2ac00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:10.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.854+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2ac40cc2c0 con 0x7f2ad4105f90 2023-12-14T18:23:10.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.854+0000 7f2ad8a9f700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2ac00a1150 0x7f2ac00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:10.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.855+0000 7f2ad8a9f700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2ac00a1150 0x7f2ac00a3600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007990 tx=0x7f2acc00b7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:10.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:10.858+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2ac4095eb0 con 0x7f2ad4105f90 2023-12-14T18:23:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: Deploying daemon mds.e on smithi091 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.69:6836/1672922586,v1:172.21.15.69:6837/1672922586] up:boot 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: fsmap 4 up:standby 2023-12-14T18:23:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:10 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T18:23:10.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: Deploying daemon mds.e on smithi091 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.69:6836/1672922586,v1:172.21.15.69:6837/1672922586] up:boot 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: fsmap 4 up:standby 2023-12-14T18:23:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:10 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-14T18:23:11.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.088+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad402cfe0 con 0x7f2ad4105f90 2023-12-14T18:23:11.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.088+0000 7f2ad1ffb700 1 -- 172.21.15.69:0/3057373852 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3528 (secure 0 0 0) 0x7f2ac40994d0 con 0x7f2ad4105f90 2023-12-14T18:23:11.090 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:11.090 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-14T18:23:11.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2ac00a1150 msgr2=0x7f2ac00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:11.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2ac00a1150 0x7f2ac00a3600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007990 tx=0x7f2acc00b7f0 comp rx=0 tx=0).stop 2023-12-14T18:23:11.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 msgr2=0x7f2ad419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 0x7f2ad419d5b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c900 tx=0x7f2ac400cc10 comp rx=0 tx=0).stop 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 shutdown_connections 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2ac00a1150 0x7f2ac00a3600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ad4105f90 0x7f2ad419d5b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ad4100d50 0x7f2ad4196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 --2- 172.21.15.69:0/3057373852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad4103670 0x7f2ad4196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 >> 172.21.15.69:0/3057373852 conn(0x7f2ad40fa7b0 msgr2=0x7f2ad41019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 shutdown_connections 2023-12-14T18:23:11.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:11.091+0000 7f2adad03700 1 -- 172.21.15.69:0/3057373852 wait complete. 2023-12-14T18:23:11.094 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2023-12-14T18:23:11.137 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:23:10 smithi091 systemd[1]: Starting Ceph mds.e for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:11.631 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mds[68016]: -- 172.21.15.91:0/3837092494 <== mon.2 v2:172.21.15.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ded4961520 con 0x55ded4936800 2023-12-14T18:23:11.631 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e[67992]: starting mds.e at 2023-12-14T18:23:11.631 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:23:11 smithi091 bash[67977]: 4273adb65ddeb5b9543859a454d2a262e0ad9d3b4901778bc55e3b6e239fe82d 2023-12-14T18:23:11.631 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:23:11 smithi091 systemd[1]: Started Ceph mds.e for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:11.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3057373852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:11.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:11 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3057373852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:11.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:11.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:11 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3057373852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:11.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:11 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:12 smithi091 ceph-mon[43601]: Deploying daemon mds.f on smithi119 2023-12-14T18:23:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:12 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] up:boot 2023-12-14T18:23:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:12 smithi091 ceph-mon[43601]: fsmap 5 up:standby 2023-12-14T18:23:12.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:12 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T18:23:12.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:12 smithi069 ceph-mon[42047]: Deploying daemon mds.f on smithi119 2023-12-14T18:23:12.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:12 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] up:boot 2023-12-14T18:23:12.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:12 smithi069 ceph-mon[42047]: fsmap 5 up:standby 2023-12-14T18:23:12.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:12 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T18:23:13.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:12 smithi119 ceph-mon[43973]: Deploying daemon mds.f on smithi119 2023-12-14T18:23:13.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:12 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] up:boot 2023-12-14T18:23:13.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:12 smithi119 ceph-mon[43973]: fsmap 5 up:standby 2023-12-14T18:23:13.016 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:12 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T18:23:13.016 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:23:12 smithi119 systemd[1]: Starting Ceph mds.f for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:13.105 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 -- 172.21.15.69:0/3970026833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300fe960 msgr2=0x7f98300fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 --2- 172.21.15.69:0/3970026833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300fe960 0x7f98300fed70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9824009990 tx=0x7f9824009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 -- 172.21.15.69:0/3970026833 shutdown_connections 2023-12-14T18:23:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 --2- 172.21.15.69:0/3970026833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98301004e0 0x7f9830106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 --2- 172.21.15.69:0/3970026833 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300fe960 0x7f98300fed70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 --2- 172.21.15.69:0/3970026833 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98300ffb50 0x7f98300fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.240+0000 7f9836bb9700 1 -- 172.21.15.69:0/3970026833 >> 172.21.15.69:0/3970026833 conn(0x7f98300f9f80 msgr2=0x7f98300fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.241+0000 7f9836bb9700 1 -- 172.21.15.69:0/3970026833 shutdown_connections 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.241+0000 7f9836bb9700 1 -- 172.21.15.69:0/3970026833 wait complete. 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.241+0000 7f9836bb9700 1 Processor -- start 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.241+0000 7f9836bb9700 1 -- start start 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98300fe960 0x7f983010a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 0x7f98301086f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98301004e0 0x7f9830108c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:13.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98301093d0 con 0x7f98300ffb50 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9830109540 con 0x7f98301004e0 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983019ffd0 con 0x7f98300fe960 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 0x7f98301086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 0x7f98301086f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51444/0 (socket says 172.21.15.69:51444) 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 -- 172.21.15.69:0/2062086452 learned_addr learned my addr 172.21.15.69:0/2062086452 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9834955700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98300fe960 0x7f983010a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9835156700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98301004e0 0x7f9830108c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:13.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 -- 172.21.15.69:0/2062086452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98300fe960 msgr2=0x7f983010a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98300fe960 0x7f983010a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 -- 172.21.15.69:0/2062086452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98301004e0 msgr2=0x7f9830108c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98301004e0 0x7f9830108c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 -- 172.21.15.69:0/2062086452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240095f0 con 0x7f98300ffb50 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982ffff700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 0x7f98301086f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f981c00e9a0 tx=0x7f981c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c009790 con 0x7f98300ffb50 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983010bb80 con 0x7f98300ffb50 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f981c010430 con 0x7f98300ffb50 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.242+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00cea0 con 0x7f98300ffb50 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.243+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983010b9f0 con 0x7f98300ffb50 2023-12-14T18:23:13.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.244+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98301a06c0 con 0x7f98300ffb50 2023-12-14T18:23:13.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.245+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f981c0105a0 con 0x7f98300ffb50 2023-12-14T18:23:13.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.245+0000 7f982dffb700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f98200a1150 0x7f98200a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:13.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.245+0000 7f9834955700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f98200a1150 0x7f98200a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:13.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.245+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f981c014070 con 0x7f98300ffb50 2023-12-14T18:23:13.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.246+0000 7f9834955700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f98200a1150 0x7f98200a3600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f98240098e0 tx=0x7f982400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:13.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.249+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f981c051730 con 0x7f98300ffb50 2023-12-14T18:23:13.375 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mds[69327]: -- 172.21.15.119:0/4287150795 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558daa8fb520 con 0x558daa8d0800 2023-12-14T18:23:13.375 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f[69304]: starting mds.f at 2023-12-14T18:23:13.375 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:23:13 smithi119 bash[69289]: 62022658ae06e1ae113715575525be7edb3a135c88b32e0f1483ba6ae63a8d8e 2023-12-14T18:23:13.375 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:23:13 smithi119 systemd[1]: Started Ceph mds.f for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:13.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.481+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9830105910 con 0x7f98300ffb50 2023-12-14T18:23:13.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.481+0000 7f982dffb700 1 -- 172.21.15.69:0/2062086452 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4282 (secure 0 0 0) 0x7f981c0962b0 con 0x7f98300ffb50 2023-12-14T18:23:13.483 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:13.483 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-12-14T18:23:13.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f98200a1150 msgr2=0x7f98200a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f98200a1150 0x7f98200a3600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f98240098e0 tx=0x7f982400b260 comp rx=0 tx=0).stop 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 msgr2=0x7f98301086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 0x7f98301086f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f981c00e9a0 tx=0x7f981c00ecb0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 shutdown_connections 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f98200a1150 0x7f98200a3600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98301004e0 0x7f9830108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98300fe960 0x7f983010a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 --2- 172.21.15.69:0/2062086452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98300ffb50 0x7f98301086f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 >> 172.21.15.69:0/2062086452 conn(0x7f98300f9f80 msgr2=0x7f98300fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:13.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 shutdown_connections 2023-12-14T18:23:13.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:13.484+0000 7f9836bb9700 1 -- 172.21.15.69:0/2062086452 wait complete. 2023-12-14T18:23:13.487 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 6 2023-12-14T18:23:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:13.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:13.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:13.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:13 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2062086452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:13 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2062086452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:13.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:13 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2062086452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:14.624 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:23:14 smithi119 systemd[1]: Starting Ceph mds.c for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:14.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:14 smithi069 ceph-mon[42047]: Deploying daemon mds.c on smithi119 2023-12-14T18:23:14.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:14 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6834/1476188818,v1:172.21.15.119:6835/1476188818] up:boot 2023-12-14T18:23:14.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:14 smithi069 ceph-mon[42047]: fsmap 6 up:standby 2023-12-14T18:23:14.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:14 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T18:23:15.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:14 smithi119 ceph-mon[43973]: Deploying daemon mds.c on smithi119 2023-12-14T18:23:15.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:14 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6834/1476188818,v1:172.21.15.119:6835/1476188818] up:boot 2023-12-14T18:23:15.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:14 smithi119 ceph-mon[43973]: fsmap 6 up:standby 2023-12-14T18:23:15.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:14 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T18:23:15.126 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:23:14 smithi119 ceph-mds[69668]: -- 172.21.15.119:0/1358541560 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e62d12f520 con 0x55e62d104800 2023-12-14T18:23:15.126 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:23:14 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c[69645]: starting mds.c at 2023-12-14T18:23:15.126 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:23:14 smithi119 bash[69630]: b67bcd5c902980e601b7d4e3a91e5cc0c391d6f6b15b70e6fdf2e66a8c1bfa8e 2023-12-14T18:23:15.127 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:23:14 smithi119 systemd[1]: Started Ceph mds.c for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:15.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:14 smithi091 ceph-mon[43601]: Deploying daemon mds.c on smithi119 2023-12-14T18:23:15.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:14 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6834/1476188818,v1:172.21.15.119:6835/1476188818] up:boot 2023-12-14T18:23:15.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:14 smithi091 ceph-mon[43601]: fsmap 6 up:standby 2023-12-14T18:23:15.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:14 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T18:23:15.497 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:15.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 -- 172.21.15.69:0/1576309022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c100c90 msgr2=0x7fde2c103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:15.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 --2- 172.21.15.69:0/1576309022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c100c90 0x7fde2c103070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009990 tx=0x7fde1c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 -- 172.21.15.69:0/1576309022 shutdown_connections 2023-12-14T18:23:15.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 --2- 172.21.15.69:0/1576309022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde2c105ed0 0x7fde2c108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 --2- 172.21.15.69:0/1576309022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c100c90 0x7fde2c103070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 --2- 172.21.15.69:0/1576309022 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c1035b0 0x7fde2c105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 -- 172.21.15.69:0/1576309022 >> 172.21.15.69:0/1576309022 conn(0x7fde2c0fa6f0 msgr2=0x7fde2c0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 -- 172.21.15.69:0/1576309022 shutdown_connections 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 -- 172.21.15.69:0/1576309022 wait complete. 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.631+0000 7fde32416700 1 Processor -- start 2023-12-14T18:23:15.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 -- start start 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c100c90 0x7fde2c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde2c1035b0 0x7fde2c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 0x7fde2c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c19dab0 con 0x7fde2c105ed0 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c19dbf0 con 0x7fde2c100c90 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde32416700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c19dd80 con 0x7fde2c1035b0 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 0x7fde2c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde2bfff700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c100c90 0x7fde2c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 0x7fde2c19d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59250/0 (socket says 172.21.15.69:59250) 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 -- 172.21.15.69:0/4224765447 learned_addr learned my addr 172.21.15.69:0/4224765447 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:15.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 -- 172.21.15.69:0/4224765447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde2c1035b0 msgr2=0x7fde2c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde2b7fe700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde2c1035b0 0x7fde2c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde2c1035b0 0x7fde2c196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 -- 172.21.15.69:0/4224765447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c100c90 msgr2=0x7fde2c195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c100c90 0x7fde2c195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 -- 172.21.15.69:0/4224765447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0095f0 con 0x7fde2c105ed0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde2bfff700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c100c90 0x7fde2c195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.632+0000 7fde309b3700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 0x7fde2c19d4e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fde24007ee0 tx=0x7fde2400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.633+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2400ddd0 con 0x7fde2c105ed0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.633+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde2400f040 con 0x7fde2c105ed0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.633+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c10ba70 con 0x7fde2c105ed0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.633+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde240047d0 con 0x7fde2c105ed0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.633+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c10b8e0 con 0x7fde2c105ed0 2023-12-14T18:23:15.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.634+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c0fc260 con 0x7fde2c105ed0 2023-12-14T18:23:15.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.635+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fde24003a00 con 0x7fde2c105ed0 2023-12-14T18:23:15.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.635+0000 7fde297fa700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fde180a1150 0x7fde180a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:15.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.635+0000 7fde2bfff700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fde180a1150 0x7fde180a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:15.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.635+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fde240cbdd0 con 0x7fde2c105ed0 2023-12-14T18:23:15.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.636+0000 7fde2bfff700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fde180a1150 0x7fde180a3600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde1c006010 tx=0x7fde1c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:15.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.640+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fde2404e730 con 0x7fde2c105ed0 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:15.866 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:15 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:15.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.871+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde2c0679f0 con 0x7fde2c105ed0 2023-12-14T18:23:15.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.871+0000 7fde297fa700 1 -- 172.21.15.69:0/4224765447 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5802 (secure 0 0 0) 0x7fde240959c0 con 0x7fde2c105ed0 2023-12-14T18:23:15.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:15.872 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-12-14T18:23:15.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fde180a1150 msgr2=0x7fde180a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:15.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fde180a1150 0x7fde180a3600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde1c006010 tx=0x7fde1c00b260 comp rx=0 tx=0).stop 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 msgr2=0x7fde2c19d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 0x7fde2c19d4e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fde24007ee0 tx=0x7fde2400d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 shutdown_connections 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fde180a1150 0x7fde180a3600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde2c105ed0 0x7fde2c19d4e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde2c100c90 0x7fde2c195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 --2- 172.21.15.69:0/4224765447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde2c1035b0 0x7fde2c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.873+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 >> 172.21.15.69:0/4224765447 conn(0x7fde2c0fa6f0 msgr2=0x7fde2c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.874+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 shutdown_connections 2023-12-14T18:23:15.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:15.874+0000 7fde32416700 1 -- 172.21.15.69:0/4224765447 wait complete. 2023-12-14T18:23:15.876 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-12-14T18:23:15.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:15.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:15.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:15.886 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:15.886 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:15.886 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:15.886 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:15 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:16.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:16.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:16.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:16.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:16.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:16.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:16.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:15 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:16.522 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:23:16 smithi091 systemd[1]: Starting Ceph mds.h for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:16 smithi069 ceph-mon[42047]: Deploying daemon mds.h on smithi091 2023-12-14T18:23:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:16 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6836/3442609233,v1:172.21.15.119:6837/3442609233] up:boot 2023-12-14T18:23:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:16 smithi069 ceph-mon[42047]: fsmap 7 up:standby 2023-12-14T18:23:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:16 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T18:23:16.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:16 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4224765447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:17.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:16 smithi119 ceph-mon[43973]: Deploying daemon mds.h on smithi091 2023-12-14T18:23:17.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:16 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6836/3442609233,v1:172.21.15.119:6837/3442609233] up:boot 2023-12-14T18:23:17.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:16 smithi119 ceph-mon[43973]: fsmap 7 up:standby 2023-12-14T18:23:17.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:16 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T18:23:17.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:16 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4224765447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:17.136 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-mds[68355]: -- 172.21.15.91:0/1078130143 <== mon.2 v2:172.21.15.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55989f8c9520 con 0x55989f89f000 2023-12-14T18:23:17.136 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h[68332]: starting mds.h at 2023-12-14T18:23:17.136 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:23:16 smithi091 bash[68317]: 7636a2a048365499b44a707478ba9f8f3a371e25bc1fafe4ca0d2cbb16f8c20e 2023-12-14T18:23:17.136 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:23:16 smithi091 systemd[1]: Started Ceph mds.h for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:17.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-mon[43601]: Deploying daemon mds.h on smithi091 2023-12-14T18:23:17.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6836/3442609233,v1:172.21.15.119:6837/3442609233] up:boot 2023-12-14T18:23:17.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-mon[43601]: fsmap 7 up:standby 2023-12-14T18:23:17.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T18:23:17.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:16 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4224765447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:17.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:17 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:17.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:17.917 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:17.917 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:17.917 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:17.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:17.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:17.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:17.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:17 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 -- 172.21.15.69:0/3164027937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 msgr2=0x7f29c40ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/3164027937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c40ff7f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009990 tx=0x7f29c0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 -- 172.21.15.69:0/3164027937 shutdown_connections 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/3164027937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 0x7f29c41075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/3164027937 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29c4100730 0x7f29c4100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/3164027937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c40ff7f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 -- 172.21.15.69:0/3164027937 >> 172.21.15.69:0/3164027937 conn(0x7f29c40f9e80 msgr2=0x7f29c40fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 -- 172.21.15.69:0/3164027937 shutdown_connections 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.022+0000 7f29cb5b3700 1 -- 172.21.15.69:0/3164027937 wait complete. 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 Processor -- start 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 -- start start 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c4195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 0x7f29c41963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29c4100730 0x7f29c419d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419da30 con 0x7f29c40ff380 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419db70 con 0x7f29c4100730 2023-12-14T18:23:18.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29cb5b3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419dd00 con 0x7f29c40ffd30 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c4195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c4195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59272/0 (socket says 172.21.15.69:59272) 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 -- 172.21.15.69:0/1356508887 learned_addr learned my addr 172.21.15.69:0/1356508887 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c8b4e700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 0x7f29c41963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c9b50700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29c4100730 0x7f29c419d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 -- 172.21.15.69:0/1356508887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 msgr2=0x7f29c41963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 0x7f29c41963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 -- 172.21.15.69:0/1356508887 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29c4100730 msgr2=0x7f29c419d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29c4100730 0x7f29c419d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 -- 172.21.15.69:0/1356508887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00095f0 con 0x7f29c40ff380 2023-12-14T18:23:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c8b4e700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 0x7f29c41963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29c934f700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c4195eb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c990 tx=0x7f29b400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.023+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4007b00 con 0x7f29c40ff380 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.024+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29b4007c60 con 0x7f29c40ff380 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.024+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c410a9c0 con 0x7f29c40ff380 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.024+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4018660 con 0x7f29c40ff380 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.024+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c410a830 con 0x7f29c40ff380 2023-12-14T18:23:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.024+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c419e330 con 0x7f29c40ff380 2023-12-14T18:23:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.026+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f29b400f450 con 0x7f29c40ff380 2023-12-14T18:23:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.027+0000 7f29ba7fc700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29b00a1150 0x7f29b00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.027+0000 7f29c8b4e700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29b00a1150 0x7f29b00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.027+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29b40cc590 con 0x7f29c40ff380 2023-12-14T18:23:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.027+0000 7f29c8b4e700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29b00a1150 0x7f29b00a3600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f29c000b2e0 tx=0x7f29c0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.030+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f29b4096210 con 0x7f29c40ff380 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:18.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:17 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:18.254 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:23:17 smithi119 systemd[1]: Starting Ceph mds.i for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:18.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.265+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29c419e8e0 con 0x7f29c40ff380 2023-12-14T18:23:18.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.266+0000 7f29ba7fc700 1 -- 172.21.15.69:0/1356508887 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6559 (secure 0 0 0) 0x7f29b4099830 con 0x7f29c40ff380 2023-12-14T18:23:18.267 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:18.267 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-12-14T18:23:18.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29b00a1150 msgr2=0x7f29b00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:18.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29b00a1150 0x7f29b00a3600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f29c000b2e0 tx=0x7f29c0005fd0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 msgr2=0x7f29c4195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c4195eb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c990 tx=0x7f29b400cd50 comp rx=0 tx=0).stop 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 shutdown_connections 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f29b00a1150 0x7f29b00a3600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29c4100730 0x7f29c419d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29c40ff380 0x7f29c4195eb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 --2- 172.21.15.69:0/1356508887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29c40ffd30 0x7f29c41963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 >> 172.21.15.69:0/1356508887 conn(0x7f29c40f9e80 msgr2=0x7f29c40fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 shutdown_connections 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:18.268+0000 7f29cb5b3700 1 -- 172.21.15.69:0/1356508887 wait complete. 2023-12-14T18:23:18.270 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 9 2023-12-14T18:23:18.676 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mds[70010]: -- 172.21.15.119:0/1853412601 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55981da0f520 con 0x55981d9e5000 2023-12-14T18:23:18.676 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i[69987]: starting mds.i at 2023-12-14T18:23:18.676 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:23:18 smithi119 bash[69972]: 79bed17d7d04aa361c6ef825b045d637dff8e96605c5c6735194ae1602f667fb 2023-12-14T18:23:18.676 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:23:18 smithi119 systemd[1]: Started Ceph mds.i for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: Deploying daemon mds.i on smithi119 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] up:boot 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: fsmap 8 up:standby 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1356508887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:18.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:18.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:18.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:18.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:18 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: Deploying daemon mds.i on smithi119 2023-12-14T18:23:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] up:boot 2023-12-14T18:23:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: fsmap 8 up:standby 2023-12-14T18:23:19.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1356508887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:19.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:18 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:19.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: Deploying daemon mds.i on smithi119 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] up:boot 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: fsmap 8 up:standby 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1356508887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:19.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:18 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:19.959 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:23:19 smithi069 systemd[1]: Starting Ceph mds.g for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:19 smithi069 ceph-mon[42047]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:19 smithi069 ceph-mon[42047]: Deploying daemon mds.g on smithi069 2023-12-14T18:23:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:19 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6838/771447970,v1:172.21.15.119:6839/771447970] up:boot 2023-12-14T18:23:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:19 smithi069 ceph-mon[42047]: fsmap 9 up:standby 2023-12-14T18:23:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:19 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T18:23:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:19 smithi119 ceph-mon[43973]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:19 smithi119 ceph-mon[43973]: Deploying daemon mds.g on smithi069 2023-12-14T18:23:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:19 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6838/771447970,v1:172.21.15.119:6839/771447970] up:boot 2023-12-14T18:23:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:19 smithi119 ceph-mon[43973]: fsmap 9 up:standby 2023-12-14T18:23:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:19 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T18:23:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:19 smithi091 ceph-mon[43601]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:19 smithi091 ceph-mon[43601]: Deploying daemon mds.g on smithi069 2023-12-14T18:23:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:19 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6838/771447970,v1:172.21.15.119:6839/771447970] up:boot 2023-12-14T18:23:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:19 smithi091 ceph-mon[43601]: fsmap 9 up:standby 2023-12-14T18:23:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:19 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T18:23:20.282 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:20.310 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:23:20 smithi069 ceph-mds[76146]: -- 172.21.15.69:0/3603636665 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564c0322d520 con 0x564c03202c00 2023-12-14T18:23:20.310 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:23:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-g[76123]: starting mds.g at 2023-12-14T18:23:20.310 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:23:20 smithi069 bash[76109]: da1fbbd61f492f4ea3ecadfaecd1ea869e84b2ebfd048241e69c647f427d97cb 2023-12-14T18:23:20.310 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:23:20 smithi069 systemd[1]: Started Ceph mds.g for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 -- 172.21.15.69:0/4184942789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838100c90 msgr2=0x7f5838103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 --2- 172.21.15.69:0/4184942789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838100c90 0x7f5838103070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5828009990 tx=0x7f5828009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 -- 172.21.15.69:0/4184942789 shutdown_connections 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 --2- 172.21.15.69:0/4184942789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5838105ed0 0x7f5838108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 --2- 172.21.15.69:0/4184942789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838100c90 0x7f5838103070 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 --2- 172.21.15.69:0/4184942789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f58381035b0 0x7f5838105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 -- 172.21.15.69:0/4184942789 >> 172.21.15.69:0/4184942789 conn(0x7f58380fa6f0 msgr2=0x7f58380fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:20.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 -- 172.21.15.69:0/4184942789 shutdown_connections 2023-12-14T18:23:20.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 -- 172.21.15.69:0/4184942789 wait complete. 2023-12-14T18:23:20.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.416+0000 7f583d9d9700 1 Processor -- start 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 -- start start 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5838100c90 0x7f5838195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58381035b0 0x7f58381963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 0x7f583819d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583819da10 con 0x7f5838105ed0 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583819db50 con 0x7f5838100c90 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583819dce0 con 0x7f58381035b0 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 0x7f583819d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 0x7f583819d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59306/0 (socket says 172.21.15.69:59306) 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 -- 172.21.15.69:0/3075196670 learned_addr learned my addr 172.21.15.69:0/3075196670 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:20.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58367fc700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58381035b0 0x7f58381963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f5836ffd700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5838100c90 0x7f5838195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 -- 172.21.15.69:0/3075196670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58381035b0 msgr2=0x7f58381963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58381035b0 0x7f58381963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 -- 172.21.15.69:0/3075196670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5838100c90 msgr2=0x7f5838195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5838100c90 0x7f5838195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 -- 172.21.15.69:0/3075196670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280095f0 con 0x7f5838105ed0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f58377fe700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 0x7f583819d440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5830007ee0 tx=0x7f583000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830017070 con 0x7f5838105ed0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f583000f040 con 0x7f5838105ed0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583810ba40 con 0x7f5838105ed0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830005710 con 0x7f5838105ed0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.417+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583810b8b0 con 0x7f5838105ed0 2023-12-14T18:23:20.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.418+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58380fc260 con 0x7f5838105ed0 2023-12-14T18:23:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.419+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5830005870 con 0x7f5838105ed0 2023-12-14T18:23:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.420+0000 7f583c9d7700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f58200a1150 0x7f58200a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.420+0000 7f5836ffd700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f58200a1150 0x7f58200a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.420+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58300cbc90 con 0x7f5838105ed0 2023-12-14T18:23:20.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.421+0000 7f5836ffd700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f58200a1150 0x7f58200a3600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5828006010 tx=0x7f5828000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:20.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.425+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5830095880 con 0x7f5838105ed0 2023-12-14T18:23:20.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.674+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f583802d030 con 0x7f5838105ed0 2023-12-14T18:23:20.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.674+0000 7f583c9d7700 1 -- 172.21.15.69:0/3075196670 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7318 (secure 0 0 0) 0x7f5830098ea0 con 0x7f5838105ed0 2023-12-14T18:23:20.675 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:20.676 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f58200a1150 msgr2=0x7f58200a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f58200a1150 0x7f58200a3600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5828006010 tx=0x7f5828000bc0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 msgr2=0x7f583819d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 0x7f583819d440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5830007ee0 tx=0x7f583000d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 shutdown_connections 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f58200a1150 0x7f58200a3600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5838105ed0 0x7f583819d440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5838100c90 0x7f5838195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 --2- 172.21.15.69:0/3075196670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58381035b0 0x7f58381963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:20.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 >> 172.21.15.69:0/3075196670 conn(0x7f58380fa6f0 msgr2=0x7f58381018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:20.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 shutdown_connections 2023-12-14T18:23:20.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:20.677+0000 7f583d9d9700 1 -- 172.21.15.69:0/3075196670 wait complete. 2023-12-14T18:23:20.679 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 10 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: Deploying daemon mds.a on smithi069 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3075196670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.69:6838/3763863482,v1:172.21.15.69:6839/3763863482] up:boot 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: fsmap 10 up:standby 2023-12-14T18:23:21.419 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:21.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:21.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: Deploying daemon mds.a on smithi069 2023-12-14T18:23:21.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3075196670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:21.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.69:6838/3763863482,v1:172.21.15.69:6839/3763863482] up:boot 2023-12-14T18:23:21.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: fsmap 10 up:standby 2023-12-14T18:23:21.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:21 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T18:23:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: Deploying daemon mds.a on smithi069 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3075196670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.69:6838/3763863482,v1:172.21.15.69:6839/3763863482] up:boot 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: fsmap 10 up:standby 2023-12-14T18:23:21.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:21 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-14T18:23:21.708 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:23:21 smithi069 systemd[1]: Starting Ceph mds.a for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:22.208 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-mds[76530]: -- 172.21.15.69:0/931150796 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a748b6d520 con 0x55a748b43000 2023-12-14T18:23:22.209 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:23:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-a[76507]: starting mds.a at 2023-12-14T18:23:22.209 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:23:21 smithi069 bash[76493]: 58408041787fb632fc131b80b63221f8b10e321e5df47b86c8af0ff9292e91c1 2023-12-14T18:23:22.209 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:23:21 smithi069 systemd[1]: Started Ceph mds.a for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:22.693 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:22.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 -- 172.21.15.69:0/3606584284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 msgr2=0x7faf10108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:22.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 --2- 172.21.15.69:0/3606584284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf10108340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf0800b0a0 tx=0x7faf0800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:22.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 -- 172.21.15.69:0/3606584284 shutdown_connections 2023-12-14T18:23:22.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 --2- 172.21.15.69:0/3606584284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf10108340 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:22.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 --2- 172.21.15.69:0/3606584284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf10100ca0 0x7faf10103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 --2- 172.21.15.69:0/3606584284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf101035c0 0x7faf101059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 -- 172.21.15.69:0/3606584284 >> 172.21.15.69:0/3606584284 conn(0x7faf100fa700 msgr2=0x7faf100fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 -- 172.21.15.69:0/3606584284 shutdown_connections 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.822+0000 7faf17354700 1 -- 172.21.15.69:0/3606584284 wait complete. 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 Processor -- start 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 -- start start 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf10100ca0 0x7faf10100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf101035c0 0x7faf100fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf100ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100ff930 con 0x7faf10105ee0 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100ffaa0 con 0x7faf10100ca0 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf17354700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf101a0040 con 0x7faf101035c0 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf100ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf100ff190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59344/0 (socket says 172.21.15.69:59344) 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 -- 172.21.15.69:0/3438729892 learned_addr learned my addr 172.21.15.69:0/3438729892 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:22.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf150f0700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf10100ca0 0x7faf10100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf148ef700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf101035c0 0x7faf100fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 -- 172.21.15.69:0/3438729892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf101035c0 msgr2=0x7faf100fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf101035c0 0x7faf100fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 -- 172.21.15.69:0/3438729892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf10100ca0 msgr2=0x7faf10100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf10100ca0 0x7faf10100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.823+0000 7faf158f1700 1 -- 172.21.15.69:0/3438729892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08009d00 con 0x7faf10105ee0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.824+0000 7faf158f1700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf100ff190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf080062a0 tx=0x7faf08004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.824+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800e040 con 0x7faf10105ee0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.824+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf08003e90 con 0x7faf10105ee0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.824+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1010ba90 con 0x7faf10105ee0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.824+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08004020 con 0x7faf10105ee0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.824+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1010b900 con 0x7faf10105ee0 2023-12-14T18:23:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.825+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf100fc270 con 0x7faf10105ee0 2023-12-14T18:23:22.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.826+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7faf08003a00 con 0x7faf10105ee0 2023-12-14T18:23:22.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.826+0000 7faf067fc700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7faefc0a1150 0x7faefc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:22.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.826+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faf080ce3d0 con 0x7faf10105ee0 2023-12-14T18:23:22.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.826+0000 7faf150f0700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7faefc0a1150 0x7faefc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:22.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.827+0000 7faf150f0700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7faefc0a1150 0x7faefc0a3600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf00007c60 tx=0x7faf000073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:22.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:22.830+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7faf08098050 con 0x7faf10105ee0 2023-12-14T18:23:23.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.064+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf1002cfe0 con 0x7faf10105ee0 2023-12-14T18:23:23.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.065+0000 7faf067fc700 1 -- 172.21.15.69:0/3438729892 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8834 (secure 0 0 0) 0x7faf0809b670 con 0x7faf10105ee0 2023-12-14T18:23:23.066 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:23.066 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7faefc0a1150 msgr2=0x7faefc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7faefc0a1150 0x7faefc0a3600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf00007c60 tx=0x7faf000073d0 comp rx=0 tx=0).stop 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 msgr2=0x7faf100ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf100ff190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf080062a0 tx=0x7faf08004d00 comp rx=0 tx=0).stop 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 shutdown_connections 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7faefc0a1150 0x7faefc0a3600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf10105ee0 0x7faf100ff190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf10100ca0 0x7faf10100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 --2- 172.21.15.69:0/3438729892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf101035c0 0x7faf100fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 >> 172.21.15.69:0/3438729892 conn(0x7faf100fa700 msgr2=0x7faf10101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:23.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 shutdown_connections 2023-12-14T18:23:23.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:23.067+0000 7faf17354700 1 -- 172.21.15.69:0/3438729892 wait complete. 2023-12-14T18:23:23.069 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 12 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: Deploying daemon mds.b on smithi091 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.69:6840/3629482996,v1:172.21.15.69:6841/3629482996] up:boot 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: fsmap 11 up:standby 2023-12-14T18:23:23.079 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:22 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T18:23:23.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: Deploying daemon mds.b on smithi091 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.69:6840/3629482996,v1:172.21.15.69:6841/3629482996] up:boot 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: fsmap 11 up:standby 2023-12-14T18:23:23.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:22 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T18:23:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:23.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: Deploying daemon mds.b on smithi091 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.69:6840/3629482996,v1:172.21.15.69:6841/3629482996] up:boot 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: fsmap 11 up:standby 2023-12-14T18:23:23.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:22 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-14T18:23:23.491 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:23 smithi091 systemd[1]: Starting Ceph mds.b for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:23:23.887 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:23 smithi091 ceph-mds[68698]: -- 172.21.15.91:0/3291024588 <== mon.2 v2:172.21.15.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562c8db4d520 con 0x562c8db22c00 2023-12-14T18:23:23.887 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: starting mds.b at 2023-12-14T18:23:23.887 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:23 smithi091 bash[68660]: 45db21e4a66da77818f741ffe5eefc52cc60e73cf0954462a595629f793e4c1d 2023-12-14T18:23:23.887 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:23 smithi091 systemd[1]: Started Ceph mds.b for f1527c12-9aac-11ee-95a5-87774f69a715. 2023-12-14T18:23:24.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3438729892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:24.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:24 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:24.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3438729892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:24.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:24 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:24.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3438729892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:24.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:24.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:24 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:25.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:25.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 -- 172.21.15.69:0/1985836325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b8105ed0 msgr2=0x7f71b8108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 --2- 172.21.15.69:0/1985836325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b8105ed0 0x7f71b8108330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71b000b0a0 tx=0x7f71b000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 -- 172.21.15.69:0/1985836325 shutdown_connections 2023-12-14T18:23:25.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 --2- 172.21.15.69:0/1985836325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b8105ed0 0x7f71b8108330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 --2- 172.21.15.69:0/1985836325 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71b8100c90 0x7f71b8103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 --2- 172.21.15.69:0/1985836325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b81035b0 0x7f71b8105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 -- 172.21.15.69:0/1985836325 >> 172.21.15.69:0/1985836325 conn(0x7f71b80fa6f0 msgr2=0x7f71b80fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 -- 172.21.15.69:0/1985836325 shutdown_connections 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.206+0000 7f71be127700 1 -- 172.21.15.69:0/1985836325 wait complete. 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.207+0000 7f71be127700 1 Processor -- start 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.207+0000 7f71be127700 1 -- start start 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b8100c90 0x7f71b8195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 0x7f71b81964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71b8105ed0 0x7f71b819d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b819db30 con 0x7f71b81035b0 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b819dc70 con 0x7f71b8105ed0 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b819de00 con 0x7f71b8100c90 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 0x7f71b81964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b8100c90 0x7f71b8195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 0x7f71b81964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59354/0 (socket says 172.21.15.69:59354) 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 -- 172.21.15.69:0/1909088195 learned_addr learned my addr 172.21.15.69:0/1909088195 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b8100c90 0x7f71b8195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:38134/0 (socket says 172.21.15.69:38134) 2023-12-14T18:23:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b7fff700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71b8105ed0 0x7f71b819d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 -- 172.21.15.69:0/1909088195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b8100c90 msgr2=0x7f71b8195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b8100c90 0x7f71b8195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 -- 172.21.15.69:0/1909088195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71b8105ed0 msgr2=0x7f71b819d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71b8105ed0 0x7f71b819d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 -- 172.21.15.69:0/1909088195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009d00 con 0x7f71b81035b0 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b6ffd700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 0x7f71b81964f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71a800e9a0 tx=0x7f71a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8009790 con 0x7f71b81035b0 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b810b9d0 con 0x7f71b81035b0 2023-12-14T18:23:25.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71a8010430 con 0x7f71b81035b0 2023-12-14T18:23:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800cea0 con 0x7f71b81035b0 2023-12-14T18:23:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.208+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b810b840 con 0x7f71b81035b0 2023-12-14T18:23:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.209+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80fc260 con 0x7f71b81035b0 2023-12-14T18:23:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.210+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f71a80105a0 con 0x7f71b81035b0 2023-12-14T18:23:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.211+0000 7f71b4ff9700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71a00a1150 0x7f71a00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.211+0000 7f71b77fe700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71a00a1150 0x7f71a00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.211+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f71a8014070 con 0x7f71b81035b0 2023-12-14T18:23:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.211+0000 7f71b77fe700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71a00a1150 0x7f71a00a3600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005950 tx=0x7f71ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.215+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f71a8051730 con 0x7f71b81035b0 2023-12-14T18:23:25.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:25 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] up:boot 2023-12-14T18:23:25.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:25 smithi119 ceph-mon[43973]: fsmap 12 up:standby 2023-12-14T18:23:25.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:25 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T18:23:25.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:25 smithi119 ceph-mon[43973]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:25.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:25 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] up:boot 2023-12-14T18:23:25.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:25 smithi091 ceph-mon[43601]: fsmap 12 up:standby 2023-12-14T18:23:25.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:25 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T18:23:25.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:25 smithi091 ceph-mon[43601]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:25.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.447+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71b8061930 con 0x7f71b81035b0 2023-12-14T18:23:25.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.448+0000 7f71b4ff9700 1 -- 172.21.15.69:0/1909088195 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9589 (secure 0 0 0) 0x7f71a80962b0 con 0x7f71b81035b0 2023-12-14T18:23:25.449 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:25.449 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-12-14T18:23:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.449+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71a00a1150 msgr2=0x7f71a00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.449+0000 7f71be127700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71a00a1150 0x7f71a00a3600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005950 tx=0x7f71ac00b410 comp rx=0 tx=0).stop 2023-12-14T18:23:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.449+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 msgr2=0x7f71b81964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.449+0000 7f71be127700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 0x7f71b81964f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71a800e9a0 tx=0x7f71a800ecb0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 shutdown_connections 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f71a00a1150 0x7f71a00a3600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71b8105ed0 0x7f71b819d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b8100c90 0x7f71b8195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 --2- 172.21.15.69:0/1909088195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b81035b0 0x7f71b81964f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 >> 172.21.15.69:0/1909088195 conn(0x7f71b80fa6f0 msgr2=0x7f71b81018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 shutdown_connections 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.450+0000 7f71be127700 1 -- 172.21.15.69:0/1909088195 wait complete. 2023-12-14T18:23:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 13 2023-12-14T18:23:25.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:25 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] up:boot 2023-12-14T18:23:25.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:25 smithi069 ceph-mon[42047]: fsmap 12 up:standby 2023-12-14T18:23:25.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:25 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T18:23:25.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:25 smithi069 ceph-mon[42047]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:25.463 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:23:25.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 -- 172.21.15.69:0/2330490718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2754100ce0 msgr2=0x7f27541075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 --2- 172.21.15.69:0/2330490718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2754100ce0 0x7f27541075a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f274c00b0a0 tx=0x7f274c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 -- 172.21.15.69:0/2330490718 shutdown_connections 2023-12-14T18:23:25.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 --2- 172.21.15.69:0/2330490718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2754100ce0 0x7f27541075a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 --2- 172.21.15.69:0/2330490718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27540ff160 0x7f27540ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 --2- 172.21.15.69:0/2330490718 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 0x7f27541007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 -- 172.21.15.69:0/2330490718 >> 172.21.15.69:0/2330490718 conn(0x7f27540fa740 msgr2=0x7f27540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 -- 172.21.15.69:0/2330490718 shutdown_connections 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.590+0000 7f27597c3700 1 -- 172.21.15.69:0/2330490718 wait complete. 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 Processor -- start 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 -- start start 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 0x7f2754069980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 0x7f275419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2754100ce0 0x7f275419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275419db40 con 0x7f27540ff160 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275419dcb0 con 0x7f2754100350 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f27597c3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275419de70 con 0x7f2754100ce0 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f2752ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 0x7f2754069980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f2752ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 0x7f2754069980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51912/0 (socket says 172.21.15.69:51912) 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.591+0000 7f2752ffd700 1 -- 172.21.15.69:0/1101325160 learned_addr learned my addr 172.21.15.69:0/1101325160 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f27537fe700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2754100ce0 0x7f275419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f27527fc700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 0x7f275419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f2752ffd700 1 -- 172.21.15.69:0/1101325160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2754100ce0 msgr2=0x7f275419d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f2752ffd700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2754100ce0 0x7f275419d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f2752ffd700 1 -- 172.21.15.69:0/1101325160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 msgr2=0x7f275419ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f2752ffd700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 0x7f275419ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f2752ffd700 1 -- 172.21.15.69:0/1101325160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c009d00 con 0x7f27540ff160 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f27527fc700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 0x7f275419ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f2752ffd700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 0x7f2754069980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f274400e970 tx=0x7f274400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744009790 con 0x7f27540ff160 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275410a980 con 0x7f27540ff160 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f274400eec0 con 0x7f27540ff160 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744003c10 con 0x7f27540ff160 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.592+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275410a7f0 con 0x7f27540ff160 2023-12-14T18:23:25.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.593+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2754106710 con 0x7f27540ff160 2023-12-14T18:23:25.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.594+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2744003d90 con 0x7f27540ff160 2023-12-14T18:23:25.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.595+0000 7f273bfff700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f273c0a1150 0x7f273c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.595+0000 7f27527fc700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f273c0a1150 0x7f273c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.595+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2744014070 con 0x7f27540ff160 2023-12-14T18:23:25.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.595+0000 7f27527fc700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f273c0a1150 0x7f273c0a3600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2748005d90 tx=0x7f2748005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:25.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.598+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2744096440 con 0x7f27540ff160 2023-12-14T18:23:25.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.804+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f275402cfe0 con 0x7f27540ff160 2023-12-14T18:23:25.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.805+0000 7f273bfff700 1 -- 172.21.15.69:0/1101325160 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18385 (secure 0 0 0) 0x7f2744099a60 con 0x7f27540ff160 2023-12-14T18:23:25.807 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:25.807 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":75,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:22:56.628514+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:25.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.807+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f273c0a1150 msgr2=0x7f273c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f273c0a1150 0x7f273c0a3600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2748005d90 tx=0x7f2748005d00 comp rx=0 tx=0).stop 2023-12-14T18:23:25.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 msgr2=0x7f2754069980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 0x7f2754069980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f274400e970 tx=0x7f274400ec80 comp rx=0 tx=0).stop 2023-12-14T18:23:25.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 shutdown_connections 2023-12-14T18:23:25.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f273c0a1150 0x7f273c0a3600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2754100ce0 0x7f275419d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27540ff160 0x7f2754069980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 --2- 172.21.15.69:0/1101325160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2754100350 0x7f275419ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 >> 172.21.15.69:0/1101325160 conn(0x7f27540fa740 msgr2=0x7f2754103850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:25.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 shutdown_connections 2023-12-14T18:23:25.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.808+0000 7f27597c3700 1 -- 172.21.15.69:0/1101325160 wait complete. 2023-12-14T18:23:25.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:23:25.822 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:23:25.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 -- 172.21.15.69:0/3723539432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101db0 msgr2=0x7fced4108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 --2- 172.21.15.69:0/3723539432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101db0 0x7fced4108670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009990 tx=0x7fcec4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 -- 172.21.15.69:0/3723539432 shutdown_connections 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 --2- 172.21.15.69:0/3723539432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101db0 0x7fced4108670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 --2- 172.21.15.69:0/3723539432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fced4100230 0x7fced4100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 --2- 172.21.15.69:0/3723539432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced4101420 0x7fced4101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 -- 172.21.15.69:0/3723539432 >> 172.21.15.69:0/3723539432 conn(0x7fced40fb850 msgr2=0x7fced40fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 -- 172.21.15.69:0/3723539432 shutdown_connections 2023-12-14T18:23:25.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.948+0000 7fcedafc3700 1 -- 172.21.15.69:0/3723539432 wait complete. 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 Processor -- start 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 -- start start 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fced4100230 0x7fced4195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 0x7fced41963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced4101db0 0x7fced419d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced419da00 con 0x7fced4101420 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced419db40 con 0x7fced4100230 2023-12-14T18:23:25.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fcedafc3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced419dcd0 con 0x7fced4101db0 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fced3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 0x7fced41963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fced3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 0x7fced41963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51918/0 (socket says 172.21.15.69:51918) 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fced3fff700 1 -- 172.21.15.69:0/2003674753 learned_addr learned my addr 172.21.15.69:0/2003674753 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fced8d5f700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fced4100230 0x7fced4195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.949+0000 7fced9560700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced4101db0 0x7fced419d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced3fff700 1 -- 172.21.15.69:0/2003674753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced4101db0 msgr2=0x7fced419d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced3fff700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced4101db0 0x7fced419d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced3fff700 1 -- 172.21.15.69:0/2003674753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fced4100230 msgr2=0x7fced4195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:25.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced3fff700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fced4100230 0x7fced4195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced3fff700 1 -- 172.21.15.69:0/2003674753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec40095f0 con 0x7fced4101420 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced3fff700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 0x7fced41963c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00d980 tx=0x7fcebc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc004220 con 0x7fced4101420 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced410bab0 con 0x7fced4101420 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcebc007640 con 0x7fced4101420 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc005660 con 0x7fced4101420 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.950+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced410b920 con 0x7fced4101420 2023-12-14T18:23:25.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.951+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced419e300 con 0x7fced4101420 2023-12-14T18:23:25.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.953+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fcebc004750 con 0x7fced4101420 2023-12-14T18:23:25.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.953+0000 7fced1ffb700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcec00a1150 0x7fcec00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:25.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.953+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcebc0cc5c0 con 0x7fced4101420 2023-12-14T18:23:25.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.954+0000 7fced8d5f700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcec00a1150 0x7fcec00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:25.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.954+0000 7fced8d5f700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcec00a1150 0x7fcec00a3600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fced4101280 tx=0x7fcecc0091c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:25.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:25.957+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fcebc0961b0 con 0x7fced4101420 2023-12-14T18:23:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.180+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fced419ec00 con 0x7fced4101420 2023-12-14T18:23:26.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.181+0000 7fced1ffb700 1 -- 172.21.15.69:0/2003674753 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcebc0997d0 con 0x7fced4101420 2023-12-14T18:23:26.183 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:23:26.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcec00a1150 msgr2=0x7fcec00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcec00a1150 0x7fcec00a3600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fced4101280 tx=0x7fcecc0091c0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 msgr2=0x7fced41963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 0x7fced41963c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00d980 tx=0x7fcebc00dc90 comp rx=0 tx=0).stop 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 shutdown_connections 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcec00a1150 0x7fcec00a3600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced4101db0 0x7fced419d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fced4100230 0x7fced4195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 --2- 172.21.15.69:0/2003674753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fced4101420 0x7fced41963c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 >> 172.21.15.69:0/2003674753 conn(0x7fced40fb850 msgr2=0x7fced40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 shutdown_connections 2023-12-14T18:23:26.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.183+0000 7fcedafc3700 1 -- 172.21.15.69:0/2003674753 wait complete. 2023-12-14T18:23:26.196 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1909088195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.197 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:23:26.198 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:23:26.198 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:26.198 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.198 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:26 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1101325160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.199 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-14T18:23:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 -- 172.21.15.69:0/1092954121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900fe700 msgr2=0x7f2a900feb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 --2- 172.21.15.69:0/1092954121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900fe700 0x7f2a900feb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009990 tx=0x7f2a80009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 -- 172.21.15.69:0/1092954121 shutdown_connections 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 --2- 172.21.15.69:0/1092954121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a90100280 0x7f2a90106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 --2- 172.21.15.69:0/1092954121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900fe700 0x7f2a900feb10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 --2- 172.21.15.69:0/1092954121 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a900ff8f0 0x7f2a900ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 -- 172.21.15.69:0/1092954121 >> 172.21.15.69:0/1092954121 conn(0x7f2a900f9d20 msgr2=0x7f2a900fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 -- 172.21.15.69:0/1092954121 shutdown_connections 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.327+0000 7f2a94da0700 1 -- 172.21.15.69:0/1092954121 wait complete. 2023-12-14T18:23:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 Processor -- start 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 -- start start 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a900fe700 0x7f2a90194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 0x7f2a901951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a90100280 0x7f2a9019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9019c800 con 0x7f2a900ff8f0 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9019c970 con 0x7f2a90100280 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a94da0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9019cb30 con 0x7f2a900fe700 2023-12-14T18:23:26.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 0x7f2a901951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 0x7f2a901951d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51934/0 (socket says 172.21.15.69:51934) 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 -- 172.21.15.69:0/2023244070 learned_addr learned my addr 172.21.15.69:0/2023244070 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8f7fe700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a900fe700 0x7f2a90194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8ffff700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a90100280 0x7f2a9019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 -- 172.21.15.69:0/2023244070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a900fe700 msgr2=0x7f2a90194c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a900fe700 0x7f2a90194c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 -- 172.21.15.69:0/2023244070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a90100280 msgr2=0x7f2a9019c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.328+0000 7f2a8effd700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a90100280 0x7f2a9019c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a8effd700 1 -- 172.21.15.69:0/2023244070 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800095f0 con 0x7f2a900ff8f0 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a8ffff700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a90100280 0x7f2a9019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a8effd700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 0x7f2a901951d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800e9a0 tx=0x7f2a7800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:26.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78009790 con 0x7f2a900ff8f0 2023-12-14T18:23:26.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a90109f60 con 0x7f2a900ff8f0 2023-12-14T18:23:26.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a7800cbd0 con 0x7f2a900ff8f0 2023-12-14T18:23:26.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78018680 con 0x7f2a900ff8f0 2023-12-14T18:23:26.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.329+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a90109dd0 con 0x7f2a900ff8f0 2023-12-14T18:23:26.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.330+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a901052d0 con 0x7f2a900ff8f0 2023-12-14T18:23:26.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.331+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2a7800cd40 con 0x7f2a900ff8f0 2023-12-14T18:23:26.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.332+0000 7f2a8cff9700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2a7c0a1150 0x7f2a7c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.332+0000 7f2a8f7fe700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2a7c0a1150 0x7f2a7c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.332+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2a78014070 con 0x7f2a900ff8f0 2023-12-14T18:23:26.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.332+0000 7f2a8f7fe700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2a7c0a1150 0x7f2a7c0a3600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a800098e0 tx=0x7f2a8000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:26.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.335+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2a78096660 con 0x7f2a900ff8f0 2023-12-14T18:23:26.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1909088195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:26.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.377 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:26 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1101325160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.386 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1909088195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.387 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:26 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1101325160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:26.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.538+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2a90061b00 con 0x7f2a900ff8f0 2023-12-14T18:23:26.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.538+0000 7f2a8cff9700 1 -- 172.21.15.69:0/2023244070 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2a78099c80 con 0x7f2a900ff8f0 2023-12-14T18:23:26.540 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:26.540 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-12-14T18:23:26.540 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:23:26.540 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2023-12-14T18:23:26.541 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2023-12-14T18:23:26.541 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:23:26.541 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2a7c0a1150 msgr2=0x7f2a7c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2a7c0a1150 0x7f2a7c0a3600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a800098e0 tx=0x7f2a8000b260 comp rx=0 tx=0).stop 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 msgr2=0x7f2a901951d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 0x7f2a901951d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800e9a0 tx=0x7f2a7800ecb0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 shutdown_connections 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2a7c0a1150 0x7f2a7c0a3600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a90100280 0x7f2a9019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a900fe700 0x7f2a90194c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 --2- 172.21.15.69:0/2023244070 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a900ff8f0 0x7f2a901951d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.540+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 >> 172.21.15.69:0/2023244070 conn(0x7f2a900f9d20 msgr2=0x7f2a900fb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:26.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.541+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 shutdown_connections 2023-12-14T18:23:26.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.541+0000 7f2a94da0700 1 -- 172.21.15.69:0/2023244070 wait complete. 2023-12-14T18:23:26.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-14T18:23:26.555 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-14T18:23:26.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.688+0000 7f209aacc700 1 -- 172.21.15.69:0/3392607479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2094101e30 msgr2=0x7f20941086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.688+0000 7f209aacc700 1 --2- 172.21.15.69:0/3392607479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2094101e30 0x7f20941086f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f208c00b0a0 tx=0x7f208c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- 172.21.15.69:0/3392607479 shutdown_connections 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 --2- 172.21.15.69:0/3392607479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2094101e30 0x7f20941086f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 --2- 172.21.15.69:0/3392607479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20940fe4d0 0x7f20940fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 --2- 172.21.15.69:0/3392607479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20941014a0 0x7f20941018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- 172.21.15.69:0/3392607479 >> 172.21.15.69:0/3392607479 conn(0x7f20940f9ed0 msgr2=0x7f20940fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- 172.21.15.69:0/3392607479 shutdown_connections 2023-12-14T18:23:26.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- 172.21.15.69:0/3392607479 wait complete. 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 Processor -- start 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- start start 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20940fe4d0 0x7f2094195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 0x7f2094196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2094101e30 0x7f209419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209419db60 con 0x7f20941014a0 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209419dca0 con 0x7f2094101e30 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.689+0000 7f209aacc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209419de30 con 0x7f20940fe4d0 2023-12-14T18:23:26.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 0x7f2094196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 0x7f2094196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51938/0 (socket says 172.21.15.69:51938) 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2099069700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2094101e30 0x7f209419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 -- 172.21.15.69:0/4164863896 learned_addr learned my addr 172.21.15.69:0/4164863896 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2098868700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20940fe4d0 0x7f2094195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 -- 172.21.15.69:0/4164863896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20940fe4d0 msgr2=0x7f2094195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20940fe4d0 0x7f2094195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 -- 172.21.15.69:0/4164863896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2094101e30 msgr2=0x7f209419d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2094101e30 0x7f209419d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 -- 172.21.15.69:0/4164863896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009d00 con 0x7f20941014a0 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2099069700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2094101e30 0x7f209419d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:23:26.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2093fff700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 0x7f2094196520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f208000e9a0 tx=0x7f208000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080009790 con 0x7f20941014a0 2023-12-14T18:23:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2080010430 con 0x7f20941014a0 2023-12-14T18:23:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209410ba30 con 0x7f20941014a0 2023-12-14T18:23:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000cea0 con 0x7f20941014a0 2023-12-14T18:23:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.690+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209410b8a0 con 0x7f20941014a0 2023-12-14T18:23:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.691+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2094107230 con 0x7f20941014a0 2023-12-14T18:23:26.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.693+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f20800105a0 con 0x7f20941014a0 2023-12-14T18:23:26.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.693+0000 7f2091ffb700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20840a1150 0x7f20840a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:26.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.693+0000 7f2098868700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20840a1150 0x7f20840a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:26.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.693+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2080014070 con 0x7f20941014a0 2023-12-14T18:23:26.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.694+0000 7f2098868700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20840a1150 0x7f20840a3600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2094067bd0 tx=0x7f2088009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:26.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.698+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2080051730 con 0x7f20941014a0 2023-12-14T18:23:26.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:26.922+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20940619b0 con 0x7f20941014a0 2023-12-14T18:23:27.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2003674753' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2023244070' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2003674753' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2023244070' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-14T18:23:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2003674753' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:23:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2023244070' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-14T18:23:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:27.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.884+0000 7f2091ffb700 1 -- 172.21.15.69:0/4164863896 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2080099d40 con 0x7f20941014a0 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.888+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20840a1150 msgr2=0x7f20840a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.888+0000 7f209aacc700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20840a1150 0x7f20840a3600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2094067bd0 tx=0x7f2088009260 comp rx=0 tx=0).stop 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.888+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 msgr2=0x7f2094196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.888+0000 7f209aacc700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 0x7f2094196520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f208000e9a0 tx=0x7f208000ecb0 comp rx=0 tx=0).stop 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 shutdown_connections 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20840a1150 0x7f20840a3600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2094101e30 0x7f209419d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20940fe4d0 0x7f2094195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 --2- 172.21.15.69:0/4164863896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20941014a0 0x7f2094196520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 >> 172.21.15.69:0/4164863896 conn(0x7f20940f9ed0 msgr2=0x7f20940fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 shutdown_connections 2023-12-14T18:23:27.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:27.889+0000 7f209aacc700 1 -- 172.21.15.69:0/4164863896 wait complete. 2023-12-14T18:23:27.892 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2023-12-14T18:23:27.906 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-14T18:23:28.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 -- 172.21.15.69:0/2268309526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48105f40 msgr2=0x7f5f48108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:28.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 --2- 172.21.15.69:0/2268309526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48105f40 0x7f5f48108340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000b0a0 tx=0x7f5f4000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 -- 172.21.15.69:0/2268309526 shutdown_connections 2023-12-14T18:23:28.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 --2- 172.21.15.69:0/2268309526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48105f40 0x7f5f48108340 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 --2- 172.21.15.69:0/2268309526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48100d00 0x7f5f481030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 --2- 172.21.15.69:0/2268309526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f48103620 0x7f5f48105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 -- 172.21.15.69:0/2268309526 >> 172.21.15.69:0/2268309526 conn(0x7f5f480fa740 msgr2=0x7f5f480fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 -- 172.21.15.69:0/2268309526 shutdown_connections 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 -- 172.21.15.69:0/2268309526 wait complete. 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 Processor -- start 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.039+0000 7f5f50185700 1 -- start start 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f48100d00 0x7f5f48195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 0x7f5f48196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48105f40 0x7f5f4819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4819da80 con 0x7f5f48103620 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4819dbc0 con 0x7f5f48100d00 2023-12-14T18:23:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4819dd50 con 0x7f5f48105f40 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 0x7f5f48196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 0x7f5f48196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51944/0 (socket says 172.21.15.69:51944) 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 -- 172.21.15.69:0/1926750818 learned_addr learned my addr 172.21.15.69:0/1926750818 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4df21700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f48100d00 0x7f5f48195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4e722700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48105f40 0x7f5f4819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 -- 172.21.15.69:0/1926750818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48105f40 msgr2=0x7f5f4819d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48105f40 0x7f5f4819d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 -- 172.21.15.69:0/1926750818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f48100d00 msgr2=0x7f5f48195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f48100d00 0x7f5f48195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 -- 172.21.15.69:0/1926750818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f40009d00 con 0x7f5f48103620 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f4d720700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 0x7f5f48196440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c9b0 tx=0x7f5f4400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44007b00 con 0x7f5f48103620 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f4400ce50 con 0x7f5f48103620 2023-12-14T18:23:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4810ba90 con 0x7f5f48103620 2023-12-14T18:23:28.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44018420 con 0x7f5f48103620 2023-12-14T18:23:28.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.040+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4810b900 con 0x7f5f48103620 2023-12-14T18:23:28.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.041+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f480fc2b0 con 0x7f5f48103620 2023-12-14T18:23:28.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.042+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5f4400f450 con 0x7f5f48103620 2023-12-14T18:23:28.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.043+0000 7f5f3effd700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5f340a1150 0x7f5f340a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:28.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.043+0000 7f5f4df21700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5f340a1150 0x7f5f340a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:28.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.043+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f5f440cc5b0 con 0x7f5f48103620 2023-12-14T18:23:28.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.043+0000 7f5f4df21700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5f340a1150 0x7f5f340a3600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005950 tx=0x7f5f3800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:28.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.047+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5f44095f90 con 0x7f5f48103620 2023-12-14T18:23:28.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.241+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5f4802cfe0 con 0x7f5f48103620 2023-12-14T18:23:28.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4164863896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-14T18:23:28.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4164863896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-14T18:23:28.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:28 smithi069 ceph-mon[42047]: osdmap e76: 12 total, 12 up, 12 in 2023-12-14T18:23:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4164863896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-14T18:23:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:28.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:23:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:23:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:23:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4164863896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-14T18:23:28.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:28 smithi119 ceph-mon[43973]: osdmap e76: 12 total, 12 up, 12 in 2023-12-14T18:23:28.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4164863896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-14T18:23:28.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4164863896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-14T18:23:28.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:28 smithi091 ceph-mon[43601]: osdmap e76: 12 total, 12 up, 12 in 2023-12-14T18:23:28.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.887+0000 7f5f3effd700 1 -- 172.21.15.69:0/1926750818 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5f4400f700 con 0x7f5f48103620 2023-12-14T18:23:28.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.898+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5f340a1150 msgr2=0x7f5f340a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.898+0000 7f5f50185700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5f340a1150 0x7f5f340a3600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005950 tx=0x7f5f3800b410 comp rx=0 tx=0).stop 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.898+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 msgr2=0x7f5f48196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.898+0000 7f5f50185700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 0x7f5f48196440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c9b0 tx=0x7f5f4400ccc0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.899+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 shutdown_connections 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.899+0000 7f5f50185700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5f340a1150 0x7f5f340a3600 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005950 tx=0x7f5f3800b410 comp rx=0 tx=0).stop 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.899+0000 7f5f50185700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48105f40 0x7f5f4819d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.899+0000 7f5f50185700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f48100d00 0x7f5f48195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.900+0000 7f5f50185700 1 --2- 172.21.15.69:0/1926750818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f48103620 0x7f5f48196440 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c9b0 tx=0x7f5f4400ccc0 comp rx=0 tx=0).stop 2023-12-14T18:23:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.900+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 >> 172.21.15.69:0/1926750818 conn(0x7f5f480fa740 msgr2=0x7f5f48101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:28.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.901+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 shutdown_connections 2023-12-14T18:23:28.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:28.903+0000 7f5f50185700 1 -- 172.21.15.69:0/1926750818 wait complete. 2023-12-14T18:23:28.908 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2023-12-14T18:23:28.919 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-14T18:23:29.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 -- 172.21.15.69:0/1903379551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c100cc0 msgr2=0x7ff92c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 --2- 172.21.15.69:0/1903379551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c100cc0 0x7ff92c1030a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009990 tx=0x7ff91c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 -- 172.21.15.69:0/1903379551 shutdown_connections 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 --2- 172.21.15.69:0/1903379551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff92c105f00 0x7ff92c108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 --2- 172.21.15.69:0/1903379551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c100cc0 0x7ff92c1030a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 --2- 172.21.15.69:0/1903379551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff92c1035e0 0x7ff92c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 -- 172.21.15.69:0/1903379551 >> 172.21.15.69:0/1903379551 conn(0x7ff92c0fa780 msgr2=0x7ff92c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 -- 172.21.15.69:0/1903379551 shutdown_connections 2023-12-14T18:23:29.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.042+0000 7ff931378700 1 -- 172.21.15.69:0/1903379551 wait complete. 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 Processor -- start 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 -- start start 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff92c100cc0 0x7ff92c100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff92c1035e0 0x7ff92c0fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 0x7ff92c0ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0ff950 con 0x7ff92c105f00 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0ffac0 con 0x7ff92c100cc0 2023-12-14T18:23:29.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff931378700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c19ff70 con 0x7ff92c1035e0 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 0x7ff92c0ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 0x7ff92c0ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51962/0 (socket says 172.21.15.69:51962) 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.043+0000 7ff92b7fe700 1 -- 172.21.15.69:0/3347310354 learned_addr learned my addr 172.21.15.69:0/3347310354 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92a7fc700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff92c1035e0 0x7ff92c0fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92affd700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff92c100cc0 0x7ff92c100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92b7fe700 1 -- 172.21.15.69:0/3347310354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff92c1035e0 msgr2=0x7ff92c0fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92b7fe700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff92c1035e0 0x7ff92c0fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92b7fe700 1 -- 172.21.15.69:0/3347310354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff92c100cc0 msgr2=0x7ff92c100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92b7fe700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff92c100cc0 0x7ff92c100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92b7fe700 1 -- 172.21.15.69:0/3347310354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0095f0 con 0x7ff92c105f00 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff92b7fe700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 0x7ff92c0ff1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff924007ee0 tx=0x7ff92400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400dd20 con 0x7ff92c105f00 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff92400f040 con 0x7ff92c105f00 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c10ba50 con 0x7ff92c105f00 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004750 con 0x7ff92c105f00 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.044+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c10b8c0 con 0x7ff92c105f00 2023-12-14T18:23:29.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.045+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c0fc2f0 con 0x7ff92c105f00 2023-12-14T18:23:29.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.046+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff924003a00 con 0x7ff92c105f00 2023-12-14T18:23:29.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.047+0000 7ff913fff700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff9140a11d0 0x7ff9140a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.047+0000 7ff92affd700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff9140a11d0 0x7ff9140a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.047+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7879+0+0 (secure 0 0 0) 0x7ff9240cc8c0 con 0x7ff92c105f00 2023-12-14T18:23:29.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.047+0000 7ff92affd700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff9140a11d0 0x7ff9140a3680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff91c006010 tx=0x7ff91c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:29.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.050+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff924096120 con 0x7ff92c105f00 2023-12-14T18:23:29.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.288+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff92c02cfe0 con 0x7ff92c105f00 2023-12-14T18:23:29.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.296+0000 7ff913fff700 1 -- 172.21.15.69:0/3347310354 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff9240230c0 con 0x7ff92c105f00 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff9140a11d0 msgr2=0x7ff9140a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff9140a11d0 0x7ff9140a3680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff91c006010 tx=0x7ff91c005960 comp rx=0 tx=0).stop 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 msgr2=0x7ff92c0ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 0x7ff92c0ff1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff924007ee0 tx=0x7ff92400d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 shutdown_connections 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff9140a11d0 0x7ff9140a3680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff92c105f00 0x7ff92c0ff1b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff92c100cc0 0x7ff92c100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 --2- 172.21.15.69:0/3347310354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff92c1035e0 0x7ff92c0fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.304+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 >> 172.21.15.69:0/3347310354 conn(0x7ff92c0fa780 msgr2=0x7ff92c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:29.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.305+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 shutdown_connections 2023-12-14T18:23:29.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.305+0000 7ff931378700 1 -- 172.21.15.69:0/3347310354 wait complete. 2023-12-14T18:23:29.318 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 2 and data pool 3 2023-12-14T18:23:29.328 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:23:29.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/1620354568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb00fe8a0 msgr2=0x7f2bb00fecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/1620354568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb00fe8a0 0x7f2bb00fecb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009990 tx=0x7f2ba0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/1620354568 shutdown_connections 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/1620354568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bb0100420 0x7f2bb0106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/1620354568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb00fe8a0 0x7f2bb00fecb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/1620354568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb00ffa90 0x7f2bb00ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/1620354568 >> 172.21.15.69:0/1620354568 conn(0x7f2bb00f9e80 msgr2=0x7f2bb00fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/1620354568 shutdown_connections 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/1620354568 wait complete. 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.451+0000 7f2bb7ed0700 1 Processor -- start 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 -- start start 2023-12-14T18:23:29.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb00fe8a0 0x7f2bb01981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bb00ffa90 0x7f2bb0198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 0x7f2bb019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb019fd50 con 0x7f2bb0100420 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb019fe90 con 0x7f2bb00ffa90 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb01a0020 con 0x7f2bb00fe8a0 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 0x7f2bb019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 0x7f2bb019f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51982/0 (socket says 172.21.15.69:51982) 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 -- 172.21.15.69:0/4011028419 learned_addr learned my addr 172.21.15.69:0/4011028419 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb546b700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bb00ffa90 0x7f2bb0198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb5c6c700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb00fe8a0 0x7f2bb01981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 -- 172.21.15.69:0/4011028419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb00fe8a0 msgr2=0x7f2bb01981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb00fe8a0 0x7f2bb01981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 -- 172.21.15.69:0/4011028419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bb00ffa90 msgr2=0x7f2bb0198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bb00ffa90 0x7f2bb0198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 -- 172.21.15.69:0/4011028419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00095f0 con 0x7f2bb0100420 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb646d700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 0x7f2bb019f780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8007ee0 tx=0x7f2ba800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800ddd0 con 0x7f2bb0100420 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ba800f040 con 0x7f2bb0100420 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb010a9b0 con 0x7f2bb0100420 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8004870 con 0x7f2bb0100420 2023-12-14T18:23:29.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.452+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb010a820 con 0x7f2bb0100420 2023-12-14T18:23:29.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.453+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb01a06c0 con 0x7f2bb0100420 2023-12-14T18:23:29.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.454+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2ba8003a00 con 0x7f2bb0100420 2023-12-14T18:23:29.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.455+0000 7f2ba6ffd700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2b9c0a11d0 0x7f2b9c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.455+0000 7f2bb5c6c700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2b9c0a11d0 0x7f2b9c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.455+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ba80cc2b0 con 0x7f2bb0100420 2023-12-14T18:23:29.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.455+0000 7f2bb5c6c700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2b9c0a11d0 0x7f2b9c0a3680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c010 tx=0x7f2ba000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:29.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:29 smithi069 ceph-mon[42047]: pgmap v217: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:29.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:29 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1926750818' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-14T18:23:29.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:29 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1926750818' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-14T18:23:29.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:29 smithi069 ceph-mon[42047]: osdmap e77: 12 total, 12 up, 12 in 2023-12-14T18:23:29.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.459+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2ba804e730 con 0x7f2bb0100420 2023-12-14T18:23:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:29 smithi119 ceph-mon[43973]: pgmap v217: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:29 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1926750818' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-14T18:23:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:29 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1926750818' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-14T18:23:29.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:29 smithi119 ceph-mon[43973]: osdmap e77: 12 total, 12 up, 12 in 2023-12-14T18:23:29.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:29 smithi091 ceph-mon[43601]: pgmap v217: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-14T18:23:29.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:29 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1926750818' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-14T18:23:29.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:29 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1926750818' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-14T18:23:29.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:29 smithi091 ceph-mon[43601]: osdmap e77: 12 total, 12 up, 12 in 2023-12-14T18:23:29.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.650+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bb01a0d60 con 0x7f2bb0100420 2023-12-14T18:23:29.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.652+0000 7f2ba6ffd700 1 -- 172.21.15.69:0/4011028419 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f2ba8095ab0 con 0x7f2bb0100420 2023-12-14T18:23:29.654 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:29.654 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":78,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:29.290875+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2b9c0a11d0 msgr2=0x7f2b9c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2b9c0a11d0 0x7f2b9c0a3680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c010 tx=0x7f2ba000b540 comp rx=0 tx=0).stop 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 msgr2=0x7f2bb019f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 0x7f2bb019f780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8007ee0 tx=0x7f2ba800d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 shutdown_connections 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2b9c0a11d0 0x7f2b9c0a3680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100420 0x7f2bb019f780 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb00fe8a0 0x7f2bb01981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 --2- 172.21.15.69:0/4011028419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bb00ffa90 0x7f2bb0198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 >> 172.21.15.69:0/4011028419 conn(0x7f2bb00f9e80 msgr2=0x7f2bb00fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:29.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 shutdown_connections 2023-12-14T18:23:29.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.654+0000 7f2bb7ed0700 1 -- 172.21.15.69:0/4011028419 wait complete. 2023-12-14T18:23:29.669 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:23:29.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 -- 172.21.15.69:0/310574437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40580ff140 msgr2=0x7f40580ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 --2- 172.21.15.69:0/310574437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40580ff140 0x7f40580ff550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f404c009990 tx=0x7f404c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 -- 172.21.15.69:0/310574437 shutdown_connections 2023-12-14T18:23:29.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 --2- 172.21.15.69:0/310574437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 0x7f4058107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 --2- 172.21.15.69:0/310574437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40580ff140 0x7f40580ff550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 --2- 172.21.15.69:0/310574437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4058100330 0x7f4058100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 -- 172.21.15.69:0/310574437 >> 172.21.15.69:0/310574437 conn(0x7f40580fa720 msgr2=0x7f40580fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 -- 172.21.15.69:0/310574437 shutdown_connections 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.788+0000 7f405eae4700 1 -- 172.21.15.69:0/310574437 wait complete. 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 Processor -- start 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 -- start start 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40580ff140 0x7f40581980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 0x7f4058198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 0x7f405819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405819fc40 con 0x7f4058100330 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405819fd80 con 0x7f40580ff140 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405eae4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405819ff10 con 0x7f4058100cc0 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f4057fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 0x7f4058198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f4057fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 0x7f4058198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52002/0 (socket says 172.21.15.69:52002) 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f4057fff700 1 -- 172.21.15.69:0/1320114826 learned_addr learned my addr 172.21.15.69:0/1320114826 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f405d081700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 0x7f405819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.789+0000 7f4057fff700 1 -- 172.21.15.69:0/1320114826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 msgr2=0x7f405819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4057fff700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 0x7f405819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f405c880700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40580ff140 0x7f40581980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4057fff700 1 -- 172.21.15.69:0/1320114826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40580ff140 msgr2=0x7f40581980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4057fff700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40580ff140 0x7f40581980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4057fff700 1 -- 172.21.15.69:0/1320114826 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0095f0 con 0x7f4058100330 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f405d081700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 0x7f405819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4057fff700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 0x7f4058198600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f404400e9a0 tx=0x7f404400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044009790 con 0x7f4058100330 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f404400cbd0 con 0x7f4058100330 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405810a960 con 0x7f4058100330 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044018680 con 0x7f4058100330 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.790+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405810a7d0 con 0x7f4058100330 2023-12-14T18:23:29.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.791+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4058067160 con 0x7f4058100330 2023-12-14T18:23:29.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.792+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f404400cd40 con 0x7f4058100330 2023-12-14T18:23:29.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.793+0000 7f4055ffb700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40480a11d0 0x7f40480a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:29.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.793+0000 7f405c880700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40480a11d0 0x7f40480a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:29.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.793+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4044014070 con 0x7f4058100330 2023-12-14T18:23:29.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.793+0000 7f405c880700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40480a11d0 0x7f40480a3680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f404c00b2e0 tx=0x7f404c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:29.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.796+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f40440965b0 con 0x7f4058100330 2023-12-14T18:23:29.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.988+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40581a0b10 con 0x7f4058100330 2023-12-14T18:23:29.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.989+0000 7f4055ffb700 1 -- 172.21.15.69:0/1320114826 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f4044026090 con 0x7f4058100330 2023-12-14T18:23:29.991 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:29.992 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":78,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:29.290875+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:29.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40480a11d0 msgr2=0x7f40480a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40480a11d0 0x7f40480a3680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f404c00b2e0 tx=0x7f404c005e80 comp rx=0 tx=0).stop 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 msgr2=0x7f4058198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 0x7f4058198600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f404400e9a0 tx=0x7f404400ed60 comp rx=0 tx=0).stop 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 shutdown_connections 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40480a11d0 0x7f40480a3680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4058100cc0 0x7f405819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40580ff140 0x7f40581980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 --2- 172.21.15.69:0/1320114826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4058100330 0x7f4058198600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.991+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 >> 172.21.15.69:0/1320114826 conn(0x7f40580fa720 msgr2=0x7f4058068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.992+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 shutdown_connections 2023-12-14T18:23:29.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:29.992+0000 7f405eae4700 1 -- 172.21.15.69:0/1320114826 wait complete. 2023-12-14T18:23:30.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-14T18:23:30.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 -- 172.21.15.69:0/3023721877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100340 msgr2=0x7f9048100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:30.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 --2- 172.21.15.69:0/3023721877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100340 0x7f9048100790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9038009990 tx=0x7f9038009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:30.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 -- 172.21.15.69:0/3023721877 shutdown_connections 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 --2- 172.21.15.69:0/3023721877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100cd0 0x7f9048107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 --2- 172.21.15.69:0/3023721877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ff150 0x7f90480ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 --2- 172.21.15.69:0/3023721877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100340 0x7f9048100790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 -- 172.21.15.69:0/3023721877 >> 172.21.15.69:0/3023721877 conn(0x7f90480fa770 msgr2=0x7f90480fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 -- 172.21.15.69:0/3023721877 shutdown_connections 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.128+0000 7f904d575700 1 -- 172.21.15.69:0/3023721877 wait complete. 2023-12-14T18:23:30.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 Processor -- start 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 -- start start 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ff150 0x7f9048069b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100340 0x7f904819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 0x7f904819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904819da10 con 0x7f9048100cd0 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904819db80 con 0x7f90480ff150 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f904d575700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904819dd40 con 0x7f9048100340 2023-12-14T18:23:30.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 0x7f904819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 0x7f904819d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52020/0 (socket says 172.21.15.69:52020) 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90477fe700 1 -- 172.21.15.69:0/3361077559 learned_addr learned my addr 172.21.15.69:0/3361077559 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90467fc700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100340 0x7f904819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90477fe700 1 -- 172.21.15.69:0/3361077559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100340 msgr2=0x7f904819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90477fe700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100340 0x7f904819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f9046ffd700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ff150 0x7f9048069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.129+0000 7f90477fe700 1 -- 172.21.15.69:0/3361077559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ff150 msgr2=0x7f9048069b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f90477fe700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ff150 0x7f9048069b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f90477fe700 1 -- 172.21.15.69:0/3361077559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380095f0 con 0x7f9048100cd0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f90467fc700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100340 0x7f904819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f90477fe700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 0x7f904819d240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9040007ee0 tx=0x7f904000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040017070 con 0x7f9048100cd0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f904000f040 con 0x7f9048100cd0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904810a960 con 0x7f9048100cd0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040005710 con 0x7f9048100cd0 2023-12-14T18:23:30.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.130+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904810a7d0 con 0x7f9048100cd0 2023-12-14T18:23:30.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.131+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9048106790 con 0x7f9048100cd0 2023-12-14T18:23:30.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.132+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9040005870 con 0x7f9048100cd0 2023-12-14T18:23:30.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.132+0000 7f902ffff700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90300a1150 0x7f90300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:30.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.132+0000 7f9046ffd700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90300a1150 0x7f90300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:30.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.132+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f90400cc070 con 0x7f9048100cd0 2023-12-14T18:23:30.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.133+0000 7f9046ffd700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90300a1150 0x7f90300a3600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f903c005fd0 tx=0x7f903c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:30.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.137+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9040095910 con 0x7f9048100cd0 2023-12-14T18:23:30.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:30.371+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f904802cfe0 con 0x7f9048100cd0 2023-12-14T18:23:30.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3347310354' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-14T18:23:30.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: osdmap e78: 12 total, 12 up, 12 in 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3347310354' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] up:active 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4011028419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:30.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:30 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1320114826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:30.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3347310354' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-14T18:23:30.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-14T18:23:30.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: osdmap e78: 12 total, 12 up, 12 in 2023-12-14T18:23:30.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3347310354' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-14T18:23:30.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-14T18:23:30.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-14T18:23:30.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] up:active 2023-12-14T18:23:30.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:30.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4011028419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:30.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:30 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1320114826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:30.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3347310354' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: osdmap e78: 12 total, 12 up, 12 in 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3347310354' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] up:active 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4011028419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:30.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:30 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1320114826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:31.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.299+0000 7f902ffff700 1 -- 172.21.15.69:0/3361077559 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9040098f30 con 0x7f9048100cd0 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90300a1150 msgr2=0x7f90300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90300a1150 0x7f90300a3600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f903c005fd0 tx=0x7f903c005f60 comp rx=0 tx=0).stop 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 msgr2=0x7f904819d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 0x7f904819d240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9040007ee0 tx=0x7f904000d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 shutdown_connections 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90300a1150 0x7f90300a3600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9048100cd0 0x7f904819d240 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ff150 0x7f9048069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 --2- 172.21.15.69:0/3361077559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9048100340 0x7f904819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.303+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 >> 172.21.15.69:0/3361077559 conn(0x7f90480fa770 msgr2=0x7f90481038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.304+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 shutdown_connections 2023-12-14T18:23:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.304+0000 7f904d575700 1 -- 172.21.15.69:0/3361077559 wait complete. 2023-12-14T18:23:31.320 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-12-14T18:23:31.321 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-14T18:23:31.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 -- 172.21.15.69:0/4009461199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 msgr2=0x7fe588103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:31.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 --2- 172.21.15.69:0/4009461199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588103080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe578009990 tx=0x7fe578009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 -- 172.21.15.69:0/4009461199 shutdown_connections 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 --2- 172.21.15.69:0/4009461199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588105ee0 0x7fe588108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 --2- 172.21.15.69:0/4009461199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588103080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 --2- 172.21.15.69:0/4009461199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5881035c0 0x7fe5881059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 -- 172.21.15.69:0/4009461199 >> 172.21.15.69:0/4009461199 conn(0x7fe5880fa740 msgr2=0x7fe5880fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 -- 172.21.15.69:0/4009461199 shutdown_connections 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.450+0000 7fe58db39700 1 -- 172.21.15.69:0/4009461199 wait complete. 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 Processor -- start 2023-12-14T18:23:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 -- start start 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5881035c0 0x7fe588196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588105ee0 0x7fe58819d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58819da40 con 0x7fe588100ca0 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58819db80 con 0x7fe5881035c0 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe58db39700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58819dd10 con 0x7fe588105ee0 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52034/0 (socket says 172.21.15.69:52034) 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 -- 172.21.15.69:0/3838027222 learned_addr learned my addr 172.21.15.69:0/3838027222 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 -- 172.21.15.69:0/3838027222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588105ee0 msgr2=0x7fe58819d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588105ee0 0x7fe58819d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 -- 172.21.15.69:0/3838027222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5881035c0 msgr2=0x7fe588196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5881035c0 0x7fe588196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 -- 172.21.15.69:0/3838027222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780095f0 con 0x7fe588100ca0 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.451+0000 7fe5877fe700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588195ec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe578006010 tx=0x7fe578003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.452+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57801d070 con 0x7fe588100ca0 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.452+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58810ba30 con 0x7fe588100ca0 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.452+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe578004640 con 0x7fe588100ca0 2023-12-14T18:23:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.452+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800f460 con 0x7fe588100ca0 2023-12-14T18:23:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.452+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58810b8a0 con 0x7fe588100ca0 2023-12-14T18:23:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.453+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5880fc2b0 con 0x7fe588100ca0 2023-12-14T18:23:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.454+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe578022470 con 0x7fe588100ca0 2023-12-14T18:23:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.454+0000 7fe584ff9700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe5740a1150 0x7fe5740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.455+0000 7fe586ffd700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe5740a1150 0x7fe5740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.455+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe5780cdf60 con 0x7fe588100ca0 2023-12-14T18:23:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.455+0000 7fe586ffd700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe5740a1150 0x7fe5740a3600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe57000a990 tx=0x7fe570005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:31.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.458+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe578097870 con 0x7fe588100ca0 2023-12-14T18:23:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:31 smithi119 ceph-mon[43973]: pgmap v220: 97 pgs: 14 creating+peering, 23 active+clean, 60 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-12-14T18:23:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:31 smithi119 ceph-mon[43973]: osdmap e79: 12 total, 12 up, 12 in 2023-12-14T18:23:31.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:31 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3361077559' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-14T18:23:31.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:31 smithi091 ceph-mon[43601]: pgmap v220: 97 pgs: 14 creating+peering, 23 active+clean, 60 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-12-14T18:23:31.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:31 smithi091 ceph-mon[43601]: osdmap e79: 12 total, 12 up, 12 in 2023-12-14T18:23:31.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:31 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3361077559' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-14T18:23:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:31.691+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fe588061900 con 0x7fe588100ca0 2023-12-14T18:23:31.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:31 smithi069 ceph-mon[42047]: pgmap v220: 97 pgs: 14 creating+peering, 23 active+clean, 60 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-12-14T18:23:31.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:31 smithi069 ceph-mon[42047]: osdmap e79: 12 total, 12 up, 12 in 2023-12-14T18:23:31.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:31 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3361077559' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-14T18:23:32.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.308+0000 7fe584ff9700 1 -- 172.21.15.69:0/3838027222 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe57809ae90 con 0x7fe588100ca0 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe5740a1150 msgr2=0x7fe5740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe5740a1150 0x7fe5740a3600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe57000a990 tx=0x7fe570005c80 comp rx=0 tx=0).stop 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 msgr2=0x7fe588195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588195ec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe578006010 tx=0x7fe578003b00 comp rx=0 tx=0).stop 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 shutdown_connections 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe5740a1150 0x7fe5740a3600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588105ee0 0x7fe58819d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe588100ca0 0x7fe588195ec0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 --2- 172.21.15.69:0/3838027222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5881035c0 0x7fe588196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 >> 172.21.15.69:0/3838027222 conn(0x7fe5880fa740 msgr2=0x7fe588101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 shutdown_connections 2023-12-14T18:23:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.311+0000 7fe58db39700 1 -- 172.21.15.69:0/3838027222 wait complete. 2023-12-14T18:23:32.329 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-12-14T18:23:32.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 -- 172.21.15.69:0/3592842149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf401035c0 msgr2=0x7fdf401059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 --2- 172.21.15.69:0/3592842149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf401035c0 0x7fdf401059a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009990 tx=0x7fdf3c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 -- 172.21.15.69:0/3592842149 shutdown_connections 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 --2- 172.21.15.69:0/3592842149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf40105ee0 0x7fdf40108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 --2- 172.21.15.69:0/3592842149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40100ca0 0x7fdf40103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 --2- 172.21.15.69:0/3592842149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf401035c0 0x7fdf401059a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 -- 172.21.15.69:0/3592842149 >> 172.21.15.69:0/3592842149 conn(0x7fdf400fa740 msgr2=0x7fdf400fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 -- 172.21.15.69:0/3592842149 shutdown_connections 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 -- 172.21.15.69:0/3592842149 wait complete. 2023-12-14T18:23:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.455+0000 7fdf47a75700 1 Processor -- start 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 -- start start 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40100ca0 0x7fdf40100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf401035c0 0x7fdf400fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 0x7fdf400ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400ff930 con 0x7fdf40105ee0 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400ffaa0 con 0x7fdf401035c0 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4019ff30 con 0x7fdf40100ca0 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 0x7fdf400ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 0x7fdf400ff190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52038/0 (socket says 172.21.15.69:52038) 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 -- 172.21.15.69:0/2843750706 learned_addr learned my addr 172.21.15.69:0/2843750706 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf45811700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40100ca0 0x7fdf40100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 -- 172.21.15.69:0/2843750706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40100ca0 msgr2=0x7fdf40100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf45010700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf401035c0 0x7fdf400fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40100ca0 0x7fdf40100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 -- 172.21.15.69:0/2843750706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf401035c0 msgr2=0x7fdf400fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf401035c0 0x7fdf400fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 -- 172.21.15.69:0/2843750706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0095f0 con 0x7fdf40105ee0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf46012700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 0x7fdf400ff190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf38007ee0 tx=0x7fdf3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38017070 con 0x7fdf40105ee0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf3800f040 con 0x7fdf40105ee0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4010ba90 con 0x7fdf40105ee0 2023-12-14T18:23:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.456+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38005710 con 0x7fdf40105ee0 2023-12-14T18:23:32.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.457+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4010b900 con 0x7fdf40105ee0 2023-12-14T18:23:32.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.457+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf401a05d0 con 0x7fdf40105ee0 2023-12-14T18:23:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.458+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdf38005870 con 0x7fdf40105ee0 2023-12-14T18:23:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.459+0000 7fdf36ffd700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fdf2c0a1150 0x7fdf2c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.459+0000 7fdf45811700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fdf2c0a1150 0x7fdf2c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.459+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdf380cc620 con 0x7fdf40105ee0 2023-12-14T18:23:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.460+0000 7fdf45811700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fdf2c0a1150 0x7fdf2c0a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005950 tx=0x7fdf3000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:32.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.463+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdf38095ec0 con 0x7fdf40105ee0 2023-12-14T18:23:32.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:32 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3361077559' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-14T18:23:32.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:32 smithi119 ceph-mon[43973]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:32.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:32 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3838027222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-14T18:23:32.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:32 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3361077559' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-14T18:23:32.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:32 smithi091 ceph-mon[43601]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:32.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:32 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3838027222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-14T18:23:32.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:32.697+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fdf401a0b80 con 0x7fdf40105ee0 2023-12-14T18:23:32.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:32 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3361077559' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-14T18:23:32.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:32 smithi069 ceph-mon[42047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:32.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:32 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3838027222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-14T18:23:33.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.316+0000 7fdf36ffd700 1 -- 172.21.15.69:0/2843750706 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdf380994e0 con 0x7fdf40105ee0 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fdf2c0a1150 msgr2=0x7fdf2c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fdf2c0a1150 0x7fdf2c0a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005950 tx=0x7fdf3000b410 comp rx=0 tx=0).stop 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 msgr2=0x7fdf400ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 0x7fdf400ff190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf38007ee0 tx=0x7fdf3800d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 shutdown_connections 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fdf2c0a1150 0x7fdf2c0a3600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf40105ee0 0x7fdf400ff190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40100ca0 0x7fdf40100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.318+0000 7fdf47a75700 1 --2- 172.21.15.69:0/2843750706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf401035c0 0x7fdf400fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.319+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 >> 172.21.15.69:0/2843750706 conn(0x7fdf400fa740 msgr2=0x7fdf40102150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.319+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 shutdown_connections 2023-12-14T18:23:33.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.319+0000 7fdf47a75700 1 -- 172.21.15.69:0/2843750706 wait complete. 2023-12-14T18:23:33.337 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-14T18:23:33.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 -- 172.21.15.69:0/3756402782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101420 msgr2=0x7f5060101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 --2- 172.21.15.69:0/3756402782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101420 0x7f5060101870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5048009990 tx=0x7f5048009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 -- 172.21.15.69:0/3756402782 shutdown_connections 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 --2- 172.21.15.69:0/3756402782 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101db0 0x7f5060108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 --2- 172.21.15.69:0/3756402782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5060100230 0x7f5060100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 --2- 172.21.15.69:0/3756402782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101420 0x7f5060101870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 -- 172.21.15.69:0/3756402782 >> 172.21.15.69:0/3756402782 conn(0x7f50600fb850 msgr2=0x7f50600fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 -- 172.21.15.69:0/3756402782 shutdown_connections 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.462+0000 7f5065927700 1 -- 172.21.15.69:0/3756402782 wait complete. 2023-12-14T18:23:33.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 Processor -- start 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 -- start start 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5060100230 0x7f5060195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101420 0x7f5060196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 0x7f506019d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506019da90 con 0x7f5060101db0 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506019dbd0 con 0x7f5060101420 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f5065927700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506019dd60 con 0x7f5060100230 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f505f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 0x7f506019d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f505f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 0x7f506019d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52064/0 (socket says 172.21.15.69:52064) 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.463+0000 7f505f7fe700 1 -- 172.21.15.69:0/2310199822 learned_addr learned my addr 172.21.15.69:0/2310199822 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505effd700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5060100230 0x7f5060195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505e7fc700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101420 0x7f5060196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505f7fe700 1 -- 172.21.15.69:0/2310199822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5060100230 msgr2=0x7f5060195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505f7fe700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5060100230 0x7f5060195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505f7fe700 1 -- 172.21.15.69:0/2310199822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101420 msgr2=0x7f5060196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505f7fe700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101420 0x7f5060196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505f7fe700 1 -- 172.21.15.69:0/2310199822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480095f0 con 0x7f5060101db0 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505e7fc700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101420 0x7f5060196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f505f7fe700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 0x7f506019d4c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f505800c970 tx=0x7f505800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058007b00 con 0x7f5060101db0 2023-12-14T18:23:33.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f505800ce60 con 0x7f5060101db0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058005440 con 0x7f5060101db0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506010ba40 con 0x7f5060101db0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.464+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506010b8b0 con 0x7f5060101db0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.465+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506019e3a0 con 0x7f5060101db0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.466+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f50580055a0 con 0x7f5060101db0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.467+0000 7f5064925700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f504c0a1150 0x7f504c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.467+0000 7f505effd700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f504c0a1150 0x7f504c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:33.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.467+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f50580cc2c0 con 0x7f5060101db0 2023-12-14T18:23:33.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.467+0000 7f505effd700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f504c0a1150 0x7f504c0a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5050009550 tx=0x7f50500091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:33.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.471+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5058095b60 con 0x7f5060101db0 2023-12-14T18:23:33.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: pgmap v222: 97 pgs: 14 creating+peering, 50 active+clean, 33 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 2 op/s 2023-12-14T18:23:33.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-14T18:23:33.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3838027222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-14T18:23:33.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-14T18:23:33.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:33.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-12-14T18:23:33.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-12-14T18:23:33.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:33 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2843750706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-14T18:23:33.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: pgmap v222: 97 pgs: 14 creating+peering, 50 active+clean, 33 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 2 op/s 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3838027222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-12-14T18:23:33.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:33 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2843750706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-14T18:23:33.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:33.706+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f5060107230 con 0x7f5060101db0 2023-12-14T18:23:33.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: pgmap v222: 97 pgs: 14 creating+peering, 50 active+clean, 33 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 2 op/s 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3838027222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-12-14T18:23:33.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:33 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2843750706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-14T18:23:34.318 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: 2023-12-14T18:23:34.028+0000 7f40c901e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-14T18:23:34.319 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: 2023-12-14T18:23:34.028+0000 7f40c901e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-12-14T18:23:34.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.330+0000 7f5064925700 1 -- 172.21.15.69:0/2310199822 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5058099180 con 0x7f5060101db0 2023-12-14T18:23:34.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f504c0a1150 msgr2=0x7f504c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f504c0a1150 0x7f504c0a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5050009550 tx=0x7f50500091b0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 msgr2=0x7f506019d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 0x7f506019d4c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f505800c970 tx=0x7f505800cc80 comp rx=0 tx=0).stop 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 shutdown_connections 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f504c0a1150 0x7f504c0a3600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5060101db0 0x7f506019d4c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5060100230 0x7f5060195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 --2- 172.21.15.69:0/2310199822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5060101420 0x7f5060196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 >> 172.21.15.69:0/2310199822 conn(0x7f50600fb850 msgr2=0x7f50600fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:34.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 shutdown_connections 2023-12-14T18:23:34.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.333+0000 7f5065927700 1 -- 172.21.15.69:0/2310199822 wait complete. 2023-12-14T18:23:34.352 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2023-12-14T18:23:34.352 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-12-14T18:23:34.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/355823220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4100d40 msgr2=0x7fe3d4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/355823220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4100d40 0x7fe3d4103120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009990 tx=0x7fe3c4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/355823220 shutdown_connections 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/355823220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 0x7fe3d4108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/355823220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4100d40 0x7fe3d4103120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/355823220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d4103660 0x7fe3d4105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/355823220 >> 172.21.15.69:0/355823220 conn(0x7fe3d40fa740 msgr2=0x7fe3d40fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/355823220 shutdown_connections 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.482+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/355823220 wait complete. 2023-12-14T18:23:34.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 Processor -- start 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 -- start start 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d4100d40 0x7fe3d4195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 0x7fe3d4196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 0x7fe3d419d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d419da70 con 0x7fe3d4103660 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d419dbb0 con 0x7fe3d4105f80 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.483+0000 7fe3dc3ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d419dd40 con 0x7fe3d4100d40 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 0x7fe3d4196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 0x7fe3d4196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52074/0 (socket says 172.21.15.69:52074) 2023-12-14T18:23:34.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 -- 172.21.15.69:0/2130574993 learned_addr learned my addr 172.21.15.69:0/2130574993 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3da188700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d4100d40 0x7fe3d4195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3da989700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 0x7fe3d419d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 -- 172.21.15.69:0/2130574993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d4100d40 msgr2=0x7fe3d4195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d4100d40 0x7fe3d4195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 -- 172.21.15.69:0/2130574993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 msgr2=0x7fe3d419d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 0x7fe3d419d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 -- 172.21.15.69:0/2130574993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40095f0 con 0x7fe3d4103660 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3da989700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 0x7fe3d419d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3d9987700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 0x7fe3d4196430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d950 tx=0x7fe3d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:34.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0009940 con 0x7fe3d4103660 2023-12-14T18:23:34.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3d0010460 con 0x7fe3d4103660 2023-12-14T18:23:34.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000f620 con 0x7fe3d4103660 2023-12-14T18:23:34.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d410ba30 con 0x7fe3d4103660 2023-12-14T18:23:34.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.484+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d410b8a0 con 0x7fe3d4103660 2023-12-14T18:23:34.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.485+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d40fc2b0 con 0x7fe3d4103660 2023-12-14T18:23:34.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.486+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe3d00105d0 con 0x7fe3d4103660 2023-12-14T18:23:34.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.487+0000 7fe3cb7fe700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe3c00a1150 0x7fe3c00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.487+0000 7fe3da188700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe3c00a1150 0x7fe3c00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.487+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe3d00cc680 con 0x7fe3d4103660 2023-12-14T18:23:34.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.487+0000 7fe3da188700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe3c00a1150 0x7fe3c00a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400b5c0 tx=0x7fe3c4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:34.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.491+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe3d0095e80 con 0x7fe3d4103660 2023-12-14T18:23:34.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] up:active 2023-12-14T18:23:34.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2843750706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-14T18:23:34.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-14T18:23:34.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-14T18:23:34.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: Cluster is now healthy 2023-12-14T18:23:34.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-12-14T18:23:34.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2023-12-14T18:23:34.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: daemon mds.e is now active in filesystem cephfs as rank 2 2023-12-14T18:23:34.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:34 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2310199822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] up:active 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2843750706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: Cluster is now healthy 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: daemon mds.e is now active in filesystem cephfs as rank 2 2023-12-14T18:23:34.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:34 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2310199822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-14T18:23:34.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] up:active 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2843750706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: Cluster is now healthy 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: daemon mds.e is now active in filesystem cephfs as rank 2 2023-12-14T18:23:34.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2310199822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-14T18:23:34.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.713+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d4061c40 con 0x7fe3c00a1150 2023-12-14T18:23:34.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.755+0000 7fe3cb7fe700 1 -- 172.21.15.69:0/2130574993 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe3d4061c40 con 0x7fe3c00a1150 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe3c00a1150 msgr2=0x7fe3c00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe3c00a1150 0x7fe3c00a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400b5c0 tx=0x7fe3c4005fb0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 msgr2=0x7fe3d4196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 0x7fe3d4196430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d950 tx=0x7fe3d000dc60 comp rx=0 tx=0).stop 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 shutdown_connections 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe3c00a1150 0x7fe3c00a3600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3d4105f80 0x7fe3d419d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3d4100d40 0x7fe3d4195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 --2- 172.21.15.69:0/2130574993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d4103660 0x7fe3d4196430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.757+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 >> 172.21.15.69:0/2130574993 conn(0x7fe3d40fa740 msgr2=0x7fe3d41019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.758+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 shutdown_connections 2023-12-14T18:23:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.758+0000 7fe3dc3ec700 1 -- 172.21.15.69:0/2130574993 wait complete. 2023-12-14T18:23:34.772 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 -- 172.21.15.69:0/242650755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61840ff160 msgr2=0x7f61840ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 --2- 172.21.15.69:0/242650755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61840ff160 0x7f61840ff570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6178009990 tx=0x7f6178009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 -- 172.21.15.69:0/242650755 shutdown_connections 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 --2- 172.21.15.69:0/242650755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6184100ce0 0x7f61841075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 --2- 172.21.15.69:0/242650755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61840ff160 0x7f61840ff570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 --2- 172.21.15.69:0/242650755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 0x7f61841007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 -- 172.21.15.69:0/242650755 >> 172.21.15.69:0/242650755 conn(0x7f61840fa780 msgr2=0x7f61840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 -- 172.21.15.69:0/242650755 shutdown_connections 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.895+0000 7f618b6d2700 1 -- 172.21.15.69:0/242650755 wait complete. 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 Processor -- start 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 -- start start 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61840ff160 0x7f6184194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 0x7f6184195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 0x7f618419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419c980 con 0x7f6184100ce0 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419cac0 con 0x7f61840ff160 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618b6d2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419cc50 con 0x7f6184100350 2023-12-14T18:23:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 0x7f618419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 0x7f618419c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52108/0 (socket says 172.21.15.69:52108) 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 -- 172.21.15.69:0/2961403867 learned_addr learned my addr 172.21.15.69:0/2961403867 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6188c6d700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 0x7f6184195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 -- 172.21.15.69:0/2961403867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 msgr2=0x7f6184195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 0x7f6184195340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 -- 172.21.15.69:0/2961403867 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61840ff160 msgr2=0x7f6184194e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f618946e700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61840ff160 0x7f6184194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61840ff160 0x7f6184194e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6189c6f700 1 -- 172.21.15.69:0/2961403867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780095f0 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.896+0000 7f6188c6d700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 0x7f6184195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.897+0000 7f6189c6f700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 0x7f618419c3b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f617c00ada0 tx=0x7f617c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.897+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00f070 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.897+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f617c007b30 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.897+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618410a980 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.897+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0053e0 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.897+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618410a7f0 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.898+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6184067160 con 0x7f6184100ce0 2023-12-14T18:23:34.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.899+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f617c00c980 con 0x7f6184100ce0 2023-12-14T18:23:34.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.899+0000 7f61767fc700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61700a1150 0x7f61700a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:34.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.900+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f617c0cc520 con 0x7f6184100ce0 2023-12-14T18:23:34.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.900+0000 7f618946e700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61700a1150 0x7f61700a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:34.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.900+0000 7f618946e700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61700a1150 0x7f61700a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f617800b5c0 tx=0x7f6178005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:34.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:34.903+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f617c095e50 con 0x7f6184100ce0 2023-12-14T18:23:35.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.123+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6184060f30 con 0x7f61700a1150 2023-12-14T18:23:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.127+0000 7f61767fc700 1 -- 172.21.15.69:0/2961403867 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f6184060f30 con 0x7f61700a1150 2023-12-14T18:23:35.129 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/_nogroup/sv_0/fc55b335-a749-455a-b64a-167648e863dc 2023-12-14T18:23:35.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61700a1150 msgr2=0x7f61700a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61700a1150 0x7f61700a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f617800b5c0 tx=0x7f6178005fb0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 msgr2=0x7f618419c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 0x7f618419c3b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f617c00ada0 tx=0x7f617c00c330 comp rx=0 tx=0).stop 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 shutdown_connections 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61700a1150 0x7f61700a3600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6184100ce0 0x7f618419c3b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61840ff160 0x7f6184194e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 --2- 172.21.15.69:0/2961403867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6184100350 0x7f6184195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 >> 172.21.15.69:0/2961403867 conn(0x7f61840fa780 msgr2=0x7f61840fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 shutdown_connections 2023-12-14T18:23:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.129+0000 7f618b6d2700 1 -- 172.21.15.69:0/2961403867 wait complete. 2023-12-14T18:23:35.142 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:23:34.717+0000 7f9bf5db3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T18:23:35.142 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:23:34.718+0000 7f9bf5db3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T18:23:35.142 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:23:34.718+0000 7f9bf5db3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T18:23:35.142 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:23:34.718+0000 7f9bf5db3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T18:23:35.142 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:23:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:23:34.718+0000 7f9bf5db3700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-14T18:23:35.144 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 -- 172.21.15.69:0/3633018321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 msgr2=0x7f61681086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 --2- 172.21.15.69:0/3633018321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61681086f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f616000b0a0 tx=0x7f616000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 -- 172.21.15.69:0/3633018321 shutdown_connections 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 --2- 172.21.15.69:0/3633018321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61681086f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 --2- 172.21.15.69:0/3633018321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61680fe4d0 0x7f61680fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 --2- 172.21.15.69:0/3633018321 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 0x7f61681018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 -- 172.21.15.69:0/3633018321 >> 172.21.15.69:0/3633018321 conn(0x7f61680f9ed0 msgr2=0x7f61680fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 -- 172.21.15.69:0/3633018321 shutdown_connections 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 -- 172.21.15.69:0/3633018321 wait complete. 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 Processor -- start 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.267+0000 7f616e782700 1 -- start start 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616e782700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61680fe4d0 0x7f6168100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616e782700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 0x7f61680ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616e782700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61680ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616e782700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168100130 con 0x7f6168101e30 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616e782700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681002a0 con 0x7f61681014a0 2023-12-14T18:23:35.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616e782700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681a0030 con 0x7f61680fe4d0 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61680ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61680ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55428/0 (socket says 172.21.15.69:55428) 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 -- 172.21.15.69:0/3630163048 learned_addr learned my addr 172.21.15.69:0/3630163048 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f61677fe700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 0x7f61680ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f6167fff700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61680fe4d0 0x7f6168100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 -- 172.21.15.69:0/3630163048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61680fe4d0 msgr2=0x7f6168100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61680fe4d0 0x7f6168100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 -- 172.21.15.69:0/3630163048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 msgr2=0x7f61680ff450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 0x7f61680ff450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 -- 172.21.15.69:0/3630163048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009d00 con 0x7f6168101e30 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f61677fe700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 0x7f61680ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f616cd1f700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61680ff990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61600062a0 tx=0x7f6160004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.268+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000e040 con 0x7f6168101e30 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.269+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61600094c0 con 0x7f6168101e30 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.269+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616810ba30 con 0x7f6168101e30 2023-12-14T18:23:35.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.269+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616001bc70 con 0x7f6168101e30 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.269+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616810b8a0 con 0x7f6168101e30 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.269+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6168107230 con 0x7f6168101e30 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.271+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f616001d890 con 0x7f6168101e30 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.271+0000 7f61657fa700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61540a1150 0x7f61540a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.272+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f61600cef90 con 0x7f6168101e30 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.272+0000 7f6167fff700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61540a1150 0x7f61540a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.272+0000 7f6167fff700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61540a1150 0x7f61540a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:35.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.274+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f61600988c0 con 0x7f6168101e30 2023-12-14T18:23:35.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:35 smithi069 ceph-mon[42047]: pgmap v223: 97 pgs: 97 active+clean; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s wr, 12 op/s 2023-12-14T18:23:35.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:35 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] up:active 2023-12-14T18:23:35.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2310199822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-14T18:23:35.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:35 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2023-12-14T18:23:35.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:35 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:23:35.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.499+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f6168061a70 con 0x7f61540a1150 2023-12-14T18:23:35.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.522+0000 7f61657fa700 1 -- 172.21.15.69:0/3630163048 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6168061a70 con 0x7f61540a1150 2023-12-14T18:23:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61540a1150 msgr2=0x7f61540a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61540a1150 0x7f61540a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150005dd0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 msgr2=0x7f61680ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61680ff990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61600062a0 tx=0x7f6160004db0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 shutdown_connections 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f61540a1150 0x7f61540a3600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6168101e30 0x7f61680ff990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61680fe4d0 0x7f6168100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 --2- 172.21.15.69:0/3630163048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61681014a0 0x7f61680ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 >> 172.21.15.69:0/3630163048 conn(0x7f61680f9ed0 msgr2=0x7f61680fc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 shutdown_connections 2023-12-14T18:23:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.524+0000 7f616e782700 1 -- 172.21.15.69:0/3630163048 wait complete. 2023-12-14T18:23:35.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-12-14T18:23:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:35 smithi119 ceph-mon[43973]: pgmap v223: 97 pgs: 97 active+clean; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s wr, 12 op/s 2023-12-14T18:23:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:35 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] up:active 2023-12-14T18:23:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2310199822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-14T18:23:35.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:35 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2023-12-14T18:23:35.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:35 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:23:35.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:35 smithi091 ceph-mon[43601]: pgmap v223: 97 pgs: 97 active+clean; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s wr, 12 op/s 2023-12-14T18:23:35.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:35 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] up:active 2023-12-14T18:23:35.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2310199822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-14T18:23:35.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:35 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2023-12-14T18:23:35.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:35 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- 172.21.15.69:0/902349027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100ca0 msgr2=0x7f8bbc107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- 172.21.15.69:0/902349027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100ca0 0x7f8bbc107560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400b0a0 tx=0x7f8bb400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- 172.21.15.69:0/902349027 shutdown_connections 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- 172.21.15.69:0/902349027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100ca0 0x7f8bbc107560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- 172.21.15.69:0/902349027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 0x7f8bbc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- 172.21.15.69:0/902349027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bbc100310 0x7f8bbc100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- 172.21.15.69:0/902349027 >> 172.21.15.69:0/902349027 conn(0x7f8bbc0fa740 msgr2=0x7f8bbc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- 172.21.15.69:0/902349027 shutdown_connections 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- 172.21.15.69:0/902349027 wait complete. 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 Processor -- start 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- start start 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 0x7f8bbc196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 0x7f8bbc196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bbc100ca0 0x7f8bbc19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19dba0 con 0x7f8bbc100310 2023-12-14T18:23:35.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.662+0000 7f8bc468c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19dce0 con 0x7f8bbc0ff120 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc468c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19de70 con 0x7f8bbc100ca0 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 0x7f8bbc196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 0x7f8bbc196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55434/0 (socket says 172.21.15.69:55434) 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 -- 172.21.15.69:0/3651227355 learned_addr learned my addr 172.21.15.69:0/3651227355 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc2c29700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bbc100ca0 0x7f8bbc19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc2428700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 0x7f8bbc196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 -- 172.21.15.69:0/3651227355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bbc100ca0 msgr2=0x7f8bbc19d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bbc100ca0 0x7f8bbc19d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 -- 172.21.15.69:0/3651227355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 msgr2=0x7f8bbc196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 0x7f8bbc196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 -- 172.21.15.69:0/3651227355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb4009d00 con 0x7f8bbc100310 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc2428700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 0x7f8bbc196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc1c27700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 0x7f8bbc196560 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c970 tx=0x7f8bac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac007aa0 con 0x7f8bbc100310 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bac004cc0 con 0x7f8bbc100310 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc10a9b0 con 0x7f8bbc100310 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac005420 con 0x7f8bbc100310 2023-12-14T18:23:35.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.663+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc10a820 con 0x7f8bbc100310 2023-12-14T18:23:35.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.664+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc19e570 con 0x7f8bbc100310 2023-12-14T18:23:35.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.665+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8bac0055c0 con 0x7f8bbc100310 2023-12-14T18:23:35.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.666+0000 7f8bb37fe700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8ba80a11d0 0x7f8ba80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:35.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.666+0000 7f8bc2428700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8ba80a11d0 0x7f8ba80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:35.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.666+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8bac013070 con 0x7f8bbc100310 2023-12-14T18:23:35.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.666+0000 7f8bc2428700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8ba80a11d0 0x7f8ba80a3680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc100170 tx=0x7f8bb800a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:35.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.669+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8bac0962b0 con 0x7f8bbc100310 2023-12-14T18:23:35.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.890+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bbc19eb20 con 0x7f8ba80a11d0 2023-12-14T18:23:35.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.894+0000 7f8bb37fe700 1 -- 172.21.15.69:0/3651227355 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f8bbc19eb20 con 0x7f8ba80a11d0 2023-12-14T18:23:35.896 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/_nogroup/sv_1/23ab708f-2232-4942-b011-ed42db3d7fce 2023-12-14T18:23:35.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8ba80a11d0 msgr2=0x7f8ba80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8ba80a11d0 0x7f8ba80a3680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc100170 tx=0x7f8bb800a680 comp rx=0 tx=0).stop 2023-12-14T18:23:35.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 msgr2=0x7f8bbc196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 0x7f8bbc196560 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c970 tx=0x7f8bac00cc80 comp rx=0 tx=0).stop 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 shutdown_connections 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8ba80a11d0 0x7f8ba80a3680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bbc100ca0 0x7f8bbc19d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bbc0ff120 0x7f8bbc196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 --2- 172.21.15.69:0/3651227355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc100310 0x7f8bbc196560 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 >> 172.21.15.69:0/3651227355 conn(0x7f8bbc0fa740 msgr2=0x7f8bbc067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 shutdown_connections 2023-12-14T18:23:35.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:35.896+0000 7f8bc468c700 1 -- 172.21.15.69:0/3651227355 wait complete. 2023-12-14T18:23:35.910 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:23:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/1608323515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 msgr2=0x7f2bc00ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/1608323515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc00ff7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009990 tx=0x7f2bac009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/1608323515 shutdown_connections 2023-12-14T18:23:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/1608323515 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bc00ffd10 0x7f2bc01075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/1608323515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc01007a0 0x7f2bc0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/1608323515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc00ff7d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/1608323515 >> 172.21.15.69:0/1608323515 conn(0x7f2bc00f9e80 msgr2=0x7f2bc00fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/1608323515 shutdown_connections 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.030+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/1608323515 wait complete. 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 Processor -- start 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 -- start start 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc0195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00ffd10 0x7f2bc01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bc01007a0 0x7f2bc019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc019da10 con 0x7f2bc00ff360 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc019db50 con 0x7f2bc01007a0 2023-12-14T18:23:36.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc6ed4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc019dce0 con 0x7f2bc00ffd10 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc0195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc0195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55452/0 (socket says 172.21.15.69:55452) 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 -- 172.21.15.69:0/3030837147 learned_addr learned my addr 172.21.15.69:0/3030837147 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 -- 172.21.15.69:0/3030837147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00ffd10 msgr2=0x7f2bc01963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00ffd10 0x7f2bc01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 -- 172.21.15.69:0/3030837147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bc01007a0 msgr2=0x7f2bc019d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bc01007a0 0x7f2bc019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 -- 172.21.15.69:0/3030837147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0095f0 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.031+0000 7f2bc4c70700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc0195e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c9b0 tx=0x7f2bb400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.032+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4007b00 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.032+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bb4007c60 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.032+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc010a9c0 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.032+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4018660 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.032+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc010a830 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.033+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc019e3c0 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.034+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2bb400f450 con 0x7f2bc00ff360 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.034+0000 7f2bbdffb700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2bb00a11d0 0x7f2bb00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.034+0000 7f2bbffff700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2bb00a11d0 0x7f2bb00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.034+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2bb40cc7d0 con 0x7f2bc00ff360 2023-12-14T18:23:36.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.035+0000 7f2bbffff700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2bb00a11d0 0x7f2bb00a3680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098e0 tx=0x7f2bac000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:36.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.038+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2bb4096070 con 0x7f2bc00ff360 2023-12-14T18:23:36.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.275+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc019dea0 con 0x7f2bc00ff360 2023-12-14T18:23:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.276+0000 7f2bbdffb700 1 -- 172.21.15.69:0/3030837147 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7f2bc019dea0 con 0x7f2bc00ff360 2023-12-14T18:23:36.282 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:36.282 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2bb00a11d0 msgr2=0x7f2bb00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2bb00a11d0 0x7f2bb00a3680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098e0 tx=0x7f2bac000bc0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 msgr2=0x7f2bc0195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc0195e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c9b0 tx=0x7f2bb400cd70 comp rx=0 tx=0).stop 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 shutdown_connections 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2bb00a11d0 0x7f2bb00a3680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bc01007a0 0x7f2bc019d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bc00ff360 0x7f2bc0195e90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 --2- 172.21.15.69:0/3030837147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00ffd10 0x7f2bc01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 >> 172.21.15.69:0/3030837147 conn(0x7f2bc00f9e80 msgr2=0x7f2bc00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 shutdown_connections 2023-12-14T18:23:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.278+0000 7f2bc6ed4700 1 -- 172.21.15.69:0/3030837147 wait complete. 2023-12-14T18:23:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:23:36.293 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 -- 172.21.15.69:0/2451067025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf4100420 msgr2=0x7facf4106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 --2- 172.21.15.69:0/2451067025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf4100420 0x7facf4106ce0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facec00b0a0 tx=0x7facec00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 -- 172.21.15.69:0/2451067025 shutdown_connections 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 --2- 172.21.15.69:0/2451067025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf4100420 0x7facf4106ce0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 --2- 172.21.15.69:0/2451067025 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facf40fe8a0 0x7facf40fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 --2- 172.21.15.69:0/2451067025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf40ffa90 0x7facf40ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 -- 172.21.15.69:0/2451067025 >> 172.21.15.69:0/2451067025 conn(0x7facf40f9e80 msgr2=0x7facf40fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 -- 172.21.15.69:0/2451067025 shutdown_connections 2023-12-14T18:23:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.417+0000 7facfa630700 1 -- 172.21.15.69:0/2451067025 wait complete. 2023-12-14T18:23:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 Processor -- start 2023-12-14T18:23:36.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 -- start start 2023-12-14T18:23:36.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 0x7facf4194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facf40ffa90 0x7facf4195430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf4100420 0x7facf419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf419ca70 con 0x7facf40fe8a0 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf419cbb0 con 0x7facf40ffa90 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.418+0000 7facfa630700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf419cd40 con 0x7facf4100420 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 0x7facf4194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 0x7facf4194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55470/0 (socket says 172.21.15.69:55470) 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 -- 172.21.15.69:0/170687791 learned_addr learned my addr 172.21.15.69:0/170687791 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf37fe700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facf40ffa90 0x7facf4195430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf8bcd700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf4100420 0x7facf419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 -- 172.21.15.69:0/170687791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf4100420 msgr2=0x7facf419c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf4100420 0x7facf419c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 -- 172.21.15.69:0/170687791 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facf40ffa90 msgr2=0x7facf4195430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facf40ffa90 0x7facf4195430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 -- 172.21.15.69:0/170687791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009d00 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf8bcd700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf4100420 0x7facf419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf3fff700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 0x7facf4194ef0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7face400c970 tx=0x7face400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4004220 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7face4007d30 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf410a0e0 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4003bf0 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.419+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf4109f50 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.420+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4106410 con 0x7facf40fe8a0 2023-12-14T18:23:36.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.421+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7face40078a0 con 0x7facf40fe8a0 2023-12-14T18:23:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.421+0000 7facf17fa700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7facdc0a11e0 0x7facdc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.422+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7face40cc570 con 0x7facf40fe8a0 2023-12-14T18:23:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.422+0000 7facf37fe700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7facdc0a11e0 0x7facdc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.422+0000 7facf37fe700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7facdc0a11e0 0x7facdc0a3690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7face8005950 tx=0x7face80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:36.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.426+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7face4095d10 con 0x7facf40fe8a0 2023-12-14T18:23:36.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.619+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facf4061700 con 0x7facf40fe8a0 2023-12-14T18:23:36.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.620+0000 7facf17fa700 1 -- 172.21.15.69:0/170687791 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22082 (secure 0 0 0) 0x7face4099330 con 0x7facf40fe8a0 2023-12-14T18:23:36.623 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:36.623 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:30.294739+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.622+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7facdc0a11e0 msgr2=0x7facdc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.622+0000 7facfa630700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7facdc0a11e0 0x7facdc0a3690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7face8005950 tx=0x7face80058e0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.622+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 msgr2=0x7facf4194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 0x7facf4194ef0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7face400c970 tx=0x7face400cd30 comp rx=0 tx=0).stop 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 shutdown_connections 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7facdc0a11e0 0x7facdc0a3690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facf4100420 0x7facf419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facf40fe8a0 0x7facf4194ef0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 --2- 172.21.15.69:0/170687791 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facf40ffa90 0x7facf4195430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 >> 172.21.15.69:0/170687791 conn(0x7facf40f9e80 msgr2=0x7facf4103550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 shutdown_connections 2023-12-14T18:23:36.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.623+0000 7facfa630700 1 -- 172.21.15.69:0/170687791 wait complete. 2023-12-14T18:23:36.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:36 smithi119 ceph-mon[43973]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:36 smithi119 ceph-mon[43973]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:36 smithi119 ceph-mon[43973]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.626 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:36 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3030837147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:36.635 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:36 smithi069 ceph-mon[42047]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.635 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:36 smithi069 ceph-mon[42047]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.636 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:36 smithi069 ceph-mon[42047]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.636 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3030837147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:36.637 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-14T18:23:36.637 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T18:23:36.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:36 smithi091 ceph-mon[43601]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:36 smithi091 ceph-mon[43601]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:36 smithi091 ceph-mon[43601]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:36.638 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:36 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3030837147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 -- 172.21.15.69:0/2237693896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101630 msgr2=0x7fe304101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 --2- 172.21.15.69:0/2237693896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101630 0x7fe304101a80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009990 tx=0x7fe2f8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 -- 172.21.15.69:0/2237693896 shutdown_connections 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 --2- 172.21.15.69:0/2237693896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe304101fc0 0x7fe304108880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 --2- 172.21.15.69:0/2237693896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3040fe5c0 0x7fe3040fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 --2- 172.21.15.69:0/2237693896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101630 0x7fe304101a80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 -- 172.21.15.69:0/2237693896 >> 172.21.15.69:0/2237693896 conn(0x7fe3040f9f80 msgr2=0x7fe3040fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 -- 172.21.15.69:0/2237693896 shutdown_connections 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.757+0000 7fe30980d700 1 -- 172.21.15.69:0/2237693896 wait complete. 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 Processor -- start 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 -- start start 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3040fe5c0 0x7fe304195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe304101630 0x7fe304196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 0x7fe30419d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30419da60 con 0x7fe304101fc0 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30419dba0 con 0x7fe3040fe5c0 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe30980d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30419dd30 con 0x7fe304101630 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe3037fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 0x7fe30419d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe3037fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 0x7fe30419d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55490/0 (socket says 172.21.15.69:55490) 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.758+0000 7fe3037fe700 1 -- 172.21.15.69:0/1990415289 learned_addr learned my addr 172.21.15.69:0/1990415289 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe302ffd700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3040fe5c0 0x7fe304195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3027fc700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe304101630 0x7fe304196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3037fe700 1 -- 172.21.15.69:0/1990415289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe304101630 msgr2=0x7fe304196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3037fe700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe304101630 0x7fe304196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3037fe700 1 -- 172.21.15.69:0/1990415289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3040fe5c0 msgr2=0x7fe304195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3037fe700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3040fe5c0 0x7fe304195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3037fe700 1 -- 172.21.15.69:0/1990415289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80095f0 con 0x7fe304101fc0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe3037fe700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 0x7fe30419d490 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007d70 tx=0x7fe2fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00ad40 con 0x7fe304101fc0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2fc0128b0 con 0x7fe304101fc0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30410ba80 con 0x7fe304101fc0 2023-12-14T18:23:36.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0116b0 con 0x7fe304101fc0 2023-12-14T18:23:36.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.759+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30410b8f0 con 0x7fe304101fc0 2023-12-14T18:23:36.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.760+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe304107a00 con 0x7fe304101fc0 2023-12-14T18:23:36.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.762+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe2fc012a20 con 0x7fe304101fc0 2023-12-14T18:23:36.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.762+0000 7fe30880b700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe2ec0a11e0 0x7fe2ec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:36.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.762+0000 7fe302ffd700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe2ec0a11e0 0x7fe2ec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:36.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.762+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe2fc0cce30 con 0x7fe304101fc0 2023-12-14T18:23:36.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.763+0000 7fe302ffd700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe2ec0a11e0 0x7fe2ec0a3690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4005950 tx=0x7fe2f40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:36.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.766+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe2fc0966e0 con 0x7fe304101fc0 2023-12-14T18:23:36.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.953+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe304061cb0 con 0x7fe2ec0a11e0 2023-12-14T18:23:36.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.964+0000 7fe30880b700 1 -- 172.21.15.69:0/1990415289 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+327882 (secure 0 0 0) 0x7fe304061cb0 con 0x7fe2ec0a11e0 2023-12-14T18:23:36.973 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe2ec0a11e0 msgr2=0x7fe2ec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe2ec0a11e0 0x7fe2ec0a3690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4005950 tx=0x7fe2f40058e0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 msgr2=0x7fe30419d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 0x7fe30419d490 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007d70 tx=0x7fe2fc00a340 comp rx=0 tx=0).stop 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 shutdown_connections 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe2ec0a11e0 0x7fe2ec0a3690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe304101fc0 0x7fe30419d490 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe3040fe5c0 0x7fe304195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 --2- 172.21.15.69:0/1990415289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe304101630 0x7fe304196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 >> 172.21.15.69:0/1990415289 conn(0x7fe3040f9f80 msgr2=0x7fe304104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:36.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 shutdown_connections 2023-12-14T18:23:36.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:36.967+0000 7fe30980d700 1 -- 172.21.15.69:0/1990415289 wait complete. 2023-12-14T18:23:36.979 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:23:36.982 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2023-12-14T18:23:36.235318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594200,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":132,"num_read_kb":114,"num_write":281,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78832,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":1124862992,"statfs":{"total":1151940427776,"available":1151859703808,"internally_reserved":0,"allocated":12075008,"data_stored":6654202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3832,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.350451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328274+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:23:29.328274+0000","last_peered":"2023-12-14T18:23:29.328274+0000","last_clean":"2023-12-14T18:23:29.328274+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:23:29.328274+0000","last_undegraded":"2023-12-14T18:23:29.328274+0000","last_fullsized":"2023-12-14T18:23:29.328274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:14:54.111820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963017+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:23:31.963017+0000","last_peered":"2023-12-14T18:23:31.963017+0000","last_clean":"2023-12-14T18:23:31.963017+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:23:31.963017+0000","last_undegraded":"2023-12-14T18:23:31.963017+0000","last_fullsized":"2023-12-14T18:23:31.963017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:53:14.564046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962969+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:23:31.962969+0000","last_peered":"2023-12-14T18:23:31.962969+0000","last_clean":"2023-12-14T18:23:31.962969+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:23:31.962969+0000","last_undegraded":"2023-12-14T18:23:31.962969+0000","last_fullsized":"2023-12-14T18:23:31.962969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:55:45.247027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964402+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:23:31.964402+0000","last_peered":"2023-12-14T18:23:31.964402+0000","last_clean":"2023-12-14T18:23:31.964402+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:23:31.964402+0000","last_undegraded":"2023-12-14T18:23:31.964402+0000","last_fullsized":"2023-12-14T18:23:31.964402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:33.555138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298752+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:23:30.298752+0000","last_peered":"2023-12-14T18:23:30.298752+0000","last_clean":"2023-12-14T18:23:30.298752+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:23:30.298752+0000","last_undegraded":"2023-12-14T18:23:30.298752+0000","last_fullsized":"2023-12-14T18:23:30.298752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:45.744707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964734+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:23:31.964734+0000","last_peered":"2023-12-14T18:23:31.964734+0000","last_clean":"2023-12-14T18:23:31.964734+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:23:31.964734+0000","last_undegraded":"2023-12-14T18:23:31.964734+0000","last_fullsized":"2023-12-14T18:23:31.964734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:56:29.640721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963441+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:23:31.963441+0000","last_peered":"2023-12-14T18:23:31.963441+0000","last_clean":"2023-12-14T18:23:31.963441+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:23:31.963441+0000","last_undegraded":"2023-12-14T18:23:31.963441+0000","last_fullsized":"2023-12-14T18:23:31.963441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:29:53.508232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962583+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:23:31.962583+0000","last_peered":"2023-12-14T18:23:31.962583+0000","last_clean":"2023-12-14T18:23:31.962583+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:23:31.962583+0000","last_undegraded":"2023-12-14T18:23:31.962583+0000","last_fullsized":"2023-12-14T18:23:31.962583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:39:26.030240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298994+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:23:30.298994+0000","last_peered":"2023-12-14T18:23:30.298994+0000","last_clean":"2023-12-14T18:23:30.298994+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:23:30.298994+0000","last_undegraded":"2023-12-14T18:23:30.298994+0000","last_fullsized":"2023-12-14T18:23:30.298994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:53:45.531715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964560+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:23:31.964560+0000","last_peered":"2023-12-14T18:23:31.964560+0000","last_clean":"2023-12-14T18:23:31.964560+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:23:31.964560+0000","last_undegraded":"2023-12-14T18:23:31.964560+0000","last_fullsized":"2023-12-14T18:23:31.964560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:00.231623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963488+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:23:31.963488+0000","last_peered":"2023-12-14T18:23:31.963488+0000","last_clean":"2023-12-14T18:23:31.963488+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:23:31.963488+0000","last_undegraded":"2023-12-14T18:23:31.963488+0000","last_fullsized":"2023-12-14T18:23:31.963488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:19:41.156980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964275+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:23:31.964275+0000","last_peered":"2023-12-14T18:23:31.964275+0000","last_clean":"2023-12-14T18:23:31.964275+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:23:31.964275+0000","last_undegraded":"2023-12-14T18:23:31.964275+0000","last_fullsized":"2023-12-14T18:23:31.964275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:34:33.441932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297890+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:23:30.297890+0000","last_peered":"2023-12-14T18:23:30.297890+0000","last_clean":"2023-12-14T18:23:30.297890+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:23:30.297890+0000","last_undegraded":"2023-12-14T18:23:30.297890+0000","last_fullsized":"2023-12-14T18:23:30.297890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:59.839011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963183+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:23:31.963183+0000","last_peered":"2023-12-14T18:23:31.963183+0000","last_clean":"2023-12-14T18:23:31.963183+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:23:31.963183+0000","last_undegraded":"2023-12-14T18:23:31.963183+0000","last_fullsized":"2023-12-14T18:23:31.963183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:23:22.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962782+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:23:31.962782+0000","last_peered":"2023-12-14T18:23:31.962782+0000","last_clean":"2023-12-14T18:23:31.962782+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:23:31.962782+0000","last_undegraded":"2023-12-14T18:23:31.962782+0000","last_fullsized":"2023-12-14T18:23:31.962782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:13.104079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298442+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:23:30.298442+0000","last_peered":"2023-12-14T18:23:30.298442+0000","last_clean":"2023-12-14T18:23:30.298442+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:23:30.298442+0000","last_undegraded":"2023-12-14T18:23:30.298442+0000","last_fullsized":"2023-12-14T18:23:30.298442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:57.579587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328618+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:23:29.328618+0000","last_peered":"2023-12-14T18:23:29.328618+0000","last_clean":"2023-12-14T18:23:29.328618+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:23:29.328618+0000","last_undegraded":"2023-12-14T18:23:29.328618+0000","last_fullsized":"2023-12-14T18:23:29.328618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:52:57.417724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217912+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:23:31.217912+0000","last_peered":"2023-12-14T18:23:31.217912+0000","last_clean":"2023-12-14T18:23:31.217912+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:23:31.217912+0000","last_undegraded":"2023-12-14T18:23:31.217912+0000","last_fullsized":"2023-12-14T18:23:31.217912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:37.822774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513258+0000","last_change":"2023-12-14T18:23:29.320811+0000","last_active":"2023-12-14T18:23:31.513258+0000","last_peered":"2023-12-14T18:23:31.513258+0000","last_clean":"2023-12-14T18:23:31.513258+0000","last_became_active":"2023-12-14T18:23:29.315538+0000","last_became_peered":"2023-12-14T18:23:29.315538+0000","last_unstale":"2023-12-14T18:23:31.513258+0000","last_undegraded":"2023-12-14T18:23:31.513258+0000","last_fullsized":"2023-12-14T18:23:31.513258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:26:01.785017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.333714+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:23:33.333714+0000","last_peered":"2023-12-14T18:23:33.333714+0000","last_clean":"2023-12-14T18:23:33.333714+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:23:33.333714+0000","last_undegraded":"2023-12-14T18:23:33.333714+0000","last_fullsized":"2023-12-14T18:23:33.333714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:15:49.986514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962770+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:23:31.962770+0000","last_peered":"2023-12-14T18:23:31.962770+0000","last_clean":"2023-12-14T18:23:31.962770+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:23:31.962770+0000","last_undegraded":"2023-12-14T18:23:31.962770+0000","last_fullsized":"2023-12-14T18:23:31.962770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:10.086046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962978+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:23:31.962978+0000","last_peered":"2023-12-14T18:23:31.962978+0000","last_clean":"2023-12-14T18:23:31.962978+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:23:31.962978+0000","last_undegraded":"2023-12-14T18:23:31.962978+0000","last_fullsized":"2023-12-14T18:23:31.962978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:08:25.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963326+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:23:31.963326+0000","last_peered":"2023-12-14T18:23:31.963326+0000","last_clean":"2023-12-14T18:23:31.963326+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:23:31.963326+0000","last_undegraded":"2023-12-14T18:23:31.963326+0000","last_fullsized":"2023-12-14T18:23:31.963326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:09:13.088758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332104+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:23:33.332104+0000","last_peered":"2023-12-14T18:23:33.332104+0000","last_clean":"2023-12-14T18:23:33.332104+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:23:33.332104+0000","last_undegraded":"2023-12-14T18:23:33.332104+0000","last_fullsized":"2023-12-14T18:23:33.332104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:29:10.775688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298727+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:23:30.298727+0000","last_peered":"2023-12-14T18:23:30.298727+0000","last_clean":"2023-12-14T18:23:30.298727+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:23:30.298727+0000","last_undegraded":"2023-12-14T18:23:30.298727+0000","last_fullsized":"2023-12-14T18:23:30.298727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:08.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299162+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:23:30.299162+0000","last_peered":"2023-12-14T18:23:30.299162+0000","last_clean":"2023-12-14T18:23:30.299162+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:23:30.299162+0000","last_undegraded":"2023-12-14T18:23:30.299162+0000","last_fullsized":"2023-12-14T18:23:30.299162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:16.688070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862680+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:23:30.862680+0000","last_peered":"2023-12-14T18:23:30.862680+0000","last_clean":"2023-12-14T18:23:30.862680+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:23:30.862680+0000","last_undegraded":"2023-12-14T18:23:30.862680+0000","last_fullsized":"2023-12-14T18:23:30.862680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:38.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:34.345522+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:23:34.345522+0000","last_peered":"2023-12-14T18:23:34.345522+0000","last_clean":"2023-12-14T18:23:34.345522+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:23:34.345522+0000","last_undegraded":"2023-12-14T18:23:34.345522+0000","last_fullsized":"2023-12-14T18:23:34.345522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:41.803316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298872+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:23:30.298872+0000","last_peered":"2023-12-14T18:23:30.298872+0000","last_clean":"2023-12-14T18:23:30.298872+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:23:30.298872+0000","last_undegraded":"2023-12-14T18:23:30.298872+0000","last_fullsized":"2023-12-14T18:23:30.298872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:00:06.468221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964558+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:23:31.964558+0000","last_peered":"2023-12-14T18:23:31.964558+0000","last_clean":"2023-12-14T18:23:31.964558+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:23:31.964558+0000","last_undegraded":"2023-12-14T18:23:31.964558+0000","last_fullsized":"2023-12-14T18:23:31.964558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:38:50.312141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862519+0000","last_change":"2023-12-14T18:23:29.314941+0000","last_active":"2023-12-14T18:23:30.862519+0000","last_peered":"2023-12-14T18:23:30.862519+0000","last_clean":"2023-12-14T18:23:30.862519+0000","last_became_active":"2023-12-14T18:23:29.314508+0000","last_became_peered":"2023-12-14T18:23:29.314508+0000","last_unstale":"2023-12-14T18:23:30.862519+0000","last_undegraded":"2023-12-14T18:23:30.862519+0000","last_fullsized":"2023-12-14T18:23:30.862519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:06:11.981373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297730+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:23:30.297730+0000","last_peered":"2023-12-14T18:23:30.297730+0000","last_clean":"2023-12-14T18:23:30.297730+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:23:30.297730+0000","last_undegraded":"2023-12-14T18:23:30.297730+0000","last_fullsized":"2023-12-14T18:23:30.297730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:53.112965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962525+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:23:31.962525+0000","last_peered":"2023-12-14T18:23:31.962525+0000","last_clean":"2023-12-14T18:23:31.962525+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:23:31.962525+0000","last_undegraded":"2023-12-14T18:23:31.962525+0000","last_fullsized":"2023-12-14T18:23:31.962525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:56.891103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862356+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:23:30.862356+0000","last_peered":"2023-12-14T18:23:30.862356+0000","last_clean":"2023-12-14T18:23:30.862356+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:23:30.862356+0000","last_undegraded":"2023-12-14T18:23:30.862356+0000","last_fullsized":"2023-12-14T18:23:30.862356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:02:39.786052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217715+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:23:31.217715+0000","last_peered":"2023-12-14T18:23:31.217715+0000","last_clean":"2023-12-14T18:23:31.217715+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:23:31.217715+0000","last_undegraded":"2023-12-14T18:23:31.217715+0000","last_fullsized":"2023-12-14T18:23:31.217715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:40:20.784196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321167+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:23:32.321167+0000","last_peered":"2023-12-14T18:23:32.321167+0000","last_clean":"2023-12-14T18:23:32.321167+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:23:32.321167+0000","last_undegraded":"2023-12-14T18:23:32.321167+0000","last_fullsized":"2023-12-14T18:23:32.321167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:52:10.663306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:47.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321675+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:23:32.321675+0000","last_peered":"2023-12-14T18:23:32.321675+0000","last_clean":"2023-12-14T18:23:32.321675+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:23:32.321675+0000","last_undegraded":"2023-12-14T18:23:32.321675+0000","last_fullsized":"2023-12-14T18:23:32.321675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:07.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963309+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:23:31.963309+0000","last_peered":"2023-12-14T18:23:31.963309+0000","last_clean":"2023-12-14T18:23:31.963309+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:23:31.963309+0000","last_undegraded":"2023-12-14T18:23:31.963309+0000","last_fullsized":"2023-12-14T18:23:31.963309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:30.502067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321701+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:23:32.321701+0000","last_peered":"2023-12-14T18:23:32.321701+0000","last_clean":"2023-12-14T18:23:32.321701+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:23:32.321701+0000","last_undegraded":"2023-12-14T18:23:32.321701+0000","last_fullsized":"2023-12-14T18:23:32.321701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:01:37.437148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298957+0000","last_change":"2023-12-14T18:23:29.311912+0000","last_active":"2023-12-14T18:23:30.298957+0000","last_peered":"2023-12-14T18:23:30.298957+0000","last_clean":"2023-12-14T18:23:30.298957+0000","last_became_active":"2023-12-14T18:23:29.310752+0000","last_became_peered":"2023-12-14T18:23:29.310752+0000","last_unstale":"2023-12-14T18:23:30.298957+0000","last_undegraded":"2023-12-14T18:23:30.298957+0000","last_fullsized":"2023-12-14T18:23:30.298957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:29:06.495199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320917+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:23:32.320917+0000","last_peered":"2023-12-14T18:23:32.320917+0000","last_clean":"2023-12-14T18:23:32.320917+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:23:32.320917+0000","last_undegraded":"2023-12-14T18:23:32.320917+0000","last_fullsized":"2023-12-14T18:23:32.320917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:01.303699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299079+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:23:30.299079+0000","last_peered":"2023-12-14T18:23:30.299079+0000","last_clean":"2023-12-14T18:23:30.299079+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:23:30.299079+0000","last_undegraded":"2023-12-14T18:23:30.299079+0000","last_fullsized":"2023-12-14T18:23:30.299079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:03.844259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512976+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:23:31.512976+0000","last_peered":"2023-12-14T18:23:31.512976+0000","last_clean":"2023-12-14T18:23:31.512976+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:23:31.512976+0000","last_undegraded":"2023-12-14T18:23:31.512976+0000","last_fullsized":"2023-12-14T18:23:31.512976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:16:46.098127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297832+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:23:30.297832+0000","last_peered":"2023-12-14T18:23:30.297832+0000","last_clean":"2023-12-14T18:23:30.297832+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:23:30.297832+0000","last_undegraded":"2023-12-14T18:23:30.297832+0000","last_fullsized":"2023-12-14T18:23:30.297832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:06:04.096044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321149+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:23:32.321149+0000","last_peered":"2023-12-14T18:23:32.321149+0000","last_clean":"2023-12-14T18:23:32.321149+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:23:32.321149+0000","last_undegraded":"2023-12-14T18:23:32.321149+0000","last_fullsized":"2023-12-14T18:23:32.321149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:28:23.739941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964105+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:23:31.964105+0000","last_peered":"2023-12-14T18:23:31.964105+0000","last_clean":"2023-12-14T18:23:31.964105+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:23:31.964105+0000","last_undegraded":"2023-12-14T18:23:31.964105+0000","last_fullsized":"2023-12-14T18:23:31.964105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:55:38.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963537+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:23:31.963537+0000","last_peered":"2023-12-14T18:23:31.963537+0000","last_clean":"2023-12-14T18:23:31.963537+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:23:31.963537+0000","last_undegraded":"2023-12-14T18:23:31.963537+0000","last_fullsized":"2023-12-14T18:23:31.963537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:17:49.846098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963126+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:23:31.963126+0000","last_peered":"2023-12-14T18:23:31.963126+0000","last_clean":"2023-12-14T18:23:31.963126+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:23:31.963126+0000","last_undegraded":"2023-12-14T18:23:31.963126+0000","last_fullsized":"2023-12-14T18:23:31.963126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:38:37.985717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.334495+0000","last_change":"2023-12-14T18:23:28.904227+0000","last_active":"2023-12-14T18:23:33.334495+0000","last_peered":"2023-12-14T18:23:33.334495+0000","last_clean":"2023-12-14T18:23:33.334495+0000","last_became_active":"2023-12-14T18:23:28.903844+0000","last_became_peered":"2023-12-14T18:23:28.903844+0000","last_unstale":"2023-12-14T18:23:33.334495+0000","last_undegraded":"2023-12-14T18:23:33.334495+0000","last_fullsized":"2023-12-14T18:23:33.334495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:03:09.233743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862403+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:23:30.862403+0000","last_peered":"2023-12-14T18:23:30.862403+0000","last_clean":"2023-12-14T18:23:30.862403+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:23:30.862403+0000","last_undegraded":"2023-12-14T18:23:30.862403+0000","last_fullsized":"2023-12-14T18:23:30.862403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:06:02.516476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299071+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:23:30.299071+0000","last_peered":"2023-12-14T18:23:30.299071+0000","last_clean":"2023-12-14T18:23:30.299071+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:23:30.299071+0000","last_undegraded":"2023-12-14T18:23:30.299071+0000","last_fullsized":"2023-12-14T18:23:30.299071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:49:05.274081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.318728+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:23:29.318728+0000","last_peered":"2023-12-14T18:23:29.318728+0000","last_clean":"2023-12-14T18:23:29.318728+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:23:29.318728+0000","last_undegraded":"2023-12-14T18:23:29.318728+0000","last_fullsized":"2023-12-14T18:23:29.318728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:39:59.709756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217770+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:23:31.217770+0000","last_peered":"2023-12-14T18:23:31.217770+0000","last_clean":"2023-12-14T18:23:31.217770+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:23:31.217770+0000","last_undegraded":"2023-12-14T18:23:31.217770+0000","last_fullsized":"2023-12-14T18:23:31.217770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:41:07.717205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964309+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:23:31.964309+0000","last_peered":"2023-12-14T18:23:31.964309+0000","last_clean":"2023-12-14T18:23:31.964309+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:23:31.964309+0000","last_undegraded":"2023-12-14T18:23:31.964309+0000","last_fullsized":"2023-12-14T18:23:31.964309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:14.386800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965740+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:23:31.965740+0000","last_peered":"2023-12-14T18:23:31.965740+0000","last_clean":"2023-12-14T18:23:31.965740+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:23:31.965740+0000","last_undegraded":"2023-12-14T18:23:31.965740+0000","last_fullsized":"2023-12-14T18:23:31.965740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:04.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964456+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:23:31.964456+0000","last_peered":"2023-12-14T18:23:31.964456+0000","last_clean":"2023-12-14T18:23:31.964456+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:23:31.964456+0000","last_undegraded":"2023-12-14T18:23:31.964456+0000","last_fullsized":"2023-12-14T18:23:31.964456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:44.704602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862512+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:23:30.862512+0000","last_peered":"2023-12-14T18:23:30.862512+0000","last_clean":"2023-12-14T18:23:30.862512+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:23:30.862512+0000","last_undegraded":"2023-12-14T18:23:30.862512+0000","last_fullsized":"2023-12-14T18:23:30.862512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:26:23.141463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297616+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:23:30.297616+0000","last_peered":"2023-12-14T18:23:30.297616+0000","last_clean":"2023-12-14T18:23:30.297616+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:23:30.297616+0000","last_undegraded":"2023-12-14T18:23:30.297616+0000","last_fullsized":"2023-12-14T18:23:30.297616+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:05.438111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963266+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:23:31.963266+0000","last_peered":"2023-12-14T18:23:31.963266+0000","last_clean":"2023-12-14T18:23:31.963266+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:23:31.963266+0000","last_undegraded":"2023-12-14T18:23:31.963266+0000","last_fullsized":"2023-12-14T18:23:31.963266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:15:26.892489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.322180+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:23:32.322180+0000","last_peered":"2023-12-14T18:23:32.322180+0000","last_clean":"2023-12-14T18:23:32.322180+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:23:32.322180+0000","last_undegraded":"2023-12-14T18:23:32.322180+0000","last_fullsized":"2023-12-14T18:23:32.322180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:20.683055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":328,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963196+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:23:31.963196+0000","last_peered":"2023-12-14T18:23:31.963196+0000","last_clean":"2023-12-14T18:23:31.963196+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:23:31.963196+0000","last_undegraded":"2023-12-14T18:23:31.963196+0000","last_fullsized":"2023-12-14T18:23:31.963196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:25:43.576640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297606+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:23:30.297606+0000","last_peered":"2023-12-14T18:23:30.297606+0000","last_clean":"2023-12-14T18:23:30.297606+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:23:30.297606+0000","last_undegraded":"2023-12-14T18:23:30.297606+0000","last_fullsized":"2023-12-14T18:23:30.297606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:42.044013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332781+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:23:33.332781+0000","last_peered":"2023-12-14T18:23:33.332781+0000","last_clean":"2023-12-14T18:23:33.332781+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:23:33.332781+0000","last_undegraded":"2023-12-14T18:23:33.332781+0000","last_fullsized":"2023-12-14T18:23:33.332781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:18.549174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298945+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:23:30.298945+0000","last_peered":"2023-12-14T18:23:30.298945+0000","last_clean":"2023-12-14T18:23:30.298945+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:23:30.298945+0000","last_undegraded":"2023-12-14T18:23:30.298945+0000","last_fullsized":"2023-12-14T18:23:30.298945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:59:20.753750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297936+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:23:30.297936+0000","last_peered":"2023-12-14T18:23:30.297936+0000","last_clean":"2023-12-14T18:23:30.297936+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:23:30.297936+0000","last_undegraded":"2023-12-14T18:23:30.297936+0000","last_fullsized":"2023-12-14T18:23:30.297936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:42.595546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.333542+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:23:33.333542+0000","last_peered":"2023-12-14T18:23:33.333542+0000","last_clean":"2023-12-14T18:23:33.333542+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:23:33.333542+0000","last_undegraded":"2023-12-14T18:23:33.333542+0000","last_fullsized":"2023-12-14T18:23:33.333542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:48:44.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963156+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:23:31.963156+0000","last_peered":"2023-12-14T18:23:31.963156+0000","last_clean":"2023-12-14T18:23:31.963156+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:23:31.963156+0000","last_undegraded":"2023-12-14T18:23:31.963156+0000","last_fullsized":"2023-12-14T18:23:31.963156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:46.733098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320452+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:23:32.320452+0000","last_peered":"2023-12-14T18:23:32.320452+0000","last_clean":"2023-12-14T18:23:32.320452+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:23:32.320452+0000","last_undegraded":"2023-12-14T18:23:32.320452+0000","last_fullsized":"2023-12-14T18:23:32.320452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:34:04.103111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963119+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:23:31.963119+0000","last_peered":"2023-12-14T18:23:31.963119+0000","last_clean":"2023-12-14T18:23:31.963119+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:23:31.963119+0000","last_undegraded":"2023-12-14T18:23:31.963119+0000","last_fullsized":"2023-12-14T18:23:31.963119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:13:05.096473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320457+0000","last_change":"2023-12-14T18:23:28.902315+0000","last_active":"2023-12-14T18:23:32.320457+0000","last_peered":"2023-12-14T18:23:32.320457+0000","last_clean":"2023-12-14T18:23:32.320457+0000","last_became_active":"2023-12-14T18:23:28.901654+0000","last_became_peered":"2023-12-14T18:23:28.901654+0000","last_unstale":"2023-12-14T18:23:32.320457+0000","last_undegraded":"2023-12-14T18:23:32.320457+0000","last_fullsized":"2023-12-14T18:23:32.320457+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:27:11.302617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298674+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:23:30.298674+0000","last_peered":"2023-12-14T18:23:30.298674+0000","last_clean":"2023-12-14T18:23:30.298674+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:23:30.298674+0000","last_undegraded":"2023-12-14T18:23:30.298674+0000","last_fullsized":"2023-12-14T18:23:30.298674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.125688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321569+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:23:32.321569+0000","last_peered":"2023-12-14T18:23:32.321569+0000","last_clean":"2023-12-14T18:23:32.321569+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:23:32.321569+0000","last_undegraded":"2023-12-14T18:23:32.321569+0000","last_fullsized":"2023-12-14T18:23:32.321569+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:07.935972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.318398+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:23:29.318398+0000","last_peered":"2023-12-14T18:23:29.318398+0000","last_clean":"2023-12-14T18:23:29.318398+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:23:29.318398+0000","last_undegraded":"2023-12-14T18:23:29.318398+0000","last_fullsized":"2023-12-14T18:23:29.318398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:33:45.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512870+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:23:31.512870+0000","last_peered":"2023-12-14T18:23:31.512870+0000","last_clean":"2023-12-14T18:23:31.512870+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:23:31.512870+0000","last_undegraded":"2023-12-14T18:23:31.512870+0000","last_fullsized":"2023-12-14T18:23:31.512870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:44:06.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962946+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:23:31.962946+0000","last_peered":"2023-12-14T18:23:31.962946+0000","last_clean":"2023-12-14T18:23:31.962946+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:23:31.962946+0000","last_undegraded":"2023-12-14T18:23:31.962946+0000","last_fullsized":"2023-12-14T18:23:31.962946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:13.860488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.322021+0000","last_change":"2023-12-14T18:23:28.904705+0000","last_active":"2023-12-14T18:23:32.322021+0000","last_peered":"2023-12-14T18:23:32.322021+0000","last_clean":"2023-12-14T18:23:32.322021+0000","last_became_active":"2023-12-14T18:23:28.904353+0000","last_became_peered":"2023-12-14T18:23:28.904353+0000","last_unstale":"2023-12-14T18:23:32.322021+0000","last_undegraded":"2023-12-14T18:23:32.322021+0000","last_fullsized":"2023-12-14T18:23:32.322021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:20.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965850+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:23:31.965850+0000","last_peered":"2023-12-14T18:23:31.965850+0000","last_clean":"2023-12-14T18:23:31.965850+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:23:31.965850+0000","last_undegraded":"2023-12-14T18:23:31.965850+0000","last_fullsized":"2023-12-14T18:23:31.965850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:43:44.219611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513178+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:23:31.513178+0000","last_peered":"2023-12-14T18:23:31.513178+0000","last_clean":"2023-12-14T18:23:31.513178+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:23:31.513178+0000","last_undegraded":"2023-12-14T18:23:31.513178+0000","last_fullsized":"2023-12-14T18:23:31.513178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:28.258373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963737+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:23:31.963737+0000","last_peered":"2023-12-14T18:23:31.963737+0000","last_clean":"2023-12-14T18:23:31.963737+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:23:31.963737+0000","last_undegraded":"2023-12-14T18:23:31.963737+0000","last_fullsized":"2023-12-14T18:23:31.963737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:40:30.090113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862732+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:23:30.862732+0000","last_peered":"2023-12-14T18:23:30.862732+0000","last_clean":"2023-12-14T18:23:30.862732+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:23:30.862732+0000","last_undegraded":"2023-12-14T18:23:30.862732+0000","last_fullsized":"2023-12-14T18:23:30.862732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:04.942766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964155+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:23:31.964155+0000","last_peered":"2023-12-14T18:23:31.964155+0000","last_clean":"2023-12-14T18:23:31.964155+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:23:31.964155+0000","last_undegraded":"2023-12-14T18:23:31.964155+0000","last_fullsized":"2023-12-14T18:23:31.964155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:09.415831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297796+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:23:30.297796+0000","last_peered":"2023-12-14T18:23:30.297796+0000","last_clean":"2023-12-14T18:23:30.297796+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:23:30.297796+0000","last_undegraded":"2023-12-14T18:23:30.297796+0000","last_fullsized":"2023-12-14T18:23:30.297796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:39:55.556069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963945+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:23:31.963945+0000","last_peered":"2023-12-14T18:23:31.963945+0000","last_clean":"2023-12-14T18:23:31.963945+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:23:31.963945+0000","last_undegraded":"2023-12-14T18:23:31.963945+0000","last_fullsized":"2023-12-14T18:23:31.963945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:04:04.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.321368+0000","last_change":"2023-12-14T18:23:29.319776+0000","last_active":"2023-12-14T18:23:29.321368+0000","last_peered":"2023-12-14T18:23:29.321368+0000","last_clean":"2023-12-14T18:23:29.321368+0000","last_became_active":"2023-12-14T18:23:29.319397+0000","last_became_peered":"2023-12-14T18:23:29.319397+0000","last_unstale":"2023-12-14T18:23:29.321368+0000","last_undegraded":"2023-12-14T18:23:29.321368+0000","last_fullsized":"2023-12-14T18:23:29.321368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:29:31.537459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512919+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:23:31.512919+0000","last_peered":"2023-12-14T18:23:31.512919+0000","last_clean":"2023-12-14T18:23:31.512919+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:23:31.512919+0000","last_undegraded":"2023-12-14T18:23:31.512919+0000","last_fullsized":"2023-12-14T18:23:31.512919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:34:15.547356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512973+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:23:31.512973+0000","last_peered":"2023-12-14T18:23:31.512973+0000","last_clean":"2023-12-14T18:23:31.512973+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:23:31.512973+0000","last_undegraded":"2023-12-14T18:23:31.512973+0000","last_fullsized":"2023-12-14T18:23:31.512973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:43:54.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962924+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:23:31.962924+0000","last_peered":"2023-12-14T18:23:31.962924+0000","last_clean":"2023-12-14T18:23:31.962924+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:23:31.962924+0000","last_undegraded":"2023-12-14T18:23:31.962924+0000","last_fullsized":"2023-12-14T18:23:31.962924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:19:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297898+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:23:30.297898+0000","last_peered":"2023-12-14T18:23:30.297898+0000","last_clean":"2023-12-14T18:23:30.297898+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:23:30.297898+0000","last_undegraded":"2023-12-14T18:23:30.297898+0000","last_fullsized":"2023-12-14T18:23:30.297898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:05:37.463585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328474+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:23:29.328474+0000","last_peered":"2023-12-14T18:23:29.328474+0000","last_clean":"2023-12-14T18:23:29.328474+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:23:29.328474+0000","last_undegraded":"2023-12-14T18:23:29.328474+0000","last_fullsized":"2023-12-14T18:23:29.328474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:38:59.294718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513248+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:23:31.513248+0000","last_peered":"2023-12-14T18:23:31.513248+0000","last_clean":"2023-12-14T18:23:31.513248+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:23:31.513248+0000","last_undegraded":"2023-12-14T18:23:31.513248+0000","last_fullsized":"2023-12-14T18:23:31.513248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:51:19.618834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963026+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:23:31.963026+0000","last_peered":"2023-12-14T18:23:31.963026+0000","last_clean":"2023-12-14T18:23:31.963026+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:23:31.963026+0000","last_undegraded":"2023-12-14T18:23:31.963026+0000","last_fullsized":"2023-12-14T18:23:31.963026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:51:46.572510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862373+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:23:30.862373+0000","last_peered":"2023-12-14T18:23:30.862373+0000","last_clean":"2023-12-14T18:23:30.862373+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:23:30.862373+0000","last_undegraded":"2023-12-14T18:23:30.862373+0000","last_fullsized":"2023-12-14T18:23:30.862373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:29.432206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962870+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:23:31.962870+0000","last_peered":"2023-12-14T18:23:31.962870+0000","last_clean":"2023-12-14T18:23:31.962870+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:23:31.962870+0000","last_undegraded":"2023-12-14T18:23:31.962870+0000","last_fullsized":"2023-12-14T18:23:31.962870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:48:20.698154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:49.538405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297941+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:23:30.297941+0000","last_peered":"2023-12-14T18:23:30.297941+0000","last_clean":"2023-12-14T18:23:30.297941+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:23:30.297941+0000","last_undegraded":"2023-12-14T18:23:30.297941+0000","last_fullsized":"2023-12-14T18:23:30.297941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:01:30.384170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328124+0000","last_change":"2023-12-14T18:23:29.325433+0000","last_active":"2023-12-14T18:23:29.328124+0000","last_peered":"2023-12-14T18:23:29.328124+0000","last_clean":"2023-12-14T18:23:29.328124+0000","last_became_active":"2023-12-14T18:23:29.325027+0000","last_became_peered":"2023-12-14T18:23:29.325027+0000","last_unstale":"2023-12-14T18:23:29.328124+0000","last_undegraded":"2023-12-14T18:23:29.328124+0000","last_fullsized":"2023-12-14T18:23:29.328124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:23:56.942164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3832,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":12146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579914,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5880,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739272,"statfs":{"total":95995035648,"available":95989014528,"internally_reserved":0,"allocated":835584,"data_stored":400330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6672,"kb_used_data":1416,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738480,"statfs":{"total":95995035648,"available":95988203520,"internally_reserved":0,"allocated":1449984,"data_stored":992125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":9,"up_from":62,"seq":266287972370,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6040,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739112,"statfs":{"total":95995035648,"available":95988850688,"internally_reserved":0,"allocated":868352,"data_stored":409718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.501}]},{"osd":7,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.51200000000000001}]},{"osd":8,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.64800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":8,"up_from":55,"seq":236223201301,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738928,"statfs":{"total":95995035648,"available":95988662272,"internally_reserved":0,"allocated":860160,"data_stored":409526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.499},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.871},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.86099999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.89300000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6872,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738280,"statfs":{"total":95995035648,"available":95987998720,"internally_reserved":0,"allocated":1458176,"data_stored":1000964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.62},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.628}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77900000000000003}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72099999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6148,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93739004,"statfs":{"total":95995035648,"available":95988740096,"internally_reserved":0,"allocated":847872,"data_stored":408900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.312},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.441}]},{"osd":2,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.502}]},{"osd":7,"last update":"Thu Dec 14 18:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47799999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63300000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65000000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7120,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738032,"statfs":{"total":95995035648,"available":95987744768,"internally_reserved":0,"allocated":860160,"data_stored":410464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.19,"15min":0.19},"max":{"1min":0.77500000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48499999999999999,"15min":0.45500000000000002},"min":{"1min":0.379,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.622}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.40100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.38700000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78100000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Dec 14 18:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73999999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Dec 14 18:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.80400000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.84999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7136,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738016,"statfs":{"total":95995035648,"available":95987728384,"internally_reserved":0,"allocated":876544,"data_stored":410378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.377,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.621},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.41699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.32000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Dec 14 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79300000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.505},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.436}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7108,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738044,"statfs":{"total":95995035648,"available":95987757056,"internally_reserved":0,"allocated":847872,"data_stored":401655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.68000000000000005,"5min":0.747,"15min":0.747},"last":0.439},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.39200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.625}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.747,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.753}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.76700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6416,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738736,"statfs":{"total":95995035648,"available":95988465664,"internally_reserved":0,"allocated":860160,"data_stored":409094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.443}]},{"osd":4,"last update":"Thu Dec 14 18:22:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.502,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57299999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6268,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738884,"statfs":{"total":95995035648,"available":95988617216,"internally_reserved":0,"allocated":839680,"data_stored":400352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36699999999999999},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70699999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.627}]},{"osd":5,"last update":"Thu Dec 14 18:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.373,"15min":0.373},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.79800000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.86699999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":5,"up_from":36,"seq":154618822688,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6948,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738204,"statfs":{"total":95995035648,"available":95987920896,"internally_reserved":0,"allocated":1470464,"data_stored":1000696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75}]},{"osd":2,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.442,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.72299999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65500000000000003}]},{"osd":9,"last update":"Thu Dec 14 18:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:23:36.990 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T18:23:37.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 -- 172.21.15.69:0/1475207250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230101da0 msgr2=0x7fd230108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:37.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 --2- 172.21.15.69:0/1475207250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230101da0 0x7fd230108660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd22800b0a0 tx=0x7fd22800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 -- 172.21.15.69:0/1475207250 shutdown_connections 2023-12-14T18:23:37.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 --2- 172.21.15.69:0/1475207250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230101da0 0x7fd230108660 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 --2- 172.21.15.69:0/1475207250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd230100220 0x7fd230100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 --2- 172.21.15.69:0/1475207250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd230101410 0x7fd230101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 -- 172.21.15.69:0/1475207250 >> 172.21.15.69:0/1475207250 conn(0x7fd2300fb800 msgr2=0x7fd2300fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 -- 172.21.15.69:0/1475207250 shutdown_connections 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.143+0000 7fd23551e700 1 -- 172.21.15.69:0/1475207250 wait complete. 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 Processor -- start 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 -- start start 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 0x7fd230196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd230101410 0x7fd230196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:37.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd230101da0 0x7fd23019d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23019dba0 con 0x7fd230100220 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23019dce0 con 0x7fd230101da0 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd23551e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23019de70 con 0x7fd230101410 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 0x7fd230196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 0x7fd230196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55506/0 (socket says 172.21.15.69:55506) 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 -- 172.21.15.69:0/1851612856 learned_addr learned my addr 172.21.15.69:0/1851612856 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22e7fc700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd230101410 0x7fd230196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22f7fe700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd230101da0 0x7fd23019d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 -- 172.21.15.69:0/1851612856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd230101410 msgr2=0x7fd230196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd230101410 0x7fd230196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 -- 172.21.15.69:0/1851612856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd230101da0 msgr2=0x7fd23019d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd230101da0 0x7fd23019d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.144+0000 7fd22effd700 1 -- 172.21.15.69:0/1851612856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228009d00 con 0x7fd230100220 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.145+0000 7fd22effd700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 0x7fd230196020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd22000e970 tx=0x7fd22000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.145+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220009790 con 0x7fd230100220 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.145+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23010ba40 con 0x7fd230100220 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.145+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2200044b0 con 0x7fd230100220 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.145+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003dd0 con 0x7fd230100220 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.145+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23010b8b0 con 0x7fd230100220 2023-12-14T18:23:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.146+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd230107810 con 0x7fd230100220 2023-12-14T18:23:37.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.147+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd220004000 con 0x7fd230100220 2023-12-14T18:23:37.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.147+0000 7fd217fff700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd2180a11e0 0x7fd2180a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:37.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.147+0000 7fd22e7fc700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd2180a11e0 0x7fd2180a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:37.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.147+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd220014070 con 0x7fd230100220 2023-12-14T18:23:37.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.148+0000 7fd22e7fc700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd2180a11e0 0x7fd2180a3690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd224009bd0 tx=0x7fd224009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:37.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.151+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd2200963f0 con 0x7fd230100220 2023-12-14T18:23:37.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.341+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd230061b00 con 0x7fd2180a11e0 2023-12-14T18:23:37.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.351+0000 7fd217fff700 1 -- 172.21.15.69:0/1851612856 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+327882 (secure 0 0 0) 0x7fd230061b00 con 0x7fd2180a11e0 2023-12-14T18:23:37.358 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:37.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd2180a11e0 msgr2=0x7fd2180a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd2180a11e0 0x7fd2180a3690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd224009bd0 tx=0x7fd224009260 comp rx=0 tx=0).stop 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 msgr2=0x7fd230196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 0x7fd230196020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd22000e970 tx=0x7fd22000ed30 comp rx=0 tx=0).stop 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 shutdown_connections 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd2180a11e0 0x7fd2180a3690 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd230101da0 0x7fd23019d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd230100220 0x7fd230196020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 --2- 172.21.15.69:0/1851612856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd230101410 0x7fd230196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 >> 172.21.15.69:0/1851612856 conn(0x7fd2300fb800 msgr2=0x7fd230104950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 shutdown_connections 2023-12-14T18:23:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:37.354+0000 7fd23551e700 1 -- 172.21.15.69:0/1851612856 wait complete. 2023-12-14T18:23:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:23:37.368 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2023-12-14T18:23:36.235318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594200,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":132,"num_read_kb":114,"num_write":281,"num_write_kb":2972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78832,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":1124862992,"statfs":{"total":1151940427776,"available":1151859703808,"internally_reserved":0,"allocated":12075008,"data_stored":6654202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3832,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.350451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328274+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:23:29.328274+0000","last_peered":"2023-12-14T18:23:29.328274+0000","last_clean":"2023-12-14T18:23:29.328274+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:23:29.328274+0000","last_undegraded":"2023-12-14T18:23:29.328274+0000","last_fullsized":"2023-12-14T18:23:29.328274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:14:54.111820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963017+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:23:31.963017+0000","last_peered":"2023-12-14T18:23:31.963017+0000","last_clean":"2023-12-14T18:23:31.963017+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:23:31.963017+0000","last_undegraded":"2023-12-14T18:23:31.963017+0000","last_fullsized":"2023-12-14T18:23:31.963017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:53:14.564046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962969+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:23:31.962969+0000","last_peered":"2023-12-14T18:23:31.962969+0000","last_clean":"2023-12-14T18:23:31.962969+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:23:31.962969+0000","last_undegraded":"2023-12-14T18:23:31.962969+0000","last_fullsized":"2023-12-14T18:23:31.962969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:55:45.247027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964402+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:23:31.964402+0000","last_peered":"2023-12-14T18:23:31.964402+0000","last_clean":"2023-12-14T18:23:31.964402+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:23:31.964402+0000","last_undegraded":"2023-12-14T18:23:31.964402+0000","last_fullsized":"2023-12-14T18:23:31.964402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:33.555138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298752+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:23:30.298752+0000","last_peered":"2023-12-14T18:23:30.298752+0000","last_clean":"2023-12-14T18:23:30.298752+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:23:30.298752+0000","last_undegraded":"2023-12-14T18:23:30.298752+0000","last_fullsized":"2023-12-14T18:23:30.298752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:45.744707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964734+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:23:31.964734+0000","last_peered":"2023-12-14T18:23:31.964734+0000","last_clean":"2023-12-14T18:23:31.964734+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:23:31.964734+0000","last_undegraded":"2023-12-14T18:23:31.964734+0000","last_fullsized":"2023-12-14T18:23:31.964734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:56:29.640721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963441+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:23:31.963441+0000","last_peered":"2023-12-14T18:23:31.963441+0000","last_clean":"2023-12-14T18:23:31.963441+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:23:31.963441+0000","last_undegraded":"2023-12-14T18:23:31.963441+0000","last_fullsized":"2023-12-14T18:23:31.963441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:29:53.508232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962583+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:23:31.962583+0000","last_peered":"2023-12-14T18:23:31.962583+0000","last_clean":"2023-12-14T18:23:31.962583+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:23:31.962583+0000","last_undegraded":"2023-12-14T18:23:31.962583+0000","last_fullsized":"2023-12-14T18:23:31.962583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:39:26.030240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298994+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:23:30.298994+0000","last_peered":"2023-12-14T18:23:30.298994+0000","last_clean":"2023-12-14T18:23:30.298994+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:23:30.298994+0000","last_undegraded":"2023-12-14T18:23:30.298994+0000","last_fullsized":"2023-12-14T18:23:30.298994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:53:45.531715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964560+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:23:31.964560+0000","last_peered":"2023-12-14T18:23:31.964560+0000","last_clean":"2023-12-14T18:23:31.964560+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:23:31.964560+0000","last_undegraded":"2023-12-14T18:23:31.964560+0000","last_fullsized":"2023-12-14T18:23:31.964560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:00.231623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963488+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:23:31.963488+0000","last_peered":"2023-12-14T18:23:31.963488+0000","last_clean":"2023-12-14T18:23:31.963488+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:23:31.963488+0000","last_undegraded":"2023-12-14T18:23:31.963488+0000","last_fullsized":"2023-12-14T18:23:31.963488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:19:41.156980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964275+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:23:31.964275+0000","last_peered":"2023-12-14T18:23:31.964275+0000","last_clean":"2023-12-14T18:23:31.964275+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:23:31.964275+0000","last_undegraded":"2023-12-14T18:23:31.964275+0000","last_fullsized":"2023-12-14T18:23:31.964275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:34:33.441932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297890+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:23:30.297890+0000","last_peered":"2023-12-14T18:23:30.297890+0000","last_clean":"2023-12-14T18:23:30.297890+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:23:30.297890+0000","last_undegraded":"2023-12-14T18:23:30.297890+0000","last_fullsized":"2023-12-14T18:23:30.297890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:59.839011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963183+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:23:31.963183+0000","last_peered":"2023-12-14T18:23:31.963183+0000","last_clean":"2023-12-14T18:23:31.963183+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:23:31.963183+0000","last_undegraded":"2023-12-14T18:23:31.963183+0000","last_fullsized":"2023-12-14T18:23:31.963183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:23:22.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962782+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:23:31.962782+0000","last_peered":"2023-12-14T18:23:31.962782+0000","last_clean":"2023-12-14T18:23:31.962782+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:23:31.962782+0000","last_undegraded":"2023-12-14T18:23:31.962782+0000","last_fullsized":"2023-12-14T18:23:31.962782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:13.104079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298442+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:23:30.298442+0000","last_peered":"2023-12-14T18:23:30.298442+0000","last_clean":"2023-12-14T18:23:30.298442+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:23:30.298442+0000","last_undegraded":"2023-12-14T18:23:30.298442+0000","last_fullsized":"2023-12-14T18:23:30.298442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:57.579587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328618+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:23:29.328618+0000","last_peered":"2023-12-14T18:23:29.328618+0000","last_clean":"2023-12-14T18:23:29.328618+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:23:29.328618+0000","last_undegraded":"2023-12-14T18:23:29.328618+0000","last_fullsized":"2023-12-14T18:23:29.328618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:52:57.417724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217912+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:23:31.217912+0000","last_peered":"2023-12-14T18:23:31.217912+0000","last_clean":"2023-12-14T18:23:31.217912+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:23:31.217912+0000","last_undegraded":"2023-12-14T18:23:31.217912+0000","last_fullsized":"2023-12-14T18:23:31.217912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:37.822774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513258+0000","last_change":"2023-12-14T18:23:29.320811+0000","last_active":"2023-12-14T18:23:31.513258+0000","last_peered":"2023-12-14T18:23:31.513258+0000","last_clean":"2023-12-14T18:23:31.513258+0000","last_became_active":"2023-12-14T18:23:29.315538+0000","last_became_peered":"2023-12-14T18:23:29.315538+0000","last_unstale":"2023-12-14T18:23:31.513258+0000","last_undegraded":"2023-12-14T18:23:31.513258+0000","last_fullsized":"2023-12-14T18:23:31.513258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:26:01.785017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.333714+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:23:33.333714+0000","last_peered":"2023-12-14T18:23:33.333714+0000","last_clean":"2023-12-14T18:23:33.333714+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:23:33.333714+0000","last_undegraded":"2023-12-14T18:23:33.333714+0000","last_fullsized":"2023-12-14T18:23:33.333714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:15:49.986514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962770+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:23:31.962770+0000","last_peered":"2023-12-14T18:23:31.962770+0000","last_clean":"2023-12-14T18:23:31.962770+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:23:31.962770+0000","last_undegraded":"2023-12-14T18:23:31.962770+0000","last_fullsized":"2023-12-14T18:23:31.962770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:10.086046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962978+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:23:31.962978+0000","last_peered":"2023-12-14T18:23:31.962978+0000","last_clean":"2023-12-14T18:23:31.962978+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:23:31.962978+0000","last_undegraded":"2023-12-14T18:23:31.962978+0000","last_fullsized":"2023-12-14T18:23:31.962978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:08:25.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963326+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:23:31.963326+0000","last_peered":"2023-12-14T18:23:31.963326+0000","last_clean":"2023-12-14T18:23:31.963326+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:23:31.963326+0000","last_undegraded":"2023-12-14T18:23:31.963326+0000","last_fullsized":"2023-12-14T18:23:31.963326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:09:13.088758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332104+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:23:33.332104+0000","last_peered":"2023-12-14T18:23:33.332104+0000","last_clean":"2023-12-14T18:23:33.332104+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:23:33.332104+0000","last_undegraded":"2023-12-14T18:23:33.332104+0000","last_fullsized":"2023-12-14T18:23:33.332104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:29:10.775688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298727+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:23:30.298727+0000","last_peered":"2023-12-14T18:23:30.298727+0000","last_clean":"2023-12-14T18:23:30.298727+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:23:30.298727+0000","last_undegraded":"2023-12-14T18:23:30.298727+0000","last_fullsized":"2023-12-14T18:23:30.298727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:08.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299162+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:23:30.299162+0000","last_peered":"2023-12-14T18:23:30.299162+0000","last_clean":"2023-12-14T18:23:30.299162+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:23:30.299162+0000","last_undegraded":"2023-12-14T18:23:30.299162+0000","last_fullsized":"2023-12-14T18:23:30.299162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:16.688070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862680+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:23:30.862680+0000","last_peered":"2023-12-14T18:23:30.862680+0000","last_clean":"2023-12-14T18:23:30.862680+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:23:30.862680+0000","last_undegraded":"2023-12-14T18:23:30.862680+0000","last_fullsized":"2023-12-14T18:23:30.862680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:38.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:34.345522+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:23:34.345522+0000","last_peered":"2023-12-14T18:23:34.345522+0000","last_clean":"2023-12-14T18:23:34.345522+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:23:34.345522+0000","last_undegraded":"2023-12-14T18:23:34.345522+0000","last_fullsized":"2023-12-14T18:23:34.345522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:41.803316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298872+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:23:30.298872+0000","last_peered":"2023-12-14T18:23:30.298872+0000","last_clean":"2023-12-14T18:23:30.298872+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:23:30.298872+0000","last_undegraded":"2023-12-14T18:23:30.298872+0000","last_fullsized":"2023-12-14T18:23:30.298872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:00:06.468221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964558+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:23:31.964558+0000","last_peered":"2023-12-14T18:23:31.964558+0000","last_clean":"2023-12-14T18:23:31.964558+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:23:31.964558+0000","last_undegraded":"2023-12-14T18:23:31.964558+0000","last_fullsized":"2023-12-14T18:23:31.964558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:38:50.312141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862519+0000","last_change":"2023-12-14T18:23:29.314941+0000","last_active":"2023-12-14T18:23:30.862519+0000","last_peered":"2023-12-14T18:23:30.862519+0000","last_clean":"2023-12-14T18:23:30.862519+0000","last_became_active":"2023-12-14T18:23:29.314508+0000","last_became_peered":"2023-12-14T18:23:29.314508+0000","last_unstale":"2023-12-14T18:23:30.862519+0000","last_undegraded":"2023-12-14T18:23:30.862519+0000","last_fullsized":"2023-12-14T18:23:30.862519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:06:11.981373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297730+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:23:30.297730+0000","last_peered":"2023-12-14T18:23:30.297730+0000","last_clean":"2023-12-14T18:23:30.297730+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:23:30.297730+0000","last_undegraded":"2023-12-14T18:23:30.297730+0000","last_fullsized":"2023-12-14T18:23:30.297730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:53.112965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962525+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:23:31.962525+0000","last_peered":"2023-12-14T18:23:31.962525+0000","last_clean":"2023-12-14T18:23:31.962525+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:23:31.962525+0000","last_undegraded":"2023-12-14T18:23:31.962525+0000","last_fullsized":"2023-12-14T18:23:31.962525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:56.891103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862356+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:23:30.862356+0000","last_peered":"2023-12-14T18:23:30.862356+0000","last_clean":"2023-12-14T18:23:30.862356+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:23:30.862356+0000","last_undegraded":"2023-12-14T18:23:30.862356+0000","last_fullsized":"2023-12-14T18:23:30.862356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:02:39.786052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217715+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:23:31.217715+0000","last_peered":"2023-12-14T18:23:31.217715+0000","last_clean":"2023-12-14T18:23:31.217715+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:23:31.217715+0000","last_undegraded":"2023-12-14T18:23:31.217715+0000","last_fullsized":"2023-12-14T18:23:31.217715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:40:20.784196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321167+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:23:32.321167+0000","last_peered":"2023-12-14T18:23:32.321167+0000","last_clean":"2023-12-14T18:23:32.321167+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:23:32.321167+0000","last_undegraded":"2023-12-14T18:23:32.321167+0000","last_fullsized":"2023-12-14T18:23:32.321167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:52:10.663306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:47.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321675+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:23:32.321675+0000","last_peered":"2023-12-14T18:23:32.321675+0000","last_clean":"2023-12-14T18:23:32.321675+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:23:32.321675+0000","last_undegraded":"2023-12-14T18:23:32.321675+0000","last_fullsized":"2023-12-14T18:23:32.321675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:07.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963309+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:23:31.963309+0000","last_peered":"2023-12-14T18:23:31.963309+0000","last_clean":"2023-12-14T18:23:31.963309+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:23:31.963309+0000","last_undegraded":"2023-12-14T18:23:31.963309+0000","last_fullsized":"2023-12-14T18:23:31.963309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:30.502067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321701+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:23:32.321701+0000","last_peered":"2023-12-14T18:23:32.321701+0000","last_clean":"2023-12-14T18:23:32.321701+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:23:32.321701+0000","last_undegraded":"2023-12-14T18:23:32.321701+0000","last_fullsized":"2023-12-14T18:23:32.321701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:01:37.437148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298957+0000","last_change":"2023-12-14T18:23:29.311912+0000","last_active":"2023-12-14T18:23:30.298957+0000","last_peered":"2023-12-14T18:23:30.298957+0000","last_clean":"2023-12-14T18:23:30.298957+0000","last_became_active":"2023-12-14T18:23:29.310752+0000","last_became_peered":"2023-12-14T18:23:29.310752+0000","last_unstale":"2023-12-14T18:23:30.298957+0000","last_undegraded":"2023-12-14T18:23:30.298957+0000","last_fullsized":"2023-12-14T18:23:30.298957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:29:06.495199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320917+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:23:32.320917+0000","last_peered":"2023-12-14T18:23:32.320917+0000","last_clean":"2023-12-14T18:23:32.320917+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:23:32.320917+0000","last_undegraded":"2023-12-14T18:23:32.320917+0000","last_fullsized":"2023-12-14T18:23:32.320917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:01.303699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299079+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:23:30.299079+0000","last_peered":"2023-12-14T18:23:30.299079+0000","last_clean":"2023-12-14T18:23:30.299079+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:23:30.299079+0000","last_undegraded":"2023-12-14T18:23:30.299079+0000","last_fullsized":"2023-12-14T18:23:30.299079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:03.844259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512976+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:23:31.512976+0000","last_peered":"2023-12-14T18:23:31.512976+0000","last_clean":"2023-12-14T18:23:31.512976+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:23:31.512976+0000","last_undegraded":"2023-12-14T18:23:31.512976+0000","last_fullsized":"2023-12-14T18:23:31.512976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:16:46.098127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297832+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:23:30.297832+0000","last_peered":"2023-12-14T18:23:30.297832+0000","last_clean":"2023-12-14T18:23:30.297832+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:23:30.297832+0000","last_undegraded":"2023-12-14T18:23:30.297832+0000","last_fullsized":"2023-12-14T18:23:30.297832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:06:04.096044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321149+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:23:32.321149+0000","last_peered":"2023-12-14T18:23:32.321149+0000","last_clean":"2023-12-14T18:23:32.321149+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:23:32.321149+0000","last_undegraded":"2023-12-14T18:23:32.321149+0000","last_fullsized":"2023-12-14T18:23:32.321149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:28:23.739941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964105+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:23:31.964105+0000","last_peered":"2023-12-14T18:23:31.964105+0000","last_clean":"2023-12-14T18:23:31.964105+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:23:31.964105+0000","last_undegraded":"2023-12-14T18:23:31.964105+0000","last_fullsized":"2023-12-14T18:23:31.964105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:55:38.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963537+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:23:31.963537+0000","last_peered":"2023-12-14T18:23:31.963537+0000","last_clean":"2023-12-14T18:23:31.963537+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:23:31.963537+0000","last_undegraded":"2023-12-14T18:23:31.963537+0000","last_fullsized":"2023-12-14T18:23:31.963537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:17:49.846098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963126+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:23:31.963126+0000","last_peered":"2023-12-14T18:23:31.963126+0000","last_clean":"2023-12-14T18:23:31.963126+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:23:31.963126+0000","last_undegraded":"2023-12-14T18:23:31.963126+0000","last_fullsized":"2023-12-14T18:23:31.963126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:38:37.985717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.334495+0000","last_change":"2023-12-14T18:23:28.904227+0000","last_active":"2023-12-14T18:23:33.334495+0000","last_peered":"2023-12-14T18:23:33.334495+0000","last_clean":"2023-12-14T18:23:33.334495+0000","last_became_active":"2023-12-14T18:23:28.903844+0000","last_became_peered":"2023-12-14T18:23:28.903844+0000","last_unstale":"2023-12-14T18:23:33.334495+0000","last_undegraded":"2023-12-14T18:23:33.334495+0000","last_fullsized":"2023-12-14T18:23:33.334495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:03:09.233743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862403+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:23:30.862403+0000","last_peered":"2023-12-14T18:23:30.862403+0000","last_clean":"2023-12-14T18:23:30.862403+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:23:30.862403+0000","last_undegraded":"2023-12-14T18:23:30.862403+0000","last_fullsized":"2023-12-14T18:23:30.862403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:06:02.516476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299071+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:23:30.299071+0000","last_peered":"2023-12-14T18:23:30.299071+0000","last_clean":"2023-12-14T18:23:30.299071+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:23:30.299071+0000","last_undegraded":"2023-12-14T18:23:30.299071+0000","last_fullsized":"2023-12-14T18:23:30.299071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:49:05.274081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.318728+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:23:29.318728+0000","last_peered":"2023-12-14T18:23:29.318728+0000","last_clean":"2023-12-14T18:23:29.318728+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:23:29.318728+0000","last_undegraded":"2023-12-14T18:23:29.318728+0000","last_fullsized":"2023-12-14T18:23:29.318728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:39:59.709756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217770+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:23:31.217770+0000","last_peered":"2023-12-14T18:23:31.217770+0000","last_clean":"2023-12-14T18:23:31.217770+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:23:31.217770+0000","last_undegraded":"2023-12-14T18:23:31.217770+0000","last_fullsized":"2023-12-14T18:23:31.217770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:41:07.717205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964309+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:23:31.964309+0000","last_peered":"2023-12-14T18:23:31.964309+0000","last_clean":"2023-12-14T18:23:31.964309+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:23:31.964309+0000","last_undegraded":"2023-12-14T18:23:31.964309+0000","last_fullsized":"2023-12-14T18:23:31.964309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:14.386800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965740+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:23:31.965740+0000","last_peered":"2023-12-14T18:23:31.965740+0000","last_clean":"2023-12-14T18:23:31.965740+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:23:31.965740+0000","last_undegraded":"2023-12-14T18:23:31.965740+0000","last_fullsized":"2023-12-14T18:23:31.965740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:04.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964456+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:23:31.964456+0000","last_peered":"2023-12-14T18:23:31.964456+0000","last_clean":"2023-12-14T18:23:31.964456+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:23:31.964456+0000","last_undegraded":"2023-12-14T18:23:31.964456+0000","last_fullsized":"2023-12-14T18:23:31.964456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:44.704602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862512+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:23:30.862512+0000","last_peered":"2023-12-14T18:23:30.862512+0000","last_clean":"2023-12-14T18:23:30.862512+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:23:30.862512+0000","last_undegraded":"2023-12-14T18:23:30.862512+0000","last_fullsized":"2023-12-14T18:23:30.862512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:26:23.141463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297616+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:23:30.297616+0000","last_peered":"2023-12-14T18:23:30.297616+0000","last_clean":"2023-12-14T18:23:30.297616+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:23:30.297616+0000","last_undegraded":"2023-12-14T18:23:30.297616+0000","last_fullsized":"2023-12-14T18:23:30.297616+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:05.438111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963266+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:23:31.963266+0000","last_peered":"2023-12-14T18:23:31.963266+0000","last_clean":"2023-12-14T18:23:31.963266+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:23:31.963266+0000","last_undegraded":"2023-12-14T18:23:31.963266+0000","last_fullsized":"2023-12-14T18:23:31.963266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:15:26.892489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.322180+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:23:32.322180+0000","last_peered":"2023-12-14T18:23:32.322180+0000","last_clean":"2023-12-14T18:23:32.322180+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:23:32.322180+0000","last_undegraded":"2023-12-14T18:23:32.322180+0000","last_fullsized":"2023-12-14T18:23:32.322180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:20.683055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":328,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963196+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:23:31.963196+0000","last_peered":"2023-12-14T18:23:31.963196+0000","last_clean":"2023-12-14T18:23:31.963196+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:23:31.963196+0000","last_undegraded":"2023-12-14T18:23:31.963196+0000","last_fullsized":"2023-12-14T18:23:31.963196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:25:43.576640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297606+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:23:30.297606+0000","last_peered":"2023-12-14T18:23:30.297606+0000","last_clean":"2023-12-14T18:23:30.297606+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:23:30.297606+0000","last_undegraded":"2023-12-14T18:23:30.297606+0000","last_fullsized":"2023-12-14T18:23:30.297606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:42.044013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332781+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:23:33.332781+0000","last_peered":"2023-12-14T18:23:33.332781+0000","last_clean":"2023-12-14T18:23:33.332781+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:23:33.332781+0000","last_undegraded":"2023-12-14T18:23:33.332781+0000","last_fullsized":"2023-12-14T18:23:33.332781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:18.549174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298945+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:23:30.298945+0000","last_peered":"2023-12-14T18:23:30.298945+0000","last_clean":"2023-12-14T18:23:30.298945+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:23:30.298945+0000","last_undegraded":"2023-12-14T18:23:30.298945+0000","last_fullsized":"2023-12-14T18:23:30.298945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:59:20.753750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297936+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:23:30.297936+0000","last_peered":"2023-12-14T18:23:30.297936+0000","last_clean":"2023-12-14T18:23:30.297936+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:23:30.297936+0000","last_undegraded":"2023-12-14T18:23:30.297936+0000","last_fullsized":"2023-12-14T18:23:30.297936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:42.595546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.333542+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:23:33.333542+0000","last_peered":"2023-12-14T18:23:33.333542+0000","last_clean":"2023-12-14T18:23:33.333542+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:23:33.333542+0000","last_undegraded":"2023-12-14T18:23:33.333542+0000","last_fullsized":"2023-12-14T18:23:33.333542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:48:44.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963156+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:23:31.963156+0000","last_peered":"2023-12-14T18:23:31.963156+0000","last_clean":"2023-12-14T18:23:31.963156+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:23:31.963156+0000","last_undegraded":"2023-12-14T18:23:31.963156+0000","last_fullsized":"2023-12-14T18:23:31.963156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:46.733098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320452+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:23:32.320452+0000","last_peered":"2023-12-14T18:23:32.320452+0000","last_clean":"2023-12-14T18:23:32.320452+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:23:32.320452+0000","last_undegraded":"2023-12-14T18:23:32.320452+0000","last_fullsized":"2023-12-14T18:23:32.320452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:34:04.103111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963119+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:23:31.963119+0000","last_peered":"2023-12-14T18:23:31.963119+0000","last_clean":"2023-12-14T18:23:31.963119+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:23:31.963119+0000","last_undegraded":"2023-12-14T18:23:31.963119+0000","last_fullsized":"2023-12-14T18:23:31.963119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:13:05.096473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320457+0000","last_change":"2023-12-14T18:23:28.902315+0000","last_active":"2023-12-14T18:23:32.320457+0000","last_peered":"2023-12-14T18:23:32.320457+0000","last_clean":"2023-12-14T18:23:32.320457+0000","last_became_active":"2023-12-14T18:23:28.901654+0000","last_became_peered":"2023-12-14T18:23:28.901654+0000","last_unstale":"2023-12-14T18:23:32.320457+0000","last_undegraded":"2023-12-14T18:23:32.320457+0000","last_fullsized":"2023-12-14T18:23:32.320457+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:27:11.302617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298674+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:23:30.298674+0000","last_peered":"2023-12-14T18:23:30.298674+0000","last_clean":"2023-12-14T18:23:30.298674+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:23:30.298674+0000","last_undegraded":"2023-12-14T18:23:30.298674+0000","last_fullsized":"2023-12-14T18:23:30.298674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.125688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321569+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:23:32.321569+0000","last_peered":"2023-12-14T18:23:32.321569+0000","last_clean":"2023-12-14T18:23:32.321569+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:23:32.321569+0000","last_undegraded":"2023-12-14T18:23:32.321569+0000","last_fullsized":"2023-12-14T18:23:32.321569+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:07.935972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.318398+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:23:29.318398+0000","last_peered":"2023-12-14T18:23:29.318398+0000","last_clean":"2023-12-14T18:23:29.318398+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:23:29.318398+0000","last_undegraded":"2023-12-14T18:23:29.318398+0000","last_fullsized":"2023-12-14T18:23:29.318398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:33:45.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512870+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:23:31.512870+0000","last_peered":"2023-12-14T18:23:31.512870+0000","last_clean":"2023-12-14T18:23:31.512870+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:23:31.512870+0000","last_undegraded":"2023-12-14T18:23:31.512870+0000","last_fullsized":"2023-12-14T18:23:31.512870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:44:06.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962946+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:23:31.962946+0000","last_peered":"2023-12-14T18:23:31.962946+0000","last_clean":"2023-12-14T18:23:31.962946+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:23:31.962946+0000","last_undegraded":"2023-12-14T18:23:31.962946+0000","last_fullsized":"2023-12-14T18:23:31.962946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:13.860488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.322021+0000","last_change":"2023-12-14T18:23:28.904705+0000","last_active":"2023-12-14T18:23:32.322021+0000","last_peered":"2023-12-14T18:23:32.322021+0000","last_clean":"2023-12-14T18:23:32.322021+0000","last_became_active":"2023-12-14T18:23:28.904353+0000","last_became_peered":"2023-12-14T18:23:28.904353+0000","last_unstale":"2023-12-14T18:23:32.322021+0000","last_undegraded":"2023-12-14T18:23:32.322021+0000","last_fullsized":"2023-12-14T18:23:32.322021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:20.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965850+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:23:31.965850+0000","last_peered":"2023-12-14T18:23:31.965850+0000","last_clean":"2023-12-14T18:23:31.965850+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:23:31.965850+0000","last_undegraded":"2023-12-14T18:23:31.965850+0000","last_fullsized":"2023-12-14T18:23:31.965850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:43:44.219611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513178+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:23:31.513178+0000","last_peered":"2023-12-14T18:23:31.513178+0000","last_clean":"2023-12-14T18:23:31.513178+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:23:31.513178+0000","last_undegraded":"2023-12-14T18:23:31.513178+0000","last_fullsized":"2023-12-14T18:23:31.513178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:28.258373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963737+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:23:31.963737+0000","last_peered":"2023-12-14T18:23:31.963737+0000","last_clean":"2023-12-14T18:23:31.963737+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:23:31.963737+0000","last_undegraded":"2023-12-14T18:23:31.963737+0000","last_fullsized":"2023-12-14T18:23:31.963737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:40:30.090113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862732+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:23:30.862732+0000","last_peered":"2023-12-14T18:23:30.862732+0000","last_clean":"2023-12-14T18:23:30.862732+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:23:30.862732+0000","last_undegraded":"2023-12-14T18:23:30.862732+0000","last_fullsized":"2023-12-14T18:23:30.862732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:04.942766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964155+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:23:31.964155+0000","last_peered":"2023-12-14T18:23:31.964155+0000","last_clean":"2023-12-14T18:23:31.964155+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:23:31.964155+0000","last_undegraded":"2023-12-14T18:23:31.964155+0000","last_fullsized":"2023-12-14T18:23:31.964155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:09.415831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297796+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:23:30.297796+0000","last_peered":"2023-12-14T18:23:30.297796+0000","last_clean":"2023-12-14T18:23:30.297796+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:23:30.297796+0000","last_undegraded":"2023-12-14T18:23:30.297796+0000","last_fullsized":"2023-12-14T18:23:30.297796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:39:55.556069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963945+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:23:31.963945+0000","last_peered":"2023-12-14T18:23:31.963945+0000","last_clean":"2023-12-14T18:23:31.963945+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:23:31.963945+0000","last_undegraded":"2023-12-14T18:23:31.963945+0000","last_fullsized":"2023-12-14T18:23:31.963945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:04:04.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.321368+0000","last_change":"2023-12-14T18:23:29.319776+0000","last_active":"2023-12-14T18:23:29.321368+0000","last_peered":"2023-12-14T18:23:29.321368+0000","last_clean":"2023-12-14T18:23:29.321368+0000","last_became_active":"2023-12-14T18:23:29.319397+0000","last_became_peered":"2023-12-14T18:23:29.319397+0000","last_unstale":"2023-12-14T18:23:29.321368+0000","last_undegraded":"2023-12-14T18:23:29.321368+0000","last_fullsized":"2023-12-14T18:23:29.321368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:29:31.537459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512919+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:23:31.512919+0000","last_peered":"2023-12-14T18:23:31.512919+0000","last_clean":"2023-12-14T18:23:31.512919+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:23:31.512919+0000","last_undegraded":"2023-12-14T18:23:31.512919+0000","last_fullsized":"2023-12-14T18:23:31.512919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:34:15.547356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512973+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:23:31.512973+0000","last_peered":"2023-12-14T18:23:31.512973+0000","last_clean":"2023-12-14T18:23:31.512973+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:23:31.512973+0000","last_undegraded":"2023-12-14T18:23:31.512973+0000","last_fullsized":"2023-12-14T18:23:31.512973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:43:54.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962924+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:23:31.962924+0000","last_peered":"2023-12-14T18:23:31.962924+0000","last_clean":"2023-12-14T18:23:31.962924+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:23:31.962924+0000","last_undegraded":"2023-12-14T18:23:31.962924+0000","last_fullsized":"2023-12-14T18:23:31.962924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:19:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297898+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:23:30.297898+0000","last_peered":"2023-12-14T18:23:30.297898+0000","last_clean":"2023-12-14T18:23:30.297898+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:23:30.297898+0000","last_undegraded":"2023-12-14T18:23:30.297898+0000","last_fullsized":"2023-12-14T18:23:30.297898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:05:37.463585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328474+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:23:29.328474+0000","last_peered":"2023-12-14T18:23:29.328474+0000","last_clean":"2023-12-14T18:23:29.328474+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:23:29.328474+0000","last_undegraded":"2023-12-14T18:23:29.328474+0000","last_fullsized":"2023-12-14T18:23:29.328474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:38:59.294718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513248+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:23:31.513248+0000","last_peered":"2023-12-14T18:23:31.513248+0000","last_clean":"2023-12-14T18:23:31.513248+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:23:31.513248+0000","last_undegraded":"2023-12-14T18:23:31.513248+0000","last_fullsized":"2023-12-14T18:23:31.513248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:51:19.618834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963026+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:23:31.963026+0000","last_peered":"2023-12-14T18:23:31.963026+0000","last_clean":"2023-12-14T18:23:31.963026+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:23:31.963026+0000","last_undegraded":"2023-12-14T18:23:31.963026+0000","last_fullsized":"2023-12-14T18:23:31.963026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:51:46.572510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862373+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:23:30.862373+0000","last_peered":"2023-12-14T18:23:30.862373+0000","last_clean":"2023-12-14T18:23:30.862373+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:23:30.862373+0000","last_undegraded":"2023-12-14T18:23:30.862373+0000","last_fullsized":"2023-12-14T18:23:30.862373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:29.432206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962870+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:23:31.962870+0000","last_peered":"2023-12-14T18:23:31.962870+0000","last_clean":"2023-12-14T18:23:31.962870+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:23:31.962870+0000","last_undegraded":"2023-12-14T18:23:31.962870+0000","last_fullsized":"2023-12-14T18:23:31.962870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:48:20.698154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:49.538405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297941+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:23:30.297941+0000","last_peered":"2023-12-14T18:23:30.297941+0000","last_clean":"2023-12-14T18:23:30.297941+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:23:30.297941+0000","last_undegraded":"2023-12-14T18:23:30.297941+0000","last_fullsized":"2023-12-14T18:23:30.297941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:01:30.384170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-14T18:23:29.328124+0000","last_change":"2023-12-14T18:23:29.325433+0000","last_active":"2023-12-14T18:23:29.328124+0000","last_peered":"2023-12-14T18:23:29.328124+0000","last_clean":"2023-12-14T18:23:29.328124+0000","last_became_active":"2023-12-14T18:23:29.325027+0000","last_became_peered":"2023-12-14T18:23:29.325027+0000","last_unstale":"2023-12-14T18:23:29.328124+0000","last_undegraded":"2023-12-14T18:23:29.328124+0000","last_fullsized":"2023-12-14T18:23:29.328124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:23:56.942164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3832,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":12146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579914,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5880,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739272,"statfs":{"total":95995035648,"available":95989014528,"internally_reserved":0,"allocated":835584,"data_stored":400330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6672,"kb_used_data":1416,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738480,"statfs":{"total":95995035648,"available":95988203520,"internally_reserved":0,"allocated":1449984,"data_stored":992125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":9,"up_from":62,"seq":266287972370,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6040,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739112,"statfs":{"total":95995035648,"available":95988850688,"internally_reserved":0,"allocated":868352,"data_stored":409718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.501}]},{"osd":7,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.51200000000000001}]},{"osd":8,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.64800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":8,"up_from":55,"seq":236223201301,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738928,"statfs":{"total":95995035648,"available":95988662272,"internally_reserved":0,"allocated":860160,"data_stored":409526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.499},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Dec 14 18:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.871},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.86099999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.89300000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6872,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738280,"statfs":{"total":95995035648,"available":95987998720,"internally_reserved":0,"allocated":1458176,"data_stored":1000964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.62},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.628}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77900000000000003}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72099999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6148,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93739004,"statfs":{"total":95995035648,"available":95988740096,"internally_reserved":0,"allocated":847872,"data_stored":408900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.312},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.441}]},{"osd":2,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.502}]},{"osd":7,"last update":"Thu Dec 14 18:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47799999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63300000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65000000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7120,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738032,"statfs":{"total":95995035648,"available":95987744768,"internally_reserved":0,"allocated":860160,"data_stored":410464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.19,"15min":0.19},"max":{"1min":0.77500000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48499999999999999,"15min":0.45500000000000002},"min":{"1min":0.379,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.622}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.40100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.38700000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78100000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Dec 14 18:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73999999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Dec 14 18:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.80400000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.84999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7136,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738016,"statfs":{"total":95995035648,"available":95987728384,"internally_reserved":0,"allocated":876544,"data_stored":410378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.377,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.621},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.51200000000000001,"15min":0.48999999999999999},"min":{"1min":0.41699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.32000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Dec 14 18:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79300000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.505},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.436}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7108,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738044,"statfs":{"total":95995035648,"available":95987757056,"internally_reserved":0,"allocated":847872,"data_stored":401655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.68000000000000005,"5min":0.747,"15min":0.747},"last":0.439},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.39200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.625}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.747,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.753}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.76700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6416,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738736,"statfs":{"total":95995035648,"available":95988465664,"internally_reserved":0,"allocated":860160,"data_stored":409094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.443}]},{"osd":4,"last update":"Thu Dec 14 18:22:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.502,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57299999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6268,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738884,"statfs":{"total":95995035648,"available":95988617216,"internally_reserved":0,"allocated":839680,"data_stored":400352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36699999999999999},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70699999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.627}]},{"osd":5,"last update":"Thu Dec 14 18:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.373,"15min":0.373},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.79800000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.86699999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":5,"up_from":36,"seq":154618822688,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6948,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738204,"statfs":{"total":95995035648,"available":95987920896,"internally_reserved":0,"allocated":1470464,"data_stored":1000696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75}]},{"osd":2,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.442,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.72299999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65500000000000003}]},{"osd":9,"last update":"Thu Dec 14 18:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:23:37.374 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-14T18:23:37.374 INFO:tasks.cephadm:Setting up client nodes... 2023-12-14T18:23:37.374 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-14T18:23:37.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:37 smithi119 ceph-mon[43973]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:37.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:37 smithi119 ceph-mon[43973]: pgmap v224: 97 pgs: 97 active+clean; 580 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 696 B/s rd, 4.6 KiB/s wr, 14 op/s 2023-12-14T18:23:37.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:37 smithi119 ceph-mon[43973]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-14T18:23:37.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:37 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/170687791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:37.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:37 smithi091 ceph-mon[43601]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:37.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:37 smithi091 ceph-mon[43601]: pgmap v224: 97 pgs: 97 active+clean; 580 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 696 B/s rd, 4.6 KiB/s wr, 14 op/s 2023-12-14T18:23:37.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:37 smithi091 ceph-mon[43601]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-14T18:23:37.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:37 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/170687791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:37.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:37 smithi069 ceph-mon[42047]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:23:37.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:37 smithi069 ceph-mon[42047]: pgmap v224: 97 pgs: 97 active+clean; 580 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 696 B/s rd, 4.6 KiB/s wr, 14 op/s 2023-12-14T18:23:37.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:37 smithi069 ceph-mon[42047]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-14T18:23:37.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:37 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/170687791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:37.715 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:38.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:38 smithi069 ceph-mon[42047]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:23:38.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:38 smithi069 ceph-mon[42047]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:23:38.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:38 smithi119 ceph-mon[43973]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:23:38.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:38 smithi119 ceph-mon[43973]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:23:38.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:38 smithi091 ceph-mon[43601]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:23:38.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:38 smithi091 ceph-mon[43601]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 -- 172.21.15.69:0/3396780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 msgr2=0x7f981c0fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3396780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c0fffb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9808009990 tx=0x7f9808009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 -- 172.21.15.69:0/3396780462 shutdown_connections 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3396780462 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 0x7f981c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3396780462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f981c0fe960 0x7f981c0fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3396780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c0fffb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 -- 172.21.15.69:0/3396780462 >> 172.21.15.69:0/3396780462 conn(0x7f981c0f9f70 msgr2=0x7f981c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:38.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 -- 172.21.15.69:0/3396780462 shutdown_connections 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 -- 172.21.15.69:0/3396780462 wait complete. 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 Processor -- start 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.748+0000 7f9822b3a700 1 -- start start 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f981c0fe960 0x7f981c108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 0x7f981c19d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c19d9d0 con 0x7f981c0ffb60 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c19db40 con 0x7f981c1004f0 2023-12-14T18:23:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c19dd00 con 0x7f981c0fe960 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55522/0 (socket says 172.21.15.69:55522) 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 -- 172.21.15.69:0/3659962610 learned_addr learned my addr 172.21.15.69:0/3659962610 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f98208d6700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f981c0fe960 0x7f981c108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f98210d7700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 0x7f981c19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 -- 172.21.15.69:0/3659962610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f981c0fe960 msgr2=0x7f981c108200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f981c0fe960 0x7f981c108200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 -- 172.21.15.69:0/3659962610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 msgr2=0x7f981c19d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 0x7f981c19d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 -- 172.21.15.69:0/3659962610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080095f0 con 0x7f981c0ffb60 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f98210d7700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 0x7f981c19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f981bfff700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c19abf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9808006010 tx=0x7f9808003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980801d070 con 0x7f981c0ffb60 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f980800bd70 con 0x7f981c0ffb60 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c10a9e0 con 0x7f981c0ffb60 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.749+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808022cb0 con 0x7f981c0ffb60 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.750+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c10a850 con 0x7f981c0ffb60 2023-12-14T18:23:38.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.751+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c105f00 con 0x7f981c0ffb60 2023-12-14T18:23:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.751+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9808022470 con 0x7f981c0ffb60 2023-12-14T18:23:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.752+0000 7f9819ffb700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f980c0a1260 0x7f980c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.752+0000 7f98208d6700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f980c0a1260 0x7f980c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.752+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f98080cde90 con 0x7f981c0ffb60 2023-12-14T18:23:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.752+0000 7f98208d6700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f980c0a1260 0x7f980c0a3710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ff9c0 tx=0x7f981000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:38.756+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f98080976c0 con 0x7f981c0ffb60 2023-12-14T18:23:39.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.023+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f981c061700 con 0x7f981c0ffb60 2023-12-14T18:23:39.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.027+0000 7f9819ffb700 1 -- 172.21.15.69:0/3659962610 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f980809ace0 con 0x7f981c0ffb60 2023-12-14T18:23:39.029 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-12-14T18:23:39.030 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQArSHtlGgKAARAARrMmUWV05Z5LRgPN+kWwiQ== 2023-12-14T18:23:39.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f980c0a1260 msgr2=0x7f980c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:39.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f980c0a1260 0x7f980c0a3710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ff9c0 tx=0x7f981000a3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 msgr2=0x7f981c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c19abf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9808006010 tx=0x7f9808003a50 comp rx=0 tx=0).stop 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 shutdown_connections 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f980c0a1260 0x7f980c0a3710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f981c1004f0 0x7f981c19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f981c0fe960 0x7f981c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 --2- 172.21.15.69:0/3659962610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f981c0ffb60 0x7f981c19abf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 >> 172.21.15.69:0/3659962610 conn(0x7f981c0f9f70 msgr2=0x7f981c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:39.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 shutdown_connections 2023-12-14T18:23:39.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:39.029+0000 7f9822b3a700 1 -- 172.21.15.69:0/3659962610 wait complete. 2023-12-14T18:23:39.410 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:23:39.410 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-14T18:23:39.410 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-14T18:23:39.451 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-14T18:23:39.451 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-14T18:23:39.452 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-14T18:23:39.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:39 smithi119 ceph-mon[43973]: pgmap v225: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2023-12-14T18:23:39.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:39 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3659962610' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-14T18:23:39.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:39 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3659962610' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-14T18:23:39.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:39 smithi091 ceph-mon[43601]: pgmap v225: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2023-12-14T18:23:39.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:39 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3659962610' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-14T18:23:39.637 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:39 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3659962610' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-14T18:23:39.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:39 smithi069 ceph-mon[42047]: pgmap v225: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2023-12-14T18:23:39.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:39 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3659962610' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-14T18:23:39.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:39 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3659962610' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-14T18:23:39.799 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:40.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.811+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2817981390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f780ff470 msgr2=0x7f1f780ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.811+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2817981390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f780ff470 0x7f1f780ff840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0099c0 tx=0x7f1f6c009cd0 comp rx=0 tx=0).stop 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.811+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2817981390 shutdown_connections 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.811+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2817981390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f78104510 0x7f1f7810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.811+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2817981390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f780ff470 0x7f1f780ff840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.811+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2817981390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f780ffe10 0x7f1f78103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.812+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2817981390 >> 172.21.15.69:0/2817981390 conn(0x7f1f780770d0 msgr2=0x7f1f780774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.812+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2817981390 shutdown_connections 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.812+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2817981390 wait complete. 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.812+0000 7f1f7cd31700 1 Processor -- start 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.812+0000 7f1f7cd31700 1 -- start start 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f780ff470 0x7f1f78195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f780ffe10 0x7f1f781957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 0x7f1f78199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7819a230 con 0x7f1f78104510 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7819a3a0 con 0x7f1f780ff470 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7819a560 con 0x7f1f780ffe10 2023-12-14T18:23:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 0x7f1f78199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 0x7f1f78199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55532/0 (socket says 172.21.15.69:55532) 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 -- 172.21.15.69:0/2379704589 learned_addr learned my addr 172.21.15.69:0/2379704589 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7659c700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f780ff470 0x7f1f78195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f75d9b700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f780ffe10 0x7f1f781957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 -- 172.21.15.69:0/2379704589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f780ffe10 msgr2=0x7f1f781957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f780ffe10 0x7f1f781957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 -- 172.21.15.69:0/2379704589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f780ff470 msgr2=0x7f1f78195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f780ff470 0x7f1f78195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 -- 172.21.15.69:0/2379704589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0095f0 con 0x7f1f78104510 2023-12-14T18:23:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f76d9d700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 0x7f1f78199c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000ada0 tx=0x7f1f7000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:40.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000f070 con 0x7f1f78104510 2023-12-14T18:23:40.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f70007b30 con 0x7f1f78104510 2023-12-14T18:23:40.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70005280 con 0x7f1f78104510 2023-12-14T18:23:40.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7810f170 con 0x7f1f78104510 2023-12-14T18:23:40.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.813+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7810efe0 con 0x7f1f78104510 2023-12-14T18:23:40.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.814+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7810f300 con 0x7f1f78104510 2023-12-14T18:23:40.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.815+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1f7000c8d0 con 0x7f1f78104510 2023-12-14T18:23:40.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.816+0000 7f1f677fe700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f600a1260 0x7f1f600a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:40.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.816+0000 7f1f7659c700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f600a1260 0x7f1f600a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:40.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.816+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1f700cbdf0 con 0x7f1f78104510 2023-12-14T18:23:40.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.816+0000 7f1f7659c700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f600a1260 0x7f1f600a3710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00b580 tx=0x7f1f6c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:40.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:40.820+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1f70095620 con 0x7f1f78104510 2023-12-14T18:23:41.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.065+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1f78066ea0 con 0x7f1f78104510 2023-12-14T18:23:41.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.070+0000 7f1f677fe700 1 -- 172.21.15.69:0/2379704589 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260125 (secure 0 0 0) 0x7f1f70098c40 con 0x7f1f78104510 2023-12-14T18:23:41.076 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.072+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f600a1260 msgr2=0x7f1f600a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.072+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f600a1260 0x7f1f600a3710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00b580 tx=0x7f1f6c009f10 comp rx=0 tx=0).stop 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.072+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 msgr2=0x7f1f78199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.072+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 0x7f1f78199c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000ada0 tx=0x7f1f7000c330 comp rx=0 tx=0).stop 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 shutdown_connections 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f600a1260 0x7f1f600a3710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:41.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f78104510 0x7f1f78199c20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:41.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f780ff470 0x7f1f78195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:41.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 --2- 172.21.15.69:0/2379704589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f780ffe10 0x7f1f781957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:41.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 >> 172.21.15.69:0/2379704589 conn(0x7f1f780770d0 msgr2=0x7f1f78102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:41.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 shutdown_connections 2023-12-14T18:23:41.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:41.073+0000 7f1f7cd31700 1 -- 172.21.15.69:0/2379704589 wait complete. 2023-12-14T18:23:41.450 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":4294204545},{"type":"v1","addr":"172.21.15.69:6801","nonce":4294204545}]},"active_addr":"172.21.15.69:6801/4294204545","active_change":"2023-12-14T18:18:26.173905+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.69:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":346919526}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2894623169}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3277684028}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":1321641025}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2830172020}]}]} 2023-12-14T18:23:41.456 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-14T18:23:41.456 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-14T18:23:41.456 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-14T18:23:41.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:41 smithi119 ceph-mon[43973]: pgmap v226: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2023-12-14T18:23:41.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:41 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2379704589' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-14T18:23:41.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:41 smithi091 ceph-mon[43601]: pgmap v226: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2023-12-14T18:23:41.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:41 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2379704589' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-14T18:23:41.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:41 smithi069 ceph-mon[42047]: pgmap v226: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2023-12-14T18:23:41.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:41 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2379704589' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-14T18:23:41.769 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/3602851958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 msgr2=0x7f8d78103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/3602851958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78103dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0099c0 tx=0x7f8d6c009cd0 comp rx=0 tx=0).stop 2023-12-14T18:23:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/3602851958 shutdown_connections 2023-12-14T18:23:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/3602851958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 0x7f8d7810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/3602851958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780ff460 0x7f8d780ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/3602851958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78103dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/3602851958 >> 172.21.15.69:0/3602851958 conn(0x7f8d780770a0 msgr2=0x7f8d780774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/3602851958 shutdown_connections 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/3602851958 wait complete. 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.836+0000 7f8d7e4f5700 1 Processor -- start 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 -- start start 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780ff460 0x7f8d78196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 0x7f8d7819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819b3f0 con 0x7f8d780ffe00 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819b560 con 0x7f8d78104500 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7e4f5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819b720 con 0x7f8d780ff460 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55550/0 (socket says 172.21.15.69:55550) 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 -- 172.21.15.69:0/2414263637 learned_addr learned my addr 172.21.15.69:0/2414263637 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d77fff700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780ff460 0x7f8d78196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 -- 172.21.15.69:0/2414263637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780ff460 msgr2=0x7f8d78196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780ff460 0x7f8d78196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7ca92700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 0x7f8d7819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 -- 172.21.15.69:0/2414263637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 msgr2=0x7f8d7819ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 0x7f8d7819ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d777fe700 1 -- 172.21.15.69:0/2414263637 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0095f0 con 0x7f8d780ffe00 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.837+0000 7f8d7ca92700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 0x7f8d7819ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.838+0000 7f8d777fe700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78196970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c006010 tx=0x7f8d6c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.838+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c01d070 con 0x7f8d780ffe00 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.838+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7810f1c0 con 0x7f8d780ffe00 2023-12-14T18:23:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.838+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d6c0047e0 con 0x7f8d780ffe00 2023-12-14T18:23:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.838+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c005320 con 0x7f8d780ffe00 2023-12-14T18:23:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.838+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7810f030 con 0x7f8d780ffe00 2023-12-14T18:23:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.839+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7810f350 con 0x7f8d780ffe00 2023-12-14T18:23:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.840+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8d6c004950 con 0x7f8d780ffe00 2023-12-14T18:23:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.841+0000 7f8d757fa700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8d600a11e0 0x7f8d600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.841+0000 7f8d77fff700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8d600a11e0 0x7f8d600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.841+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8d6c0cdee0 con 0x7f8d780ffe00 2023-12-14T18:23:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.841+0000 7f8d77fff700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8d600a11e0 0x7f8d600a3690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d68006fd0 tx=0x7f8d68008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:42.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:42.844+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8d6c097610 con 0x7f8d780ffe00 2023-12-14T18:23:43.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.038+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d78066ea0 con 0x7f8d780ffe00 2023-12-14T18:23:43.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.040+0000 7f8d757fa700 1 -- 172.21.15.69:0/2414263637 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22082 (secure 0 0 0) 0x7f8d6c09ac30 con 0x7f8d780ffe00 2023-12-14T18:23:43.042 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:43.042 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:30.294739+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:43.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8d600a11e0 msgr2=0x7f8d600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:43.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8d600a11e0 0x7f8d600a3690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d68006fd0 tx=0x7f8d68008040 comp rx=0 tx=0).stop 2023-12-14T18:23:43.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 msgr2=0x7f8d78196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:43.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78196970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c006010 tx=0x7f8d6c003820 comp rx=0 tx=0).stop 2023-12-14T18:23:43.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 shutdown_connections 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8d600a11e0 0x7f8d600a3690 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d78104500 0x7f8d7819ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d780ff460 0x7f8d78196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 --2- 172.21.15.69:0/2414263637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d780ffe00 0x7f8d78196970 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 >> 172.21.15.69:0/2414263637 conn(0x7f8d780770a0 msgr2=0x7f8d78068770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 shutdown_connections 2023-12-14T18:23:43.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:43.042+0000 7f8d7e4f5700 1 -- 172.21.15.69:0/2414263637 wait complete. 2023-12-14T18:23:43.425 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-14T18:23:43.426 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-14T18:23:43.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:43 smithi119 ceph-mon[43973]: pgmap v227: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2023-12-14T18:23:43.625 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:43 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2414263637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:43.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:43 smithi091 ceph-mon[43601]: pgmap v227: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2023-12-14T18:23:43.636 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:43 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2414263637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:43.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:43 smithi069 ceph-mon[42047]: pgmap v227: 97 pgs: 97 active+clean; 616 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2023-12-14T18:23:43.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:43 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2414263637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:43.737 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 -- 172.21.15.69:0/2537169491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 msgr2=0x7f1550106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 --2- 172.21.15.69:0/2537169491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f1550106740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f154c009990 tx=0x7f154c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 -- 172.21.15.69:0/2537169491 shutdown_connections 2023-12-14T18:23:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 --2- 172.21.15.69:0/2537169491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1550100e40 0x7f155010d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 --2- 172.21.15.69:0/2537169491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f1550106740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 --2- 172.21.15.69:0/2537169491 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1550100490 0x7f1550100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.703+0000 7f155781c700 1 -- 172.21.15.69:0/2537169491 >> 172.21.15.69:0/2537169491 conn(0x7f1550078430 msgr2=0x7f1550078830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.704+0000 7f155781c700 1 -- 172.21.15.69:0/2537169491 shutdown_connections 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.704+0000 7f155781c700 1 -- 172.21.15.69:0/2537169491 wait complete. 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.704+0000 7f155781c700 1 Processor -- start 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.704+0000 7f155781c700 1 -- start start 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f155781c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1550100490 0x7f15501962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f155781c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1550100e40 0x7f1550196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:44.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f155781c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f155019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f155781c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155019b2a0 con 0x7f1550106370 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f155781c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155019b410 con 0x7f1550100490 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f155781c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155019b5d0 con 0x7f1550100e40 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f155019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f155019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55568/0 (socket says 172.21.15.69:55568) 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 -- 172.21.15.69:0/3100209389 learned_addr learned my addr 172.21.15.69:0/3100209389 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f15555b8700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1550100490 0x7f15501962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1554db7700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1550100e40 0x7f1550196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:44.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 -- 172.21.15.69:0/3100209389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1550100e40 msgr2=0x7f1550196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1550100e40 0x7f1550196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 -- 172.21.15.69:0/3100209389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1550100490 msgr2=0x7f15501962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1550100490 0x7f15501962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 -- 172.21.15.69:0/3100209389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0095f0 con 0x7f1550106370 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f1555db9700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f155019ac90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1548007f10 tx=0x7f154800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.705+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548017070 con 0x7f1550106370 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.706+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1550110230 con 0x7f1550106370 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.706+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f154800f040 con 0x7f1550106370 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.706+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548005570 con 0x7f1550106370 2023-12-14T18:23:44.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.706+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15501100a0 con 0x7f1550106370 2023-12-14T18:23:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.706+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15501103c0 con 0x7f1550106370 2023-12-14T18:23:44.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.707+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f154800db20 con 0x7f1550106370 2023-12-14T18:23:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.708+0000 7f15467fc700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f153c0a11e0 0x7f153c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.708+0000 7f15555b8700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f153c0a11e0 0x7f153c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.708+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f15480cbfd0 con 0x7f1550106370 2023-12-14T18:23:44.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.708+0000 7f15555b8700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f153c0a11e0 0x7f153c0a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f154c00b5c0 tx=0x7f154c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:44.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.713+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1548095770 con 0x7f1550106370 2023-12-14T18:23:44.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.903+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1550066ea0 con 0x7f1550106370 2023-12-14T18:23:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.905+0000 7f15467fc700 1 -- 172.21.15.69:0/3100209389 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22082 (secure 0 0 0) 0x7f1548098d90 con 0x7f1550106370 2023-12-14T18:23:44.907 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:23:44.908 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:30.294739+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:23:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f153c0a11e0 msgr2=0x7f153c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f153c0a11e0 0x7f153c0a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f154c00b5c0 tx=0x7f154c005fb0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 msgr2=0x7f155019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f155019ac90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1548007f10 tx=0x7f154800d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 shutdown_connections 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f153c0a11e0 0x7f153c0a3690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1550106370 0x7f155019ac90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1550100490 0x7f15501962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 --2- 172.21.15.69:0/3100209389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1550100e40 0x7f1550196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 >> 172.21.15.69:0/3100209389 conn(0x7f1550078430 msgr2=0x7f15500fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 shutdown_connections 2023-12-14T18:23:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:44.907+0000 7f155781c700 1 -- 172.21.15.69:0/3100209389 wait complete. 2023-12-14T18:23:45.276 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-14T18:23:45.276 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-14T18:23:45.277 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-14T18:23:45.278 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-14T18:23:45.278 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-14T18:23:45.279 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-14T18:23:45.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2023-12-14T18:23:45.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2023-12-14T18:23:45.281 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2023-12-14T18:23:45.282 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2023-12-14T18:23:45.282 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2023-12-14T18:23:45.283 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2023-12-14T18:23:45.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:45 smithi069 ceph-mon[42047]: pgmap v228: 97 pgs: 97 active+clean; 621 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 KiB/s wr, 16 op/s 2023-12-14T18:23:45.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:45 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3100209389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:45 smithi119 ceph-mon[43973]: pgmap v228: 97 pgs: 97 active+clean; 621 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 KiB/s wr, 16 op/s 2023-12-14T18:23:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:45 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3100209389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:45.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:45 smithi091 ceph-mon[43601]: pgmap v228: 97 pgs: 97 active+clean; 621 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 KiB/s wr, 16 op/s 2023-12-14T18:23:45.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:45 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3100209389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:23:46.066 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:46.161 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:46.717 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:47.220 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:47.648 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:47 smithi069 ceph-mon[42047]: pgmap v229: 97 pgs: 97 active+clean; 621 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2023-12-14T18:23:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:47 smithi119 ceph-mon[43973]: pgmap v229: 97 pgs: 97 active+clean; 621 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2023-12-14T18:23:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:47 smithi091 ceph-mon[43601]: pgmap v229: 97 pgs: 97 active+clean; 621 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2023-12-14T18:23:48.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 -- 172.21.15.69:0/2020685125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 msgr2=0x7f3db4101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 --2- 172.21.15.69:0/2020685125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db4101760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009990 tx=0x7f3da4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 -- 172.21.15.69:0/2020685125 shutdown_connections 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 --2- 172.21.15.69:0/2020685125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3db410a8b0 0x7f3db410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 --2- 172.21.15.69:0/2020685125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db4101760 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 --2- 172.21.15.69:0/2020685125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db4101ca0 0x7f3db410a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 -- 172.21.15.69:0/2020685125 >> 172.21.15.69:0/2020685125 conn(0x7f3db40770a0 msgr2=0x7f3db40774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.082+0000 7f3dba461700 1 -- 172.21.15.69:0/2020685125 shutdown_connections 2023-12-14T18:23:48.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 -- 172.21.15.69:0/2020685125 wait complete. 2023-12-14T18:23:48.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 Processor -- start 2023-12-14T18:23:48.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 -- start start 2023-12-14T18:23:48.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db40ff1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db4101ca0 0x7f3db40ff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3db410a8b0 0x7f3db40ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db41a4890 con 0x7f3db4101390 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db41a4a00 con 0x7f3db410a8b0 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.083+0000 7f3dba461700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db41a4bc0 con 0x7f3db4101ca0 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db40ff1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db40ff1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57284/0 (socket says 172.21.15.69:57284) 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 -- 172.21.15.69:0/3427933998 learned_addr learned my addr 172.21.15.69:0/3427933998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db37fe700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db4101ca0 0x7f3db40ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db89fe700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3db410a8b0 0x7f3db40ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 -- 172.21.15.69:0/3427933998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db4101ca0 msgr2=0x7f3db40ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db4101ca0 0x7f3db40ff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 -- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3db410a8b0 msgr2=0x7f3db40ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3db410a8b0 0x7f3db40ffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 -- 172.21.15.69:0/3427933998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40095f0 con 0x7f3db4101390 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db3fff700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db40ff1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da401d070 con 0x7f3db4101390 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3da4004130 con 0x7f3db4101390 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db4110250 con 0x7f3db4101390 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4022e90 con 0x7f3db4101390 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.084+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db41100c0 con 0x7f3db4101390 2023-12-14T18:23:48.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.085+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3db40fc6c0 con 0x7f3db4101390 2023-12-14T18:23:48.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.086+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3da4003ca0 con 0x7f3db4101390 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db17fa700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3d9c0a11e0 0x7f3d9c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db37fe700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3d9c0a11e0 0x7f3d9c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3da40ce4c0 con 0x7f3db4101390 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db17fa700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] conn(0x7f3d9c0aa840 0x7f3d9c0acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 --> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d9c0ad300 con 0x7f3d9c0aa840 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3da40ce960 con 0x7f3db4101390 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db37fe700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3d9c0a11e0 0x7f3d9c0a3690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3db41009b0 tx=0x7f3da8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.087+0000 7f3db89fe700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] conn(0x7f3d9c0aa840 0x7f3d9c0acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.088+0000 7f3db89fe700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] conn(0x7f3d9c0aa840 0x7f3d9c0acc50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.088+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== osd.10 v2:172.21.15.91:6824/687412463 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d9c0ad300 con 0x7f3d9c0aa840 2023-12-14T18:23:48.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.104+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 --> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3db41103e0 con 0x7f3d9c0aa840 2023-12-14T18:23:48.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3db17fa700 1 -- 172.21.15.69:0/3427933998 <== osd.10 v2:172.21.15.91:6824/687412463 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3db41103e0 con 0x7f3d9c0aa840 2023-12-14T18:23:48.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] conn(0x7f3d9c0aa840 msgr2=0x7f3d9c0acc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] conn(0x7f3d9c0aa840 0x7f3d9c0acc50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3d9c0a11e0 msgr2=0x7f3d9c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3d9c0a11e0 0x7f3d9c0a3690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3db41009b0 tx=0x7f3da8009190 comp rx=0 tx=0).stop 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 msgr2=0x7f3db40ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 --2- 172.21.15.69:0/3427933998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4101390 0x7f3db40ff1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da40047b0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3db89fe700 1 -- 172.21.15.69:0/3427933998 reap_dead start 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 shutdown_connections 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 >> 172.21.15.69:0/3427933998 conn(0x7f3db40770a0 msgr2=0x7f3db40fbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 shutdown_connections 2023-12-14T18:23:48.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.105+0000 7f3dba461700 1 -- 172.21.15.69:0/3427933998 wait complete. 2023-12-14T18:23:48.405 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:48.505 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:48.650 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:48.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 -- 172.21.15.69:0/2798946090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 msgr2=0x7f8e6010d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 --2- 172.21.15.69:0/2798946090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6010d180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800b0d0 tx=0x7f8e5800b3e0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 -- 172.21.15.69:0/2798946090 shutdown_connections 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 --2- 172.21.15.69:0/2798946090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6010d180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 --2- 172.21.15.69:0/2798946090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e60100560 0x7f8e60100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 --2- 172.21.15.69:0/2798946090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e60100f00 0x7f8e60104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 -- 172.21.15.69:0/2798946090 >> 172.21.15.69:0/2798946090 conn(0x7f8e600fbde0 msgr2=0x7f8e600fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 -- 172.21.15.69:0/2798946090 shutdown_connections 2023-12-14T18:23:48.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.712+0000 7f8e6503a700 1 -- 172.21.15.69:0/2798946090 wait complete. 2023-12-14T18:23:48.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.713+0000 7f8e6503a700 1 Processor -- start 2023-12-14T18:23:48.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.713+0000 7f8e6503a700 1 -- start start 2023-12-14T18:23:48.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e6503a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e60100560 0x7f8e60196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e6503a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e60100f00 0x7f8e60196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e6503a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e6503a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6019b3f0 con 0x7f8e60105600 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e6503a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6019b560 con 0x7f8e60100560 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e6503a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6019b720 con 0x7f8e60100f00 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57302/0 (socket says 172.21.15.69:57302) 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 -- 172.21.15.69:0/937572134 learned_addr learned my addr 172.21.15.69:0/937572134 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5e59c700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e60100f00 0x7f8e60196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5ed9d700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e60100560 0x7f8e60196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 -- 172.21.15.69:0/937572134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e60100f00 msgr2=0x7f8e60196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e60100f00 0x7f8e60196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 -- 172.21.15.69:0/937572134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e60100560 msgr2=0x7f8e60196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e60100560 0x7f8e60196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 -- 172.21.15.69:0/937572134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58009d00 con 0x7f8e60105600 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5ed9d700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e60100560 0x7f8e60196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5e59c700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e60100f00 0x7f8e60196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.714+0000 7f8e5f59e700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6019ade0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009380 tx=0x7f8e58009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.715+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800e040 con 0x7f8e60105600 2023-12-14T18:23:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.715+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e58003e10 con 0x7f8e60105600 2023-12-14T18:23:48.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.715+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e60110280 con 0x7f8e60105600 2023-12-14T18:23:48.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.715+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58012a80 con 0x7f8e60105600 2023-12-14T18:23:48.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.715+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e601100f0 con 0x7f8e60105600 2023-12-14T18:23:48.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.715+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e600fd220 con 0x7f8e60105600 2023-12-14T18:23:48.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8e58012be0 con 0x7f8e60105600 2023-12-14T18:23:48.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e47fff700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8e480a11e0 0x7f8e480a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e580ce5f0 con 0x7f8e60105600 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e5ed9d700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8e480a11e0 0x7f8e480a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e47fff700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] conn(0x7f8e480aa9b0 0x7f8e480acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 --> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e480ad470 con 0x7f8e480aa9b0 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.718+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e580cea90 con 0x7f8e60105600 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.719+0000 7f8e5e59c700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] conn(0x7f8e480aa9b0 0x7f8e480acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.719+0000 7f8e5ed9d700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8e480a11e0 0x7f8e480a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005fd0 tx=0x7f8e50005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.719+0000 7f8e5e59c700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] conn(0x7f8e480aa9b0 0x7f8e480acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.720+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== osd.6 v2:172.21.15.69:6818/2145059445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8e480ad470 con 0x7f8e480aa9b0 2023-12-14T18:23:48.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 --> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e6019bc60 con 0x7f8e480aa9b0 2023-12-14T18:23:48.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e47fff700 1 -- 172.21.15.69:0/937572134 <== osd.6 v2:172.21.15.69:6818/2145059445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8e6019bc60 con 0x7f8e480aa9b0 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] conn(0x7f8e480aa9b0 msgr2=0x7f8e480acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] conn(0x7f8e480aa9b0 0x7f8e480acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8e480a11e0 msgr2=0x7f8e480a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8e480a11e0 0x7f8e480a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005fd0 tx=0x7f8e50005ee0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 msgr2=0x7f8e6019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 --2- 172.21.15.69:0/937572134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e60105600 0x7f8e6019ade0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009380 tx=0x7f8e58009460 comp rx=0 tx=0).stop 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e5f59e700 1 -- 172.21.15.69:0/937572134 reap_dead start 2023-12-14T18:23:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 shutdown_connections 2023-12-14T18:23:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.737+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 >> 172.21.15.69:0/937572134 conn(0x7f8e600fbde0 msgr2=0x7f8e600fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.738+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 shutdown_connections 2023-12-14T18:23:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.738+0000 7f8e6503a700 1 -- 172.21.15.69:0/937572134 wait complete. 2023-12-14T18:23:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 -- 172.21.15.69:0/307074484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 msgr2=0x7f8bc0100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 --2- 172.21.15.69:0/307074484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc0100930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40099c0 tx=0x7f8bb4009cd0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 -- 172.21.15.69:0/307074484 shutdown_connections 2023-12-14T18:23:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 --2- 172.21.15.69:0/307074484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bc0105600 0x7f8bc010d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 --2- 172.21.15.69:0/307074484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc0100930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 --2- 172.21.15.69:0/307074484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bc0100f00 0x7f8bc0104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.823+0000 7f8bc7177700 1 -- 172.21.15.69:0/307074484 >> 172.21.15.69:0/307074484 conn(0x7f8bc00fbde0 msgr2=0x7f8bc00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 -- 172.21.15.69:0/307074484 shutdown_connections 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 -- 172.21.15.69:0/307074484 wait complete. 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 Processor -- start 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 -- start start 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bc0100f00 0x7f8bc0196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bc0105600 0x7f8bc019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc019b280 con 0x7f8bc0100560 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc019b3f0 con 0x7f8bc0100f00 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc7177700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc019b5b0 con 0x7f8bc0105600 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.824+0000 7f8bc4f13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc01962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57322/0 (socket says 172.21.15.69:57322) 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 -- 172.21.15.69:0/3956135320 learned_addr learned my addr 172.21.15.69:0/3956135320 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bbffff700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bc0100f00 0x7f8bc0196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc5714700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bc0105600 0x7f8bc019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 -- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bc0105600 msgr2=0x7f8bc019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bc0105600 0x7f8bc019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 -- 172.21.15.69:0/3956135320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bc0100f00 msgr2=0x7f8bc0196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bc0100f00 0x7f8bc0196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 -- 172.21.15.69:0/3956135320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40095f0 con 0x7f8bc0100560 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bbffff700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bc0100f00 0x7f8bc0196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc4f13700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc01962c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005910 tx=0x7f8bb4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb401d070 con 0x7f8bc0100560 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bb400fbf0 con 0x7f8bc0100560 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc01101f0 con 0x7f8bc0100560 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40173f0 con 0x7f8bc0100560 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.825+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0110060 con 0x7f8bc0100560 2023-12-14T18:23:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.826+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bc00fd2f0 con 0x7f8bc0100560 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.827+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8bb4022470 con 0x7f8bc0100560 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbdffb700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8bb00a11e0 0x7f8bb00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbffff700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8bb00a11e0 0x7f8bb00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8bb40ce090 con 0x7f8bc0100560 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbdffb700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] conn(0x7f8bb00aa9b0 0x7f8bb00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 --> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bb00ad470 con 0x7f8bb00aa9b0 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bb40ce400 con 0x7f8bc0100560 2023-12-14T18:23:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.828+0000 7f8bbffff700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8bb00a11e0 0x7f8bb00a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8bc01978e0 tx=0x7f8bac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.829+0000 7f8bc5714700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] conn(0x7f8bb00aa9b0 0x7f8bb00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:48.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.829+0000 7f8bc5714700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] conn(0x7f8bb00aa9b0 0x7f8bb00acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:48.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.830+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== osd.2 v2:172.21.15.119:6800/1861543624 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8bb00ad470 con 0x7f8bb00aa9b0 2023-12-14T18:23:48.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.846+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 --> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8bc0110380 con 0x7f8bb00aa9b0 2023-12-14T18:23:48.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.846+0000 7f8bbdffb700 1 -- 172.21.15.69:0/3956135320 <== osd.2 v2:172.21.15.119:6800/1861543624 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8bc0110380 con 0x7f8bb00aa9b0 2023-12-14T18:23:48.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.846+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] conn(0x7f8bb00aa9b0 msgr2=0x7f8bb00acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] conn(0x7f8bb00aa9b0 0x7f8bb00acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:48.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8bb00a11e0 msgr2=0x7f8bb00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8bb00a11e0 0x7f8bb00a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8bc01978e0 tx=0x7f8bac009260 comp rx=0 tx=0).stop 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 msgr2=0x7f8bc01962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 --2- 172.21.15.69:0/3956135320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bc0100560 0x7f8bc01962c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005910 tx=0x7f8bb4009580 comp rx=0 tx=0).stop 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc5714700 1 -- 172.21.15.69:0/3956135320 reap_dead start 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 shutdown_connections 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 >> 172.21.15.69:0/3956135320 conn(0x7f8bc00fbde0 msgr2=0x7f8bc00fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 shutdown_connections 2023-12-14T18:23:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:48.847+0000 7f8bc7177700 1 -- 172.21.15.69:0/3956135320 wait complete. 2023-12-14T18:23:49.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:49 smithi069 ceph-mon[42047]: pgmap v230: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2023-12-14T18:23:49.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:49 smithi119 ceph-mon[43973]: pgmap v230: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2023-12-14T18:23:49.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:49 smithi091 ceph-mon[43601]: pgmap v230: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2023-12-14T18:23:50.190 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:50.425 INFO:teuthology.orchestra.run.smithi069.stdout:287762808849 2023-12-14T18:23:50.425 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.10 2023-12-14T18:23:51.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:51 smithi069 ceph-mon[42047]: pgmap v231: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-12-14T18:23:51.532 INFO:teuthology.orchestra.run.smithi069.stdout:184683593760 2023-12-14T18:23:51.533 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.6 2023-12-14T18:23:51.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:51 smithi119 ceph-mon[43973]: pgmap v231: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-12-14T18:23:51.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:51 smithi091 ceph-mon[43601]: pgmap v231: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 -- 172.21.15.69:0/142213783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 msgr2=0x7fa7f4100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 --2- 172.21.15.69:0/142213783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f4100910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0099c0 tx=0x7fa7dc009cd0 comp rx=0 tx=0).stop 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 -- 172.21.15.69:0/142213783 shutdown_connections 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 --2- 172.21.15.69:0/142213783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7f41055e0 0x7fa7f410d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 --2- 172.21.15.69:0/142213783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f4100910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 --2- 172.21.15.69:0/142213783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f4100ee0 0x7fa7f4104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 -- 172.21.15.69:0/142213783 >> 172.21.15.69:0/142213783 conn(0x7fa7f40fbdc0 msgr2=0x7fa7f40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:51.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 -- 172.21.15.69:0/142213783 shutdown_connections 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.980+0000 7fa7f990f700 1 -- 172.21.15.69:0/142213783 wait complete. 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 Processor -- start 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 -- start start 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f41963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7f4100ee0 0x7fa7f4196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f41055e0 0x7fa7f419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f419b3b0 con 0x7fa7f4100540 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f419b520 con 0x7fa7f4100ee0 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f990f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f419b6e0 con 0x7fa7f41055e0 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f41963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f41963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57340/0 (socket says 172.21.15.69:57340) 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/1076792014 learned_addr learned my addr 172.21.15.69:0/1076792014 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f27fc700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7f4100ee0 0x7fa7f4196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.981+0000 7fa7f37fe700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f41055e0 0x7fa7f419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:51.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/1076792014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f41055e0 msgr2=0x7fa7f419ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f2ffd700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f41055e0 0x7fa7f419ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/1076792014 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7f4100ee0 msgr2=0x7fa7f4196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f2ffd700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7f4100ee0 0x7fa7f4196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f2ffd700 1 -- 172.21.15.69:0/1076792014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc0095f0 con 0x7fa7f4100540 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f2ffd700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f41963f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009990 tx=0x7fa7dc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc01d070 con 0x7fa7f4100540 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f41101d0 con 0x7fa7f4100540 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7dc004160 con 0x7fa7f4100540 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc022dd0 con 0x7fa7f4100540 2023-12-14T18:23:51.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.982+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f4110040 con 0x7fa7f4100540 2023-12-14T18:23:51.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.983+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7f41048c0 con 0x7fa7f4100540 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.984+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa7dc022570 con 0x7fa7f4100540 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.984+0000 7fa7f890d700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7e00a11e0 0x7fa7e00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f27fc700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7e00a11e0 0x7fa7e00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7dc0ce2a0 con 0x7fa7f4100540 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f890d700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] conn(0x7fa7e00aa9b0 0x7fa7e00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 --> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7e00ad470 con 0x7fa7e00aa9b0 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7dc0ce740 con 0x7fa7f4100540 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f37fe700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] conn(0x7fa7e00aa9b0 0x7fa7e00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f27fc700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7e00a11e0 0x7fa7e00a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4197a10 tx=0x7fa7e400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.985+0000 7fa7f37fe700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] conn(0x7fa7e00aa9b0 0x7fa7e00acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:51.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:51.986+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== osd.3 v2:172.21.15.69:6810/3948335762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa7e00ad470 con 0x7fa7e00aa9b0 2023-12-14T18:23:52.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.002+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 --> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7f4110360 con 0x7fa7e00aa9b0 2023-12-14T18:23:52.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f890d700 1 -- 172.21.15.69:0/1076792014 <== osd.3 v2:172.21.15.69:6810/3948335762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa7f4110360 con 0x7fa7e00aa9b0 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] conn(0x7fa7e00aa9b0 msgr2=0x7fa7e00acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] conn(0x7fa7e00aa9b0 0x7fa7e00acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7e00a11e0 msgr2=0x7fa7e00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7e00a11e0 0x7fa7e00a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4197a10 tx=0x7fa7e400a300 comp rx=0 tx=0).stop 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 msgr2=0x7fa7f41963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 --2- 172.21.15.69:0/1076792014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7f4100540 0x7fa7f41963f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009990 tx=0x7fa7dc003820 comp rx=0 tx=0).stop 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f37fe700 1 -- 172.21.15.69:0/1076792014 reap_dead start 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 shutdown_connections 2023-12-14T18:23:52.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 >> 172.21.15.69:0/1076792014 conn(0x7fa7f40fbdc0 msgr2=0x7fa7f4103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:52.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 shutdown_connections 2023-12-14T18:23:52.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.003+0000 7fa7f990f700 1 -- 172.21.15.69:0/1076792014 wait complete. 2023-12-14T18:23:52.106 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 -- 172.21.15.69:0/3700408326 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec80fe830 msgr2=0x7f6ec80feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/3700408326 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec80fe830 0x7f6ec80feca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009990 tx=0x7f6eb8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 -- 172.21.15.69:0/3700408326 shutdown_connections 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/3700408326 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ec80ff1e0 0x7f6ec810d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/3700408326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec8105290 0x7f6ec8105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/3700408326 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec80fe830 0x7f6ec80feca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 -- 172.21.15.69:0/3700408326 >> 172.21.15.69:0/3700408326 conn(0x7f6ec80758a0 msgr2=0x7f6ec8075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:52.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 -- 172.21.15.69:0/3700408326 shutdown_connections 2023-12-14T18:23:52.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 -- 172.21.15.69:0/3700408326 wait complete. 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 Processor -- start 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.206+0000 7f6ecf57b700 1 -- start start 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecf57b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ec80fe830 0x7f6ec80ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecf57b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec80ff1e0 0x7f6ec80fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecf57b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec8105290 0x7f6ec81004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecf57b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81a4880 con 0x7f6ec8105290 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecf57b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81a49f0 con 0x7f6ec80fe830 2023-12-14T18:23:52.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecf57b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81a4bb0 con 0x7f6ec80ff1e0 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec8105290 0x7f6ec81004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec8105290 0x7f6ec81004d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57354/0 (socket says 172.21.15.69:57354) 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 -- 172.21.15.69:0/185400259 learned_addr learned my addr 172.21.15.69:0/185400259 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecd317700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ec80fe830 0x7f6ec80ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6eccb16700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec80ff1e0 0x7f6ec80fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 -- 172.21.15.69:0/185400259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec80ff1e0 msgr2=0x7f6ec80fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec80ff1e0 0x7f6ec80fff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 -- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ec80fe830 msgr2=0x7f6ec80ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ec80fe830 0x7f6ec80ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 -- 172.21.15.69:0/185400259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80095f0 con 0x7f6ec8105290 2023-12-14T18:23:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.207+0000 7f6ecdb18700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec8105290 0x7f6ec81004d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0007ee0 tx=0x7f6ec000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.208+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0017070 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.208+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ec000f040 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.208+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec81102c0 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.208+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0005570 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.208+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8110130 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.209+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ec80fdae0 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.210+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6ec000db20 con 0x7f6ec8105290 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.210+0000 7f6ebe7fc700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6eb40a1260 0x7f6eb40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.210+0000 7f6ecd317700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6eb40a1260 0x7f6eb40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.210+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6ec00cc6b0 con 0x7f6ec8105290 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.211+0000 7f6ebe7fc700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] conn(0x7f6eb40aaa30 0x7f6eb40ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.211+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 --> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6eb40ad4f0 con 0x7f6eb40aaa30 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.211+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ec00ccb50 con 0x7f6ec8105290 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.211+0000 7f6ecd317700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6eb40a1260 0x7f6eb40a3710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4005950 tx=0x7f6ec400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.211+0000 7f6eccb16700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] conn(0x7f6eb40aaa30 0x7f6eb40ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.211+0000 7f6eccb16700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] conn(0x7f6eb40aaa30 0x7f6eb40ace40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:52.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.212+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== osd.7 v2:172.21.15.91:6816/3612368750 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6eb40ad4f0 con 0x7f6eb40aaa30 2023-12-14T18:23:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.228+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 --> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ec8110450 con 0x7f6eb40aaa30 2023-12-14T18:23:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ebe7fc700 1 -- 172.21.15.69:0/185400259 <== osd.7 v2:172.21.15.91:6816/3612368750 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6ec8110450 con 0x7f6eb40aaa30 2023-12-14T18:23:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] conn(0x7f6eb40aaa30 msgr2=0x7f6eb40ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] conn(0x7f6eb40aaa30 0x7f6eb40ace40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6eb40a1260 msgr2=0x7f6eb40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6eb40a1260 0x7f6eb40a3710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4005950 tx=0x7f6ec400b410 comp rx=0 tx=0).stop 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec8105290 msgr2=0x7f6ec81004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.229+0000 7f6ecf57b700 1 --2- 172.21.15.69:0/185400259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ec8105290 0x7f6ec81004d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0007ee0 tx=0x7f6ec000d3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.230+0000 7f6ecdb18700 1 -- 172.21.15.69:0/185400259 reap_dead start 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.230+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 shutdown_connections 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.230+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 >> 172.21.15.69:0/185400259 conn(0x7f6ec80758a0 msgr2=0x7f6ec80fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.230+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 shutdown_connections 2023-12-14T18:23:52.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.230+0000 7f6ecf57b700 1 -- 172.21.15.69:0/185400259 wait complete. 2023-12-14T18:23:52.262 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:52.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 -- 172.21.15.69:0/4157018415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb40ffa50 msgr2=0x7efcb410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 --2- 172.21.15.69:0/4157018415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb40ffa50 0x7efcb410c7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efca80098f0 tx=0x7efca8009c00 comp rx=0 tx=0).stop 2023-12-14T18:23:52.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 -- 172.21.15.69:0/4157018415 shutdown_connections 2023-12-14T18:23:52.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 --2- 172.21.15.69:0/4157018415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb410ccf0 0x7efcb410f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 --2- 172.21.15.69:0/4157018415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcb40ff140 0x7efcb40ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 --2- 172.21.15.69:0/4157018415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb40ffa50 0x7efcb410c7b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 -- 172.21.15.69:0/4157018415 >> 172.21.15.69:0/4157018415 conn(0x7efcb40770d0 msgr2=0x7efcb40774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:52.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 -- 172.21.15.69:0/4157018415 shutdown_connections 2023-12-14T18:23:52.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.570+0000 7efcba582700 1 -- 172.21.15.69:0/4157018415 wait complete. 2023-12-14T18:23:52.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 Processor -- start 2023-12-14T18:23:52.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 -- start start 2023-12-14T18:23:52.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb40ff140 0x7efcb4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcb40ffa50 0x7efcb4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb410ccf0 0x7efcb419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb419d4d0 con 0x7efcb40ff140 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb419d640 con 0x7efcb410ccf0 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.571+0000 7efcba582700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb419d800 con 0x7efcb40ffa50 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb40ff140 0x7efcb4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb40ff140 0x7efcb4198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57384/0 (socket says 172.21.15.69:57384) 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 -- 172.21.15.69:0/1700632610 learned_addr learned my addr 172.21.15.69:0/1700632610 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb37fe700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcb40ffa50 0x7efcb4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb8b1f700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb410ccf0 0x7efcb419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 -- 172.21.15.69:0/1700632610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcb40ffa50 msgr2=0x7efcb4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcb40ffa50 0x7efcb4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 -- 172.21.15.69:0/1700632610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb410ccf0 msgr2=0x7efcb419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb410ccf0 0x7efcb419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 -- 172.21.15.69:0/1700632610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac009d00 con 0x7efcb40ff140 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb8b1f700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efcb410ccf0 0x7efcb419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb37fe700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcb40ffa50 0x7efcb4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb3fff700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb40ff140 0x7efcb4198510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efca400e9a0 tx=0x7efca400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4009790 con 0x7efcb40ff140 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8009520 con 0x7efcb40ff140 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efca400cbd0 con 0x7efcb40ff140 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4018680 con 0x7efcb40ff140 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.572+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb4112400 con 0x7efcb40ff140 2023-12-14T18:23:52.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.573+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcb410eaa0 con 0x7efcb40ff140 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.575+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efca400cd40 con 0x7efcb40ff140 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.575+0000 7efcb17fa700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efc9c0a11e0 0x7efc9c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb37fe700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efc9c0a11e0 0x7efc9c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efca4014070 con 0x7efcb40ff140 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb17fa700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] conn(0x7efc9c0aa9b0 0x7efc9c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 --> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc9c0ad470 con 0x7efc9c0aa9b0 2023-12-14T18:23:52.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca40cd300 con 0x7efcb40ff140 2023-12-14T18:23:52.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb8b1f700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] conn(0x7efc9c0aa9b0 0x7efc9c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:52.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb37fe700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efc9c0a11e0 0x7efc9c0a3690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efca8009fd0 tx=0x7efca8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:52.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.576+0000 7efcb8b1f700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] conn(0x7efc9c0aa9b0 0x7efc9c0acdc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:52.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.577+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== osd.9 v2:172.21.15.69:6826/242196071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efc9c0ad470 con 0x7efc9c0aa9b0 2023-12-14T18:23:52.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.594+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 --> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcb4112270 con 0x7efc9c0aa9b0 2023-12-14T18:23:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcb17fa700 1 -- 172.21.15.69:0/1700632610 <== osd.9 v2:172.21.15.69:6826/242196071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efcb4112270 con 0x7efc9c0aa9b0 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] conn(0x7efc9c0aa9b0 msgr2=0x7efc9c0acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] conn(0x7efc9c0aa9b0 0x7efc9c0acdc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efc9c0a11e0 msgr2=0x7efc9c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efc9c0a11e0 0x7efc9c0a3690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efca8009fd0 tx=0x7efca8019040 comp rx=0 tx=0).stop 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb40ff140 msgr2=0x7efcb4198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 --2- 172.21.15.69:0/1700632610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcb40ff140 0x7efcb4198510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efca400e9a0 tx=0x7efca400ed60 comp rx=0 tx=0).stop 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcb8b1f700 1 -- 172.21.15.69:0/1700632610 reap_dead start 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 shutdown_connections 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 >> 172.21.15.69:0/1700632610 conn(0x7efcb40770d0 msgr2=0x7efcb410e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 shutdown_connections 2023-12-14T18:23:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.595+0000 7efcba582700 1 -- 172.21.15.69:0/1700632610 wait complete. 2023-12-14T18:23:53.138 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:53.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:53 smithi069 ceph-mon[42047]: pgmap v232: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2023-12-14T18:23:53.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 -- 172.21.15.69:0/357407981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 msgr2=0x7f6ae010c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/357407981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae010c740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009990 tx=0x7f6ad4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 -- 172.21.15.69:0/357407981 shutdown_connections 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/357407981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae010cc80 0x7f6ae010f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/357407981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae00ff0d0 0x7f6ae00ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/357407981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae010c740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 -- 172.21.15.69:0/357407981 >> 172.21.15.69:0/357407981 conn(0x7f6ae00770a0 msgr2=0x7f6ae00774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 -- 172.21.15.69:0/357407981 shutdown_connections 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 -- 172.21.15.69:0/357407981 wait complete. 2023-12-14T18:23:53.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.534+0000 7f6ae4dde700 1 Processor -- start 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 -- start start 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae00ff0d0 0x7f6ae01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae010cc80 0x7f6ae019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae019d560 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae019d6d0 con 0x7f6ae00ff0d0 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ae4dde700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae019d890 con 0x7f6ae010cc80 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:53.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae0198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57372/0 (socket says 172.21.15.69:57372) 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 -- 172.21.15.69:0/2324711379 learned_addr learned my addr 172.21.15.69:0/2324711379 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6ade59c700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae00ff0d0 0x7f6ae01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6aded9d700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae010cc80 0x7f6ae019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 -- 172.21.15.69:0/2324711379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae010cc80 msgr2=0x7f6ae019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae010cc80 0x7f6ae019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 -- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae00ff0d0 msgr2=0x7f6ae01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae00ff0d0 0x7f6ae01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6addd9b700 1 -- 172.21.15.69:0/2324711379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad40095f0 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.535+0000 7f6aded9d700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae010cc80 0x7f6ae019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.536+0000 7f6addd9b700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae0198ae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4006010 tx=0x7f6ad4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:53.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.536+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad401d070 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.536+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ad4004000 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.536+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae0112420 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.536+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4022c00 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.536+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae0112290 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.537+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ae010ea50 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.538+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6ad4022470 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6acf7fe700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ac80a11e0 0x7f6ac80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6ade59c700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ac80a11e0 0x7f6ac80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6ad40ce880 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6acf7fe700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] conn(0x7f6ac80aa9b0 0x7f6ac80acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:53.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 --> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ac80ad470 con 0x7f6ac80aa9b0 2023-12-14T18:23:53.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad40ced20 con 0x7f6ae00ff9e0 2023-12-14T18:23:53.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6ade59c700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ac80a11e0 0x7f6ac80a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005950 tx=0x7f6ad000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:53.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.539+0000 7f6aded9d700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] conn(0x7f6ac80aa9b0 0x7f6ac80acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:53.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.540+0000 7f6aded9d700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] conn(0x7f6ac80aa9b0 0x7f6ac80acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:53.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.540+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== osd.4 v2:172.21.15.91:6808/3884359011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6ac80ad470 con 0x7f6ac80aa9b0 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.556+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 --> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ae01125b0 con 0x7f6ac80aa9b0 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6acf7fe700 1 -- 172.21.15.69:0/2324711379 <== osd.4 v2:172.21.15.91:6808/3884359011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6ae01125b0 con 0x7f6ac80aa9b0 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] conn(0x7f6ac80aa9b0 msgr2=0x7f6ac80acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] conn(0x7f6ac80aa9b0 0x7f6ac80acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ac80a11e0 msgr2=0x7f6ac80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ac80a11e0 0x7f6ac80a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005950 tx=0x7f6ad000b410 comp rx=0 tx=0).stop 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 msgr2=0x7f6ae0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 --2- 172.21.15.69:0/2324711379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae00ff9e0 0x7f6ae0198ae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4006010 tx=0x7f6ad4005740 comp rx=0 tx=0).stop 2023-12-14T18:23:53.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6aded9d700 1 -- 172.21.15.69:0/2324711379 reap_dead start 2023-12-14T18:23:53.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 shutdown_connections 2023-12-14T18:23:53.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.557+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 >> 172.21.15.69:0/2324711379 conn(0x7f6ae00770a0 msgr2=0x7f6ae010e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:53.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.558+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 shutdown_connections 2023-12-14T18:23:53.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:52.558+0000 7f6ae4dde700 1 -- 172.21.15.69:0/2324711379 wait complete. 2023-12-14T18:23:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:53 smithi119 ceph-mon[43973]: pgmap v232: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2023-12-14T18:23:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:53 smithi091 ceph-mon[43601]: pgmap v232: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2023-12-14T18:23:54.030 INFO:teuthology.orchestra.run.smithi069.stdout:77309411373 2023-12-14T18:23:54.031 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-14T18:23:54.151 INFO:teuthology.orchestra.run.smithi069.stdout:266287972374 2023-12-14T18:23:54.151 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.9 2023-12-14T18:23:54.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.542+0000 7f0a27f77700 1 -- 172.21.15.69:0/993357126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a201133b0 msgr2=0x7f0a20115790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.542+0000 7f0a27f77700 1 --2- 172.21.15.69:0/993357126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a201133b0 0x7f0a20115790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800b0a0 tx=0x7f0a1800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 -- 172.21.15.69:0/993357126 shutdown_connections 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 --2- 172.21.15.69:0/993357126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a201133b0 0x7f0a20115790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 --2- 172.21.15.69:0/993357126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20107af0 0x7f0a20107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 --2- 172.21.15.69:0/993357126 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a20108400 0x7f0a20112e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 -- 172.21.15.69:0/993357126 >> 172.21.15.69:0/993357126 conn(0x7f0a2006c600 msgr2=0x7f0a200717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 -- 172.21.15.69:0/993357126 shutdown_connections 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 -- 172.21.15.69:0/993357126 wait complete. 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 Processor -- start 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 -- start start 2023-12-14T18:23:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.543+0000 7f0a27f77700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a20107af0 0x7f0a201a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108400 0x7f0a201a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a201133b0 0x7f0a2019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2019f0b0 con 0x7f0a20107af0 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2019f220 con 0x7f0a201133b0 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2019f3e0 con 0x7f0a20108400 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a20107af0 0x7f0a201a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a20107af0 0x7f0a201a49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57404/0 (socket says 172.21.15.69:57404) 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 -- 172.21.15.69:0/3677201296 learned_addr learned my addr 172.21.15.69:0/3677201296 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25512700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108400 0x7f0a201a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a26514700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a201133b0 0x7f0a2019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 -- 172.21.15.69:0/3677201296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108400 msgr2=0x7f0a201a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108400 0x7f0a201a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 -- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a201133b0 msgr2=0x7f0a2019ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a201133b0 0x7f0a2019ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 -- 172.21.15.69:0/3677201296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18009d00 con 0x7f0a20107af0 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a26514700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a201133b0 0x7f0a2019ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a25d13700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a20107af0 0x7f0a201a49c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00bfa0 tx=0x7f0a1c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c012c90 con 0x7f0a20107af0 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a201189b0 con 0x7f0a20107af0 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a1c016070 con 0x7f0a20107af0 2023-12-14T18:23:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c009680 con 0x7f0a20107af0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.544+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a20118820 con 0x7f0a20107af0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.545+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a20061270 con 0x7f0a20107af0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0a1c01d480 con 0x7f0a20107af0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a16ffd700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0a0c0a11e0 0x7f0a0c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0a1c018070 con 0x7f0a20107af0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a25512700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0a0c0a11e0 0x7f0a0c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a16ffd700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] conn(0x7f0a0c0aa9b0 0x7f0a0c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 --> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a0c0ad470 con 0x7f0a0c0aa9b0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.547+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a1c0d2d20 con 0x7f0a20107af0 2023-12-14T18:23:54.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.548+0000 7f0a25512700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0a0c0a11e0 0x7f0a0c0a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a20114b40 tx=0x7f0a1000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:54.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.548+0000 7f0a26514700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] conn(0x7f0a0c0aa9b0 0x7f0a0c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.548+0000 7f0a26514700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] conn(0x7f0a0c0aa9b0 0x7f0a0c0acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:54.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.549+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== osd.1 v2:172.21.15.91:6800/3579777020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0a0c0ad470 con 0x7f0a0c0aa9b0 2023-12-14T18:23:54.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.566+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 --> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a20061620 con 0x7f0a0c0aa9b0 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.567+0000 7f0a16ffd700 1 -- 172.21.15.69:0/3677201296 <== osd.1 v2:172.21.15.91:6800/3579777020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a20061620 con 0x7f0a0c0aa9b0 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] conn(0x7f0a0c0aa9b0 msgr2=0x7f0a0c0acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] conn(0x7f0a0c0aa9b0 0x7f0a0c0acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0a0c0a11e0 msgr2=0x7f0a0c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0a0c0a11e0 0x7f0a0c0a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a20114b40 tx=0x7f0a1000b410 comp rx=0 tx=0).stop 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a20107af0 msgr2=0x7f0a201a49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 --2- 172.21.15.69:0/3677201296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a20107af0 0x7f0a201a49c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00bfa0 tx=0x7f0a1c00dbb0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a26514700 1 -- 172.21.15.69:0/3677201296 reap_dead start 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 shutdown_connections 2023-12-14T18:23:54.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 >> 172.21.15.69:0/3677201296 conn(0x7f0a2006c600 msgr2=0x7f0a2010ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:54.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 shutdown_connections 2023-12-14T18:23:54.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.568+0000 7f0a27f77700 1 -- 172.21.15.69:0/3677201296 wait complete. 2023-12-14T18:23:54.727 INFO:teuthology.orchestra.run.smithi069.stdout:133143986216 2023-12-14T18:23:54.727 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-14T18:23:54.735 INFO:teuthology.orchestra.run.smithi069.stdout:206158430236 2023-12-14T18:23:54.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.7 2023-12-14T18:23:54.980 INFO:teuthology.orchestra.run.smithi069.stdout:103079215146 2023-12-14T18:23:54.980 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-14T18:23:54.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 -- 172.21.15.69:0/4198319418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 msgr2=0x7f4d40104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 --2- 172.21.15.69:0/4198319418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 0x7f4d40104eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d300099c0 tx=0x7f4d30009cd0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 -- 172.21.15.69:0/4198319418 shutdown_connections 2023-12-14T18:23:54.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 --2- 172.21.15.69:0/4198319418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 0x7f4d4010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 --2- 172.21.15.69:0/4198319418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d40100540 0x7f4d40100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 --2- 172.21.15.69:0/4198319418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 0x7f4d40104eb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 -- 172.21.15.69:0/4198319418 >> 172.21.15.69:0/4198319418 conn(0x7f4d400fbdc0 msgr2=0x7f4d400fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 -- 172.21.15.69:0/4198319418 shutdown_connections 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.953+0000 7f4d477df700 1 -- 172.21.15.69:0/4198319418 wait complete. 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.954+0000 7f4d477df700 1 Processor -- start 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.954+0000 7f4d477df700 1 -- start start 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d477df700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d40100540 0x7f4d401963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d477df700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 0x7f4d401968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d477df700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 0x7f4d4019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d477df700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4019b370 con 0x7f4d40100540 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d477df700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4019b4e0 con 0x7f4d401055e0 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d477df700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4019b6a0 con 0x7f4d40100ee0 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 0x7f4d4019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d4557b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d40100540 0x7f4d401963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 0x7f4d4019ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:51358/0 (socket says 172.21.15.69:51358) 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 -- 172.21.15.69:0/2681645338 learned_addr learned my addr 172.21.15.69:0/2681645338 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d44d7a700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 0x7f4d401968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 -- 172.21.15.69:0/2681645338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 msgr2=0x7f4d401968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d40100ee0 0x7f4d401968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 -- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d40100540 msgr2=0x7f4d401963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d40100540 0x7f4d401963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.955+0000 7f4d45d7c700 1 -- 172.21.15.69:0/2681645338 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300095f0 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.956+0000 7f4d45d7c700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 0x7f4d4019ad60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800ef30 tx=0x7f4d3800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.956+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38018070 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.956+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d40110220 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.956+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d3800f040 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.956+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800cc70 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.956+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d40110090 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.957+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d24000ff0 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.959+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4d38004000 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.959+0000 7f4d367fc700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d2c0a11e0 0x7f4d2c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.959+0000 7f4d4557b700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d2c0a11e0 0x7f4d2c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d380cc5b0 con 0x7f4d401055e0 2023-12-14T18:23:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d367fc700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] conn(0x7f4d2c0aa9b0 0x7f4d2c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 --> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d2c0ad470 con 0x7f4d2c0aa9b0 2023-12-14T18:23:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== mon.2 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d380cc9d0 con 0x7f4d401055e0 2023-12-14T18:23:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d44d7a700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] conn(0x7f4d2c0aa9b0 0x7f4d2c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d4557b700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d2c0a11e0 0x7f4d2c0a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009a10 tx=0x7f4d3c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.960+0000 7f4d44d7a700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] conn(0x7f4d2c0aa9b0 0x7f4d2c0acdc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.961+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== osd.0 v2:172.21.15.69:6802/1311409675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d2c0ad470 con 0x7f4d2c0aa9b0 2023-12-14T18:23:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.993+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 --> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d24002d70 con 0x7f4d2c0aa9b0 2023-12-14T18:23:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d367fc700 1 -- 172.21.15.69:0/2681645338 <== osd.0 v2:172.21.15.69:6802/1311409675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d24002d70 con 0x7f4d2c0aa9b0 2023-12-14T18:23:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] conn(0x7f4d2c0aa9b0 msgr2=0x7f4d2c0acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] conn(0x7f4d2c0aa9b0 0x7f4d2c0acdc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d2c0a11e0 msgr2=0x7f4d2c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d2c0a11e0 0x7f4d2c0a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009a10 tx=0x7f4d3c009190 comp rx=0 tx=0).stop 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 msgr2=0x7f4d4019ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 --2- 172.21.15.69:0/2681645338 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d401055e0 0x7f4d4019ad60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800ef30 tx=0x7f4d3800c3a0 comp rx=0 tx=0).stop 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d45d7c700 1 -- 172.21.15.69:0/2681645338 reap_dead start 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 shutdown_connections 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.994+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 >> 172.21.15.69:0/2681645338 conn(0x7f4d400fbdc0 msgr2=0x7f4d400fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.995+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 shutdown_connections 2023-12-14T18:23:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:54.995+0000 7f4d477df700 1 -- 172.21.15.69:0/2681645338 wait complete. 2023-12-14T18:23:55.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1537720045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101e50 msgr2=0x7fd9ac10a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1537720045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101e50 0x7fd9ac10a350 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009990 tx=0x7fd9a0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1537720045 shutdown_connections 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1537720045 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9ac10a890 0x7fd9ac10ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1537720045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9ac101540 0x7fd9ac101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1537720045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101e50 0x7fd9ac10a350 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1537720045 >> 172.21.15.69:0/1537720045 conn(0x7fd9ac0770a0 msgr2=0x7fd9ac0774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1537720045 shutdown_connections 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.145+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1537720045 wait complete. 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 Processor -- start 2023-12-14T18:23:55.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 -- start start 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101540 0x7fd9ac196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9ac101e50 0x7fd9ac1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9ac10a890 0x7fd9ac19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac19b250 con 0x7fd9ac101540 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac19b3c0 con 0x7fd9ac10a890 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b27d8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac19b580 con 0x7fd9ac101e50 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101540 0x7fd9ac196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101540 0x7fd9ac196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57438/0 (socket says 172.21.15.69:57438) 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9abfff700 1 -- 172.21.15.69:0/1677549868 learned_addr learned my addr 172.21.15.69:0/1677549868 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:55.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9b0d75700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9ac10a890 0x7fd9ac19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.146+0000 7fd9ab7fe700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9ac101e50 0x7fd9ac1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9abfff700 1 -- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9ac101e50 msgr2=0x7fd9ac1967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9abfff700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9ac101e50 0x7fd9ac1967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9abfff700 1 -- 172.21.15.69:0/1677549868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9ac10a890 msgr2=0x7fd9ac19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9abfff700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9ac10a890 0x7fd9ac19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9abfff700 1 -- 172.21.15.69:0/1677549868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a00095f0 con 0x7fd9ac101540 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9abfff700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101540 0x7fd9ac196290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c9b0 tx=0x7fd99c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c007b00 con 0x7fd9ac101540 2023-12-14T18:23:55.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac1101c0 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd99c007c60 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c018660 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.147+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac110030 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.148+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9ac0fc760 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.149+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd99c00f450 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.149+0000 7fd9a97fa700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9940a11e0 0x7fd9940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.149+0000 7fd9ab7fe700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9940a11e0 0x7fd9940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.149+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd99c0ccef0 con 0x7fd9ac101540 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.150+0000 7fd9a97fa700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] conn(0x7fd9940aa9b0 0x7fd9940acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:55.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.150+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 --> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9940ad470 con 0x7fd9940aa9b0 2023-12-14T18:23:55.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.150+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd99c0cd390 con 0x7fd9ac101540 2023-12-14T18:23:55.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.150+0000 7fd9ab7fe700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9940a11e0 0x7fd9940a3690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac1978b0 tx=0x7fd9a000b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:55.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.150+0000 7fd9b0d75700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] conn(0x7fd9940aa9b0 0x7fd9940acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:55.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.150+0000 7fd9b0d75700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] conn(0x7fd9940aa9b0 0x7fd9940acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:55.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.151+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== osd.5 v2:172.21.15.119:6808/3766790322 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd9940ad470 con 0x7fd9940aa9b0 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.173+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 --> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9ac110350 con 0x7fd9940aa9b0 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9a97fa700 1 -- 172.21.15.69:0/1677549868 <== osd.5 v2:172.21.15.119:6808/3766790322 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd9ac110350 con 0x7fd9940aa9b0 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] conn(0x7fd9940aa9b0 msgr2=0x7fd9940acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] conn(0x7fd9940aa9b0 0x7fd9940acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9940a11e0 msgr2=0x7fd9940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9940a11e0 0x7fd9940a3690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac1978b0 tx=0x7fd9a000b2a0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101540 msgr2=0x7fd9ac196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 --2- 172.21.15.69:0/1677549868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9ac101540 0x7fd9ac196290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c9b0 tx=0x7fd99c00ccc0 comp rx=0 tx=0).stop 2023-12-14T18:23:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b0d75700 1 -- 172.21.15.69:0/1677549868 reap_dead start 2023-12-14T18:23:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 shutdown_connections 2023-12-14T18:23:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 >> 172.21.15.69:0/1677549868 conn(0x7fd9ac0770a0 msgr2=0x7fd9ac0fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 shutdown_connections 2023-12-14T18:23:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:55.174+0000 7fd9b27d8700 1 -- 172.21.15.69:0/1677549868 wait complete. 2023-12-14T18:23:55.661 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:55 smithi069 ceph-mon[42047]: pgmap v233: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T18:23:55.730 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:55.840 INFO:teuthology.orchestra.run.smithi069.stdout:55834574899 2023-12-14T18:23:55.841 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-14T18:23:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:55 smithi119 ceph-mon[43973]: pgmap v233: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T18:23:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:55 smithi091 ceph-mon[43601]: pgmap v233: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T18:23:56.614 INFO:teuthology.orchestra.run.smithi069.stdout:34359738421 2023-12-14T18:23:56.615 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-14T18:23:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:57.312 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:57.434 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:57.488 INFO:teuthology.orchestra.run.smithi069.stdout:154618822693 2023-12-14T18:23:57.488 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-14T18:23:57.514 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:57 smithi069 ceph-mon[42047]: pgmap v234: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-14T18:23:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 -- 172.21.15.69:0/2875094982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 msgr2=0x7f27ec10b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 --2- 172.21.15.69:0/2875094982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec10b7e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c210 tx=0x7f27e400c520 comp rx=0 tx=0).stop 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 -- 172.21.15.69:0/2875094982 shutdown_connections 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 --2- 172.21.15.69:0/2875094982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec10b7e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 --2- 172.21.15.69:0/2875094982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec1049a0 0x7f27ec104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 --2- 172.21.15.69:0/2875094982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27ec0fe9a0 0x7f27ec0fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 -- 172.21.15.69:0/2875094982 >> 172.21.15.69:0/2875094982 conn(0x7f27ec0758a0 msgr2=0x7f27ec075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 -- 172.21.15.69:0/2875094982 shutdown_connections 2023-12-14T18:23:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.823+0000 7f27f19ba700 1 -- 172.21.15.69:0/2875094982 wait complete. 2023-12-14T18:23:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.824+0000 7f27f19ba700 1 Processor -- start 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.824+0000 7f27f19ba700 1 -- start start 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.824+0000 7f27f19ba700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27ec0fe9a0 0x7f27ec1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.824+0000 7f27f19ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27f19ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec1049a0 0x7f27ec19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27f19ba700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec19b280 con 0x7f27ec0ff350 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27f19ba700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec19b3f0 con 0x7f27ec0fe9a0 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27f19ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec19b5b0 con 0x7f27ec1049a0 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38506/0 (socket says 172.21.15.69:38506) 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 -- 172.21.15.69:0/3515342142 learned_addr learned my addr 172.21.15.69:0/3515342142 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27eb7fe700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec1049a0 0x7f27ec19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:57.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27eaffd700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27ec0fe9a0 0x7f27ec1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 -- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec1049a0 msgr2=0x7f27ec19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec1049a0 0x7f27ec19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 -- 172.21.15.69:0/3515342142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27ec0fe9a0 msgr2=0x7f27ec1962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27ec0fe9a0 0x7f27ec1962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 -- 172.21.15.69:0/3515342142 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e400ae10 con 0x7f27ec0ff350 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.825+0000 7f27ea7fc700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec196800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c9b0 tx=0x7f27e000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.826+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0007b00 con 0x7f27ec0ff350 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.826+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27e0007c60 con 0x7f27ec0ff350 2023-12-14T18:23:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.826+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0018660 con 0x7f27ec0ff350 2023-12-14T18:23:57.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.826+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec10e050 con 0x7f27ec0ff350 2023-12-14T18:23:57.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.826+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec10dec0 con 0x7f27ec0ff350 2023-12-14T18:23:57.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.827+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27ec103f50 con 0x7f27ec0ff350 2023-12-14T18:23:57.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.829+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f27e000f450 con 0x7f27ec0ff350 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.829+0000 7f27f09b8700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f27d40a13b0 0x7f27d40a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f27e00ccdc0 con 0x7f27ec0ff350 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27eaffd700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f27d40a13b0 0x7f27d40a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27f09b8700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] conn(0x7f27d40aab80 0x7f27d40acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 --> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27d40ad640 con 0x7f27d40aab80 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e00cd170 con 0x7f27ec0ff350 2023-12-14T18:23:57.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27eb7fe700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] conn(0x7f27d40aab80 0x7f27d40acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:57.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.830+0000 7f27eaffd700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f27d40a13b0 0x7f27d40a3860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005950 tx=0x7f27dc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:57.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.831+0000 7f27eb7fe700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] conn(0x7f27d40aab80 0x7f27d40acf90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:57.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.831+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== osd.8 v2:172.21.15.119:6816/1350490441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f27d40ad640 con 0x7f27d40aab80 2023-12-14T18:23:57.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.850+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 --> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27ec10e1e0 con 0x7f27d40aab80 2023-12-14T18:23:57.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.850+0000 7f27f09b8700 1 -- 172.21.15.69:0/3515342142 <== osd.8 v2:172.21.15.119:6816/1350490441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f27ec10e1e0 con 0x7f27d40aab80 2023-12-14T18:23:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] conn(0x7f27d40aab80 msgr2=0x7f27d40acf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] conn(0x7f27d40aab80 0x7f27d40acf90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f27d40a13b0 msgr2=0x7f27d40a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f27d40a13b0 0x7f27d40a3860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005950 tx=0x7f27dc0058e0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 msgr2=0x7f27ec196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 --2- 172.21.15.69:0/3515342142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27ec0ff350 0x7f27ec196800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c9b0 tx=0x7f27e000ccc0 comp rx=0 tx=0).stop 2023-12-14T18:23:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27eb7fe700 1 -- 172.21.15.69:0/3515342142 reap_dead start 2023-12-14T18:23:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 shutdown_connections 2023-12-14T18:23:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 >> 172.21.15.69:0/3515342142 conn(0x7f27ec0758a0 msgr2=0x7f27ec1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 shutdown_connections 2023-12-14T18:23:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:57.851+0000 7f27f19ba700 1 -- 172.21.15.69:0/3515342142 wait complete. 2023-12-14T18:23:57.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:57 smithi119 ceph-mon[43973]: pgmap v234: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-14T18:23:57.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:57 smithi091 ceph-mon[43601]: pgmap v234: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-14T18:23:58.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 -- 172.21.15.69:0/2252747714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7480ff470 msgr2=0x7ff7480ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/2252747714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7480ff470 0x7ff7480ff840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0099c0 tx=0x7ff73c009cd0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 -- 172.21.15.69:0/2252747714 shutdown_connections 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/2252747714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff748104510 0x7ff74810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/2252747714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7480ff470 0x7ff7480ff840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/2252747714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7480ffe10 0x7ff748103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 -- 172.21.15.69:0/2252747714 >> 172.21.15.69:0/2252747714 conn(0x7ff7480770d0 msgr2=0x7ff7480774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 -- 172.21.15.69:0/2252747714 shutdown_connections 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 -- 172.21.15.69:0/2252747714 wait complete. 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 Processor -- start 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.195+0000 7ff74ee1a700 1 -- start start 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7480ff470 0x7ff748196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7480ffe10 0x7ff748196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff748104510 0x7ff74819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74819b300 con 0x7ff748104510 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74819b470 con 0x7ff7480ff470 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74819b630 con 0x7ff7480ffe10 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff748104510 0x7ff74819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff748104510 0x7ff74819acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38526/0 (socket says 172.21.15.69:38526) 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 -- 172.21.15.69:0/1396044102 learned_addr learned my addr 172.21.15.69:0/1396044102 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74cbb6700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7480ff470 0x7ff748196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff747fff700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7480ffe10 0x7ff748196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 -- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7480ffe10 msgr2=0x7ff748196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7480ffe10 0x7ff748196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 -- 172.21.15.69:0/1396044102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7480ff470 msgr2=0x7ff748196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7480ff470 0x7ff748196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 -- 172.21.15.69:0/1396044102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c0095f0 con 0x7ff748104510 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74cbb6700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7480ff470 0x7ff748196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74d3b7700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff748104510 0x7ff74819acf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff74000ada0 tx=0x7ff74000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74000f070 con 0x7ff748104510 2023-12-14T18:23:58.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74810f150 con 0x7ff748104510 2023-12-14T18:23:58.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff740007b30 con 0x7ff748104510 2023-12-14T18:23:58.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.196+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400053e0 con 0x7ff748104510 2023-12-14T18:23:58.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.197+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74810efc0 con 0x7ff748104510 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.197+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff748069950 con 0x7ff748104510 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.198+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff74000c980 con 0x7ff748104510 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff745ffb700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7380a11e0 0x7ff7380a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff74cbb6700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7380a11e0 0x7ff7380a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff7400cc970 con 0x7ff748104510 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff745ffb700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] conn(0x7ff7380aa9b0 0x7ff7380acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 --> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7380ad470 con 0x7ff7380aa9b0 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7400cce10 con 0x7ff748104510 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.199+0000 7ff74cbb6700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7380a11e0 0x7ff7380a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff73c006010 tx=0x7ff73c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.200+0000 7ff747fff700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] conn(0x7ff7380aa9b0 0x7ff7380acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.200+0000 7ff747fff700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] conn(0x7ff7380aa9b0 0x7ff7380acdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:58.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.201+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== osd.11 v2:172.21.15.119:6824/1392075929 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff7380ad470 con 0x7ff7380aa9b0 2023-12-14T18:23:58.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.217+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 --> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff74810f2e0 con 0x7ff7380aa9b0 2023-12-14T18:23:58.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.217+0000 7ff745ffb700 1 -- 172.21.15.69:0/1396044102 <== osd.11 v2:172.21.15.119:6824/1392075929 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff74810f2e0 con 0x7ff7380aa9b0 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.217+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] conn(0x7ff7380aa9b0 msgr2=0x7ff7380acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.217+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] conn(0x7ff7380aa9b0 0x7ff7380acdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7380a11e0 msgr2=0x7ff7380a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7380a11e0 0x7ff7380a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff73c006010 tx=0x7ff73c000bc0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff748104510 msgr2=0x7ff74819acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 --2- 172.21.15.69:0/1396044102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff748104510 0x7ff74819acf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff74000ada0 tx=0x7ff74000c330 comp rx=0 tx=0).stop 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74d3b7700 1 -- 172.21.15.69:0/1396044102 reap_dead start 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 shutdown_connections 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 >> 172.21.15.69:0/1396044102 conn(0x7ff7480770d0 msgr2=0x7ff748068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 shutdown_connections 2023-12-14T18:23:58.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.218+0000 7ff74ee1a700 1 -- 172.21.15.69:0/1396044102 wait complete. 2023-12-14T18:23:58.304 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:58.304 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:58.304 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:23:58.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2558449232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e780737a0 msgr2=0x7f6e78110db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2558449232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e780737a0 0x7f6e78110db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009990 tx=0x7f6e68009ca0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2558449232 shutdown_connections 2023-12-14T18:23:58.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2558449232 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e781112f0 0x7f6e781136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2558449232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e78072e90 0x7f6e78073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2558449232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e780737a0 0x7f6e78110db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2558449232 >> 172.21.15.69:0/2558449232 conn(0x7f6e780fbdc0 msgr2=0x7f6e780fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:58.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2558449232 shutdown_connections 2023-12-14T18:23:58.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.939+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2558449232 wait complete. 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 Processor -- start 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 -- start start 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e78072e90 0x7f6e7819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e780737a0 0x7f6e7819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 0x7f6e781a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781a1940 con 0x7f6e781112f0 2023-12-14T18:23:58.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781a1ab0 con 0x7f6e780737a0 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7f47b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781a1c70 con 0x7f6e78072e90 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 0x7f6e781a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 0x7f6e781a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38530/0 (socket says 172.21.15.69:38530) 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 -- 172.21.15.69:0/2523959357 learned_addr learned my addr 172.21.15.69:0/2523959357 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7ca16700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e780737a0 0x7f6e7819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7d217700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e78072e90 0x7f6e7819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 -- 172.21.15.69:0/2523959357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e78072e90 msgr2=0x7f6e7819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e78072e90 0x7f6e7819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 -- 172.21.15.69:0/2523959357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e780737a0 msgr2=0x7f6e7819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e780737a0 0x7f6e7819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 -- 172.21.15.69:0/2523959357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680095f0 con 0x7f6e781112f0 2023-12-14T18:23:58.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7ca16700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e780737a0 0x7f6e7819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.940+0000 7f6e7da18700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 0x7f6e781a1370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000ada0 tx=0x7f6e7000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.941+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000f070 con 0x7f6e781112f0 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.941+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e70007b00 con 0x7f6e781112f0 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.941+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78116860 con 0x7f6e781112f0 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.941+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e700053a0 con 0x7f6e781112f0 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.941+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e781166d0 con 0x7f6e781112f0 2023-12-14T18:23:58.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.942+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e781169f0 con 0x7f6e781112f0 2023-12-14T18:23:58.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.943+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6e7000c980 con 0x7f6e781112f0 2023-12-14T18:23:58.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.943+0000 7f6e6e7fc700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6e640a11e0 0x7f6e640a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:23:58.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.943+0000 7f6e7d217700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6e640a11e0 0x7f6e640a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:23:58.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.943+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6e700cc580 con 0x7f6e781112f0 2023-12-14T18:23:58.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.944+0000 7f6e7d217700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6e640a11e0 0x7f6e640a3690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:23:58.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:58.947+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6e70095db0 con 0x7f6e781112f0 2023-12-14T18:23:59.042 INFO:teuthology.orchestra.run.smithi069.stdout:317827579920 2023-12-14T18:23:59.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.11 2023-12-14T18:23:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.150+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6e781037d0 con 0x7f6e781112f0 2023-12-14T18:23:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.151+0000 7f6e6e7fc700 1 -- 172.21.15.69:0/2523959357 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e7000cc30 con 0x7f6e781112f0 2023-12-14T18:23:59.152 INFO:teuthology.orchestra.run.smithi069.stdout:184683593762 2023-12-14T18:23:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6e640a11e0 msgr2=0x7f6e640a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6e640a11e0 0x7f6e640a3690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74008040 comp rx=0 tx=0).stop 2023-12-14T18:23:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 msgr2=0x7f6e781a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:23:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 0x7f6e781a1370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000ada0 tx=0x7f6e7000c330 comp rx=0 tx=0).stop 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 shutdown_connections 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6e640a11e0 0x7f6e640a3690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e781112f0 0x7f6e781a1370 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e78072e90 0x7f6e7819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 --2- 172.21.15.69:0/2523959357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e780737a0 0x7f6e7819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 >> 172.21.15.69:0/2523959357 conn(0x7f6e780fbdc0 msgr2=0x7f6e780fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 shutdown_connections 2023-12-14T18:23:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:23:59.153+0000 7f6e7f47b700 1 -- 172.21.15.69:0/2523959357 wait complete. 2023-12-14T18:23:59.642 INFO:teuthology.orchestra.run.smithi069.stdout:236223201306 2023-12-14T18:23:59.643 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.8 2023-12-14T18:23:59.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:59 smithi069 ceph-mon[42047]: pgmap v235: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T18:23:59.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:23:59 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2523959357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-14T18:23:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:59 smithi119 ceph-mon[43973]: pgmap v235: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T18:23:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:23:59 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2523959357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-14T18:23:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:59 smithi091 ceph-mon[43601]: pgmap v235: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-14T18:23:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:23:59 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2523959357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 -- 172.21.15.69:0/3750981460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 msgr2=0x7f829810ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 --2- 172.21.15.69:0/3750981460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829810ccd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f829000b0a0 tx=0x7f829000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 -- 172.21.15.69:0/3750981460 shutdown_connections 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 --2- 172.21.15.69:0/3750981460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829810ccd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 --2- 172.21.15.69:0/3750981460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8298101540 0x7f8298101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 --2- 172.21.15.69:0/3750981460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8298101e50 0x7f829810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.983+0000 7f829f19c700 1 -- 172.21.15.69:0/3750981460 >> 172.21.15.69:0/3750981460 conn(0x7f82980770a0 msgr2=0x7f82980774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.984+0000 7f829f19c700 1 -- 172.21.15.69:0/3750981460 shutdown_connections 2023-12-14T18:24:01.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.984+0000 7f829f19c700 1 -- 172.21.15.69:0/3750981460 wait complete. 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.984+0000 7f829f19c700 1 Processor -- start 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.984+0000 7f829f19c700 1 -- start start 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8298101540 0x7f82981963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8298101e50 0x7f8298196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829819b380 con 0x7f829810a890 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829819b4f0 con 0x7f8298101e50 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829819b6b0 con 0x7f8298101540 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829819ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38556/0 (socket says 172.21.15.69:38556) 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 -- 172.21.15.69:0/1258540443 learned_addr learned my addr 172.21.15.69:0/1258540443 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f8297fff700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8298101e50 0x7f8298196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829cf38700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8298101540 0x7f82981963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 -- 172.21.15.69:0/1258540443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8298101540 msgr2=0x7f82981963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8298101540 0x7f82981963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 -- 172.21.15.69:0/1258540443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8298101e50 msgr2=0x7f8298196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8298101e50 0x7f8298196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 -- 172.21.15.69:0/1258540443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009d00 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829d739700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829819ad70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f829000b780 tx=0x7f829000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000e040 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8290004e60 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.985+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8298110160 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.986+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900052a0 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.986+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829810ffd0 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.987+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82981102f0 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.989+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f829001d470 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.990+0000 7f8295ffb700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a11e0 0x7f82880a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.990+0000 7f829cf38700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a11e0 0x7f82880a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.990+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f82900ce5c0 con 0x7f829810a890 2023-12-14T18:24:01.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.990+0000 7f829cf38700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a11e0 0x7f82880a3690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f828c005950 tx=0x7f828c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:01.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.993+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8290097df0 con 0x7f829810a890 2023-12-14T18:24:01.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.194+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82981a3440 con 0x7f829810a890 2023-12-14T18:24:01.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.195+0000 7f8295ffb700 1 -- 172.21.15.69:0/1258540443 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f829009b410 con 0x7f829810a890 2023-12-14T18:24:01.196 INFO:teuthology.orchestra.run.smithi069.stdout:77309411375 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a11e0 msgr2=0x7f82880a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a11e0 0x7f82880a3690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f828c005950 tx=0x7f828c00b410 comp rx=0 tx=0).stop 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 msgr2=0x7f829819ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829819ad70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f829000b780 tx=0x7f829000bd60 comp rx=0 tx=0).stop 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 shutdown_connections 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a11e0 0x7f82880a3690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829810a890 0x7f829819ad70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8298101540 0x7f82981963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 --2- 172.21.15.69:0/1258540443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8298101e50 0x7f8298196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 >> 172.21.15.69:0/1258540443 conn(0x7f82980770a0 msgr2=0x7f82980fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 shutdown_connections 2023-12-14T18:24:01.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.197+0000 7f829f19c700 1 -- 172.21.15.69:0/1258540443 wait complete. 2023-12-14T18:24:01.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:01 smithi069 ceph-mon[42047]: pgmap v236: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:01.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:01 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/391342131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-14T18:24:01.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:01 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1258540443' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-14T18:24:01.858 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411373 got 77309411375 for osd.2 2023-12-14T18:24:01.859 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:01 smithi119 ceph-mon[43973]: pgmap v236: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:01 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/391342131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-14T18:24:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:01 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1258540443' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-14T18:24:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:01 smithi091 ceph-mon[43601]: pgmap v236: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:01 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/391342131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-14T18:24:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:01 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1258540443' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-14T18:24:01.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 -- 172.21.15.69:0/2622283730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 msgr2=0x7f4668103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 --2- 172.21.15.69:0/2622283730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668103dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f465c0099c0 tx=0x7f465c009cd0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 -- 172.21.15.69:0/2622283730 shutdown_connections 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 --2- 172.21.15.69:0/2622283730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 0x7f466810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 --2- 172.21.15.69:0/2622283730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46680ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 --2- 172.21.15.69:0/2622283730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668103dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 -- 172.21.15.69:0/2622283730 >> 172.21.15.69:0/2622283730 conn(0x7f46680770a0 msgr2=0x7f46680774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 -- 172.21.15.69:0/2622283730 shutdown_connections 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.881+0000 7f466cf52700 1 -- 172.21.15.69:0/2622283730 wait complete. 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 Processor -- start 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 -- start start 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46681971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 0x7f46681a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4668198060 con 0x7f46680ff460 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46681a27a0 con 0x7f4668104500 2023-12-14T18:24:01.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466cf52700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46681a2960 con 0x7f46680ffe00 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46681971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46681971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38538/0 (socket says 172.21.15.69:38538) 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.882+0000 7f466659c700 1 -- 172.21.15.69:0/391342131 learned_addr learned my addr 172.21.15.69:0/391342131 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f4666d9d700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 0x7f46681a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f4665d9b700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466659c700 1 -- 172.21.15.69:0/391342131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 msgr2=0x7f4668197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466659c700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466659c700 1 -- 172.21.15.69:0/391342131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 msgr2=0x7f46681a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466659c700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 0x7f46681a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466659c700 1 -- 172.21.15.69:0/391342131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0095f0 con 0x7f46680ff460 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f4666d9d700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 0x7f46681a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f4665d9b700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466659c700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46681971e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f465800e9a0 tx=0x7f465800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658009790 con 0x7f46680ff460 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f465800cbd0 con 0x7f46680ff460 2023-12-14T18:24:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466810f0e0 con 0x7f46680ff460 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658018680 con 0x7f46680ff460 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.883+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466810ef50 con 0x7f46680ff460 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.884+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466810f270 con 0x7f46680ff460 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.885+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4658010430 con 0x7f46680ff460 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.885+0000 7f46577fe700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f46500a11e0 0x7f46500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stdout:266287972375 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.886+0000 7f4665d9b700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f46500a11e0 0x7f46500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.886+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4658014070 con 0x7f46680ff460 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.886+0000 7f4665d9b700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f46500a11e0 0x7f46500a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f465c0098e0 tx=0x7f465c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:00.890+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4658051730 con 0x7f46680ff460 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.102+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f4668066ea0 con 0x7f46680ff460 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.102+0000 7f46577fe700 1 -- 172.21.15.69:0/391342131 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4658099e30 con 0x7f46680ff460 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f46500a11e0 msgr2=0x7f46500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f46500a11e0 0x7f46500a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f465c0098e0 tx=0x7f465c000bc0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 msgr2=0x7f46681971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46681971e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f465800e9a0 tx=0x7f465800ed60 comp rx=0 tx=0).stop 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 shutdown_connections 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f46500a11e0 0x7f46500a3690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4668104500 0x7f46681a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46680ff460 0x7f46681971e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 --2- 172.21.15.69:0/391342131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46680ffe00 0x7f4668197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 >> 172.21.15.69:0/391342131 conn(0x7f46680770a0 msgr2=0x7f46680fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 shutdown_connections 2023-12-14T18:24:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:01.104+0000 7f466cf52700 1 -- 172.21.15.69:0/391342131 wait complete. 2023-12-14T18:24:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2894350494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4100f00 msgr2=0x7f07e4104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2894350494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4100f00 0x7f07e4104ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07d40099c0 tx=0x7f07d4009cd0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2894350494 shutdown_connections 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2894350494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e4105600 0x7f07e410d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2894350494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07e4100560 0x7f07e4100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2894350494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4100f00 0x7f07e4104ed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2894350494 >> 172.21.15.69:0/2894350494 conn(0x7f07e40fbde0 msgr2=0x7f07e40fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:02.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2894350494 shutdown_connections 2023-12-14T18:24:02.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.614+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2894350494 wait complete. 2023-12-14T18:24:02.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 Processor -- start 2023-12-14T18:24:02.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 -- start start 2023-12-14T18:24:02.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e4100560 0x7f07e4196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07e4100f00 0x7f07e41967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 0x7f07e419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e419b240 con 0x7f07e4105600 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e419b3b0 con 0x7f07e4100f00 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07ea0fc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e419b570 con 0x7f07e4100560 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07e3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 0x7f07e419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07e3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 0x7f07e419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38578/0 (socket says 172.21.15.69:38578) 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07e3fff700 1 -- 172.21.15.69:0/2786161656 learned_addr learned my addr 172.21.15.69:0/2786161656 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07e2ffd700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07e4100f00 0x7f07e41967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.615+0000 7f07e37fe700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e4100560 0x7f07e4196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e3fff700 1 -- 172.21.15.69:0/2786161656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e4100560 msgr2=0x7f07e4196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e3fff700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e4100560 0x7f07e4196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e3fff700 1 -- 172.21.15.69:0/2786161656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07e4100f00 msgr2=0x7f07e41967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e3fff700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07e4100f00 0x7f07e41967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e3fff700 1 -- 172.21.15.69:0/2786161656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40095f0 con 0x7f07e4105600 2023-12-14T18:24:02.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e3fff700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 0x7f07e419ac30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f07dc007d70 tx=0x7f07dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00ad40 con 0x7f07e4105600 2023-12-14T18:24:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07dc0128b0 con 0x7f07e4105600 2023-12-14T18:24:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0115a0 con 0x7f07e4105600 2023-12-14T18:24:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e41101e0 con 0x7f07e4105600 2023-12-14T18:24:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.616+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e4110050 con 0x7f07e4105600 2023-12-14T18:24:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.617+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e4110370 con 0x7f07e4105600 2023-12-14T18:24:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.618+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f07dc012a20 con 0x7f07e4105600 2023-12-14T18:24:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.618+0000 7f07e0ff9700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f07cc0a12e0 0x7f07cc0a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.619+0000 7f07e37fe700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f07cc0a12e0 0x7f07cc0a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.619+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f07dc0cca50 con 0x7f07e4105600 2023-12-14T18:24:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.619+0000 7f07e37fe700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f07cc0a12e0 0x7f07cc0a3790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009bf0 tx=0x7f07d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:02.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.623+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f07dc096200 con 0x7f07e4105600 2023-12-14T18:24:02.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.835+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f07e4066ea0 con 0x7f07e4105600 2023-12-14T18:24:02.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.836+0000 7f07e0ff9700 1 -- 172.21.15.69:0/2786161656 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07dc016090 con 0x7f07e4105600 2023-12-14T18:24:02.837 INFO:teuthology.orchestra.run.smithi069.stdout:206158430238 2023-12-14T18:24:02.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.838+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f07cc0a12e0 msgr2=0x7f07cc0a3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.838+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f07cc0a12e0 0x7f07cc0a3790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009bf0 tx=0x7f07d8009260 comp rx=0 tx=0).stop 2023-12-14T18:24:02.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.839+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 msgr2=0x7f07e419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.839+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 0x7f07e419ac30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f07dc007d70 tx=0x7f07dc00a340 comp rx=0 tx=0).stop 2023-12-14T18:24:02.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 shutdown_connections 2023-12-14T18:24:02.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f07cc0a12e0 0x7f07cc0a3790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07e4105600 0x7f07e419ac30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e4100560 0x7f07e4196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 --2- 172.21.15.69:0/2786161656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07e4100f00 0x7f07e41967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 >> 172.21.15.69:0/2786161656 conn(0x7f07e40fbde0 msgr2=0x7f07e40fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:02.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 shutdown_connections 2023-12-14T18:24:02.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.840+0000 7f07ea0fc700 1 -- 172.21.15.69:0/2786161656 wait complete. 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 -- 172.21.15.69:0/741910316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f411010a900 msgr2=0x7f411010cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 --2- 172.21.15.69:0/741910316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f411010a900 0x7f411010cd00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f410800b0a0 tx=0x7f410800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 -- 172.21.15.69:0/741910316 shutdown_connections 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 --2- 172.21.15.69:0/741910316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f411010a900 0x7f411010cd00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 --2- 172.21.15.69:0/741910316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41101013e0 0x7f41101017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 --2- 172.21.15.69:0/741910316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4110101cf0 0x7f411010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 -- 172.21.15.69:0/741910316 >> 172.21.15.69:0/741910316 conn(0x7f41100770d0 msgr2=0x7f41100774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 -- 172.21.15.69:0/741910316 shutdown_connections 2023-12-14T18:24:02.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.843+0000 7f41151dc700 1 -- 172.21.15.69:0/741910316 wait complete. 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 Processor -- start 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 -- start start 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 0x7f41101964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4110101cf0 0x7f41101969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f411010a900 0x7f411019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411019b400 con 0x7f41101013e0 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411019b570 con 0x7f411010a900 2023-12-14T18:24:02.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f41151dc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411019b730 con 0x7f4110101cf0 2023-12-14T18:24:02.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f410ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 0x7f41101964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f410ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 0x7f41101964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38602/0 (socket says 172.21.15.69:38602) 2023-12-14T18:24:02.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f410ed9d700 1 -- 172.21.15.69:0/3972390064 learned_addr learned my addr 172.21.15.69:0/3972390064 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f410f59e700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f411010a900 0x7f411019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.844+0000 7f410e59c700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4110101cf0 0x7f41101969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f410ed9d700 1 -- 172.21.15.69:0/3972390064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4110101cf0 msgr2=0x7f41101969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f410ed9d700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4110101cf0 0x7f41101969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f410ed9d700 1 -- 172.21.15.69:0/3972390064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f411010a900 msgr2=0x7f411019adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f410ed9d700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f411010a900 0x7f411019adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f410ed9d700 1 -- 172.21.15.69:0/3972390064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009d00 con 0x7f41101013e0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f410ed9d700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 0x7f41101964b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f410000d980 tx=0x7f410000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100004220 con 0x7f41101013e0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41101101e0 con 0x7f41101013e0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4100007640 con 0x7f41101013e0 2023-12-14T18:24:02.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000055e0 con 0x7f41101013e0 2023-12-14T18:24:02.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.845+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4110110050 con 0x7f41101013e0 2023-12-14T18:24:02.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.846+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4110110370 con 0x7f41101013e0 2023-12-14T18:24:02.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.847+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4100004750 con 0x7f41101013e0 2023-12-14T18:24:02.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.848+0000 7f40f7fff700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40f80a11e0 0x7f40f80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:02.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.848+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f41000ccbf0 con 0x7f41101013e0 2023-12-14T18:24:02.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.848+0000 7f410e59c700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40f80a11e0 0x7f40f80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:02.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.848+0000 7f410e59c700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40f80a11e0 0x7f40f80a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4104005950 tx=0x7f41040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:02.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:02.852+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4100096390 con 0x7f41101013e0 2023-12-14T18:24:02.956 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3231433728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101540 msgr2=0x7f6b00101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3231433728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101540 0x7f6b00101910 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009990 tx=0x7f6af4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3231433728 shutdown_connections 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3231433728 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b0010a890 0x7f6b0010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3231433728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101540 0x7f6b00101910 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3231433728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b00101e50 0x7f6b0010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3231433728 >> 172.21.15.69:0/3231433728 conn(0x7f6b000770a0 msgr2=0x7f6b000774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3231433728 shutdown_connections 2023-12-14T18:24:03.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.031+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3231433728 wait complete. 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 Processor -- start 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 -- start start 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b00101540 0x7f6b001963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 0x7f6b00196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b0010a890 0x7f6b0019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0019b390 con 0x7f6b00101e50 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0019b500 con 0x7f6b00101540 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b06f7e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0019b6c0 con 0x7f6b0010a890 2023-12-14T18:24:03.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 0x7f6b00196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 0x7f6b00196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38622/0 (socket says 172.21.15.69:38622) 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 -- 172.21.15.69:0/3476481521 learned_addr learned my addr 172.21.15.69:0/3476481521 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6b04d1a700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b00101540 0x7f6b001963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 -- 172.21.15.69:0/3476481521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b0010a890 msgr2=0x7f6b0019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b0010a890 0x7f6b0019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 -- 172.21.15.69:0/3476481521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b00101540 msgr2=0x7f6b001963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b00101540 0x7f6b001963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 -- 172.21.15.69:0/3476481521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40095f0 con 0x7f6b00101e50 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.032+0000 7f6afffff700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 0x7f6b00196910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00e920 tx=0x7f6aec00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.033+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec009790 con 0x7f6b00101e50 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.033+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6aec00cbd0 con 0x7f6b00101e50 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.033+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b00110210 con 0x7f6b00101e50 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.033+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec018680 con 0x7f6b00101e50 2023-12-14T18:24:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.033+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b00110080 con 0x7f6b00101e50 2023-12-14T18:24:03.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.034+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b001103a0 con 0x7f6b00101e50 2023-12-14T18:24:03.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.035+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6aec00cd40 con 0x7f6b00101e50 2023-12-14T18:24:03.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.035+0000 7f6afdffb700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6af00a11e0 0x7f6af00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:03.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.036+0000 7f6b04d1a700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6af00a11e0 0x7f6af00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:03.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.036+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6aec014070 con 0x7f6b00101e50 2023-12-14T18:24:03.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.036+0000 7f6b04d1a700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6af00a11e0 0x7f6af00a3690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6af400b2e0 tx=0x7f6af4004720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:03.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.043+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6aec096540 con 0x7f6b00101e50 2023-12-14T18:24:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.073+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f41101a3520 con 0x7f41101013e0 2023-12-14T18:24:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.073+0000 7f40f7fff700 1 -- 172.21.15.69:0/3972390064 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4100016020 con 0x7f41101013e0 2023-12-14T18:24:03.074 INFO:teuthology.orchestra.run.smithi069.stdout:103079215148 2023-12-14T18:24:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40f80a11e0 msgr2=0x7f40f80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40f80a11e0 0x7f40f80a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4104005950 tx=0x7f41040058e0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 msgr2=0x7f41101964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 0x7f41101964b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f410000d980 tx=0x7f410000dc90 comp rx=0 tx=0).stop 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 shutdown_connections 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40f80a11e0 0x7f40f80a3690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f411010a900 0x7f411019adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41101013e0 0x7f41101964b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 --2- 172.21.15.69:0/3972390064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4110101cf0 0x7f41101969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 >> 172.21.15.69:0/3972390064 conn(0x7f41100770d0 msgr2=0x7f41100fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.075+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 shutdown_connections 2023-12-14T18:24:03.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.076+0000 7f41151dc700 1 -- 172.21.15.69:0/3972390064 wait complete. 2023-12-14T18:24:03.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.248+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6b00066ea0 con 0x7f6b00101e50 2023-12-14T18:24:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.249+0000 7f6afdffb700 1 -- 172.21.15.69:0/3476481521 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6aec026020 con 0x7f6b00101e50 2023-12-14T18:24:03.250 INFO:teuthology.orchestra.run.smithi069.stdout:133143986217 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6af00a11e0 msgr2=0x7f6af00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6af00a11e0 0x7f6af00a3690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6af400b2e0 tx=0x7f6af4004720 comp rx=0 tx=0).stop 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 msgr2=0x7f6b00196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 0x7f6b00196910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00e920 tx=0x7f6aec00ece0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 shutdown_connections 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6af00a11e0 0x7f6af00a3690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b0010a890 0x7f6b0019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b00101540 0x7f6b001963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 --2- 172.21.15.69:0/3476481521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b00101e50 0x7f6b00196910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:03.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 >> 172.21.15.69:0/3476481521 conn(0x7f6b000770a0 msgr2=0x7f6b000fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:03.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 shutdown_connections 2023-12-14T18:24:03.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:03.251+0000 7f6b06f7e700 1 -- 172.21.15.69:0/3476481521 wait complete. 2023-12-14T18:24:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:03 smithi069 ceph-mon[42047]: pgmap v237: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:03 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2786161656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-14T18:24:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:03 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3972390064' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-14T18:24:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:03 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3476481521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-14T18:24:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:03 smithi119 ceph-mon[43973]: pgmap v237: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:03 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2786161656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-14T18:24:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:03 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3972390064' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-14T18:24:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:03 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3476481521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-14T18:24:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:03 smithi091 ceph-mon[43601]: pgmap v237: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:03 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2786161656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-14T18:24:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:03 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3972390064' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-14T18:24:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:03 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3476481521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-14T18:24:03.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430236 got 206158430238 for osd.7 2023-12-14T18:24:03.973 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:03.994 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593760 got 184683593762 for osd.6 2023-12-14T18:24:03.994 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:04.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986216 got 133143986217 for osd.4 2023-12-14T18:24:04.263 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 -- 172.21.15.69:0/3301433117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ff460 msgr2=0x7fa9d80ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 --2- 172.21.15.69:0/3301433117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ff460 0x7fa9d80ff830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b0d0 tx=0x7fa9d000b3e0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 -- 172.21.15.69:0/3301433117 shutdown_connections 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 --2- 172.21.15.69:0/3301433117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d8104500 0x7fa9d810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 --2- 172.21.15.69:0/3301433117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ff460 0x7fa9d80ff830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 --2- 172.21.15.69:0/3301433117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9d80ffe00 0x7fa9d8103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 -- 172.21.15.69:0/3301433117 >> 172.21.15.69:0/3301433117 conn(0x7fa9d80770a0 msgr2=0x7fa9d80774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 -- 172.21.15.69:0/3301433117 shutdown_connections 2023-12-14T18:24:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 -- 172.21.15.69:0/3301433117 wait complete. 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.378+0000 7fa9df60f700 1 Processor -- start 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 -- start start 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9d80ff460 0x7fa9d8197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 0x7fa9d81978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d8104500 0x7fa9d81a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81981b0 con 0x7fa9d80ffe00 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81a2920 con 0x7fa9d80ff460 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9df60f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81a2a90 con 0x7fa9d8104500 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 0x7fa9d81978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 0x7fa9d81978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38640/0 (socket says 172.21.15.69:38640) 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 -- 172.21.15.69:0/1738005468 learned_addr learned my addr 172.21.15.69:0/1738005468 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dd3ab700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9d80ff460 0x7fa9d8197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9ddbac700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d8104500 0x7fa9d81a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 -- 172.21.15.69:0/1738005468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d8104500 msgr2=0x7fa9d81a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d8104500 0x7fa9d81a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 -- 172.21.15.69:0/1738005468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9d80ff460 msgr2=0x7fa9d8197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9d80ff460 0x7fa9d8197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 -- 172.21.15.69:0/1738005468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0009d00 con 0x7fa9d80ffe00 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9dcbaa700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 0x7fa9d81978a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400e970 tx=0x7fa9d400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.379+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4009790 con 0x7fa9d80ffe00 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.380+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9d400eec0 con 0x7fa9d80ffe00 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.380+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d810f0f0 con 0x7fa9d80ffe00 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.380+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40054b0 con 0x7fa9d80ffe00 2023-12-14T18:24:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.380+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d810ef60 con 0x7fa9d80ffe00 2023-12-14T18:24:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.380+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d810f280 con 0x7fa9d80ffe00 2023-12-14T18:24:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.382+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa9d4005610 con 0x7fa9d80ffe00 2023-12-14T18:24:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.382+0000 7fa9ce7fc700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa9c40a1260 0x7fa9c40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.382+0000 7fa9dd3ab700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa9c40a1260 0x7fa9c40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.382+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa9d4014070 con 0x7fa9d80ffe00 2023-12-14T18:24:04.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.383+0000 7fa9dd3ab700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa9c40a1260 0x7fa9c40a3710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009fd0 tx=0x7fa9d000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.386+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa9d4096420 con 0x7fa9d80ffe00 2023-12-14T18:24:04.546 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972374 got 266287972375 for osd.9 2023-12-14T18:24:04.547 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:04.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.586+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fa9d8066ea0 con 0x7fa9d80ffe00 2023-12-14T18:24:04.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.586+0000 7fa9ce7fc700 1 -- 172.21.15.69:0/1738005468 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fa9d4099a40 con 0x7fa9d80ffe00 2023-12-14T18:24:04.587 INFO:teuthology.orchestra.run.smithi069.stdout:287762808852 2023-12-14T18:24:04.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa9c40a1260 msgr2=0x7fa9c40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:04.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa9c40a1260 0x7fa9c40a3710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009fd0 tx=0x7fa9d000b040 comp rx=0 tx=0).stop 2023-12-14T18:24:04.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 msgr2=0x7fa9d81978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:04.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 0x7fa9d81978a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400e970 tx=0x7fa9d400ec80 comp rx=0 tx=0).stop 2023-12-14T18:24:04.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 shutdown_connections 2023-12-14T18:24:04.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa9c40a1260 0x7fa9c40a3710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d8104500 0x7fa9d81a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9d80ff460 0x7fa9d8197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 --2- 172.21.15.69:0/1738005468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9d80ffe00 0x7fa9d81978a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:04.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 >> 172.21.15.69:0/1738005468 conn(0x7fa9d80770a0 msgr2=0x7fa9d80fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:04.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 shutdown_connections 2023-12-14T18:24:04.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:04.588+0000 7fa9df60f700 1 -- 172.21.15.69:0/1738005468 wait complete. 2023-12-14T18:24:04.672 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:04.821 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215146 got 103079215148 for osd.3 2023-12-14T18:24:04.821 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:04.872 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:05.431 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808849 got 287762808852 for osd.10 2023-12-14T18:24:05.432 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:05.494 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:05.688 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:05 smithi069 ceph-mon[42047]: pgmap v238: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-14T18:24:05.688 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:05 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1738005468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-14T18:24:05.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 -- 172.21.15.69:0/2336364121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 msgr2=0x7fb1a80ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:05.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 --2- 172.21.15.69:0/2336364121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a80ff830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1980099c0 tx=0x7fb198009cd0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 -- 172.21.15.69:0/2336364121 shutdown_connections 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 --2- 172.21.15.69:0/2336364121 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a8104500 0x7fb1a810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 --2- 172.21.15.69:0/2336364121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a80ff830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 --2- 172.21.15.69:0/2336364121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a80ffe00 0x7fb1a8103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 -- 172.21.15.69:0/2336364121 >> 172.21.15.69:0/2336364121 conn(0x7fb1a80770a0 msgr2=0x7fb1a80774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 -- 172.21.15.69:0/2336364121 shutdown_connections 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.722+0000 7fb1acef0700 1 -- 172.21.15.69:0/2336364121 wait complete. 2023-12-14T18:24:05.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 Processor -- start 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 -- start start 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a8196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a80ffe00 0x7fb1a81969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a8104500 0x7fb1a819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a819b440 con 0x7fb1a80ff460 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a819b5b0 con 0x7fb1a80ffe00 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1acef0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a819b770 con 0x7fb1a8104500 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a8196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a8196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37350/0 (socket says 172.21.15.69:37350) 2023-12-14T18:24:05.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.723+0000 7fb1a659c700 1 -- 172.21.15.69:0/217888112 learned_addr learned my addr 172.21.15.69:0/217888112 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb19dd9b700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a80ffe00 0x7fb1a81969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a6d9d700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a8104500 0x7fb1a819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a659c700 1 -- 172.21.15.69:0/217888112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a8104500 msgr2=0x7fb1a819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a659c700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a8104500 0x7fb1a819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a659c700 1 -- 172.21.15.69:0/217888112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a80ffe00 msgr2=0x7fb1a81969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a659c700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a80ffe00 0x7fb1a81969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a659c700 1 -- 172.21.15.69:0/217888112 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980095f0 con 0x7fb1a80ff460 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb19dd9b700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a80ffe00 0x7fb1a81969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a6d9d700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a8104500 0x7fb1a819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:05.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1a659c700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a8196480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c010 tx=0x7fb198003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:05.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19801d070 con 0x7fb1a80ff460 2023-12-14T18:24:05.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a810f1b0 con 0x7fb1a80ff460 2023-12-14T18:24:05.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb198022470 con 0x7fb1a80ff460 2023-12-14T18:24:05.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800f6c0 con 0x7fb1a80ff460 2023-12-14T18:24:05.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.724+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a810f020 con 0x7fb1a80ff460 2023-12-14T18:24:05.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.725+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a810f340 con 0x7fb1a80ff460 2023-12-14T18:24:05.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.726+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb1980225e0 con 0x7fb1a80ff460 2023-12-14T18:24:05.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.727+0000 7fb19ffff700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1940a11e0 0x7fb1940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:05.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.727+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb1980ce250 con 0x7fb1a80ff460 2023-12-14T18:24:05.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.727+0000 7fb19dd9b700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1940a11e0 0x7fb1940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:05.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.727+0000 7fb19dd9b700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1940a11e0 0x7fb1940a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8197aa0 tx=0x7fb190008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:05.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.730+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb198097980 con 0x7fb1a80ff460 2023-12-14T18:24:05.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:05 smithi119 ceph-mon[43973]: pgmap v238: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-14T18:24:05.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:05 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1738005468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-14T18:24:05.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:05 smithi091 ceph-mon[43601]: pgmap v238: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-14T18:24:05.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:05 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1738005468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-14T18:24:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.937+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1a8197840 con 0x7fb1a80ff460 2023-12-14T18:24:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.938+0000 7fb19ffff700 1 -- 172.21.15.69:0/217888112 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb19809afa0 con 0x7fb1a80ff460 2023-12-14T18:24:05.939 INFO:teuthology.orchestra.run.smithi069.stdout:34359738423 2023-12-14T18:24:05.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1940a11e0 msgr2=0x7fb1940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:05.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1940a11e0 0x7fb1940a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8197aa0 tx=0x7fb190008040 comp rx=0 tx=0).stop 2023-12-14T18:24:05.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 msgr2=0x7fb1a8196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:05.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a8196480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c010 tx=0x7fb198003820 comp rx=0 tx=0).stop 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 shutdown_connections 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1940a11e0 0x7fb1940a3690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a8104500 0x7fb1a819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1a80ff460 0x7fb1a8196480 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 --2- 172.21.15.69:0/217888112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a80ffe00 0x7fb1a81969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 >> 172.21.15.69:0/217888112 conn(0x7fb1a80770a0 msgr2=0x7fb1a80686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 shutdown_connections 2023-12-14T18:24:05.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:05.940+0000 7fb1acef0700 1 -- 172.21.15.69:0/217888112 wait complete. 2023-12-14T18:24:06.588 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:06 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/217888112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-14T18:24:06.677 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738421 got 34359738423 for osd.0 2023-12-14T18:24:06.677 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:06.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 -- 172.21.15.69:0/1136516852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df01045d0 msgr2=0x7f5df010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 --2- 172.21.15.69:0/1136516852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df01045d0 0x7f5df010c150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5de800b0d0 tx=0x7f5de800b3e0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 -- 172.21.15.69:0/1136516852 shutdown_connections 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 --2- 172.21.15.69:0/1136516852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df01045d0 0x7f5df010c150 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 --2- 172.21.15.69:0/1136516852 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df00ff530 0x7f5df00ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 --2- 172.21.15.69:0/1136516852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 0x7f5df0103ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 -- 172.21.15.69:0/1136516852 >> 172.21.15.69:0/1136516852 conn(0x7f5df00760d0 msgr2=0x7f5df00764d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 -- 172.21.15.69:0/1136516852 shutdown_connections 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.771+0000 7f5df7c18700 1 -- 172.21.15.69:0/1136516852 wait complete. 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 Processor -- start 2023-12-14T18:24:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 -- start start 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 0x7f5df0100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 0x7f5df0101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df01045d0 0x7f5df0101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a4850 con 0x7f5df00ff530 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a49c0 con 0x7f5df01045d0 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df7c18700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a4b80 con 0x7f5df00ffed0 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df59b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 0x7f5df0100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df59b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 0x7f5df0100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37360/0 (socket says 172.21.15.69:37360) 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df59b4700 1 -- 172.21.15.69:0/3916766117 learned_addr learned my addr 172.21.15.69:0/3916766117 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df61b5700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df01045d0 0x7f5df0101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.772+0000 7f5df51b3700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 0x7f5df0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df59b4700 1 -- 172.21.15.69:0/3916766117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 msgr2=0x7f5df0101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df59b4700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 0x7f5df0101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df59b4700 1 -- 172.21.15.69:0/3916766117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df01045d0 msgr2=0x7f5df0101a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df59b4700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df01045d0 0x7f5df0101a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df59b4700 1 -- 172.21.15.69:0/3916766117 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009d00 con 0x7f5df00ff530 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df51b3700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 0x7f5df0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df61b5700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df01045d0 0x7f5df0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df59b4700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 0x7f5df0100f40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c920 tx=0x7f5dec00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec007b00 con 0x7f5df00ff530 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dec004cc0 con 0x7f5df00ff530 2023-12-14T18:24:06.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df010f1c0 con 0x7f5df00ff530 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec005590 con 0x7f5df00ff530 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.773+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df010f030 con 0x7f5df00ff530 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.774+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df010f350 con 0x7f5df00ff530 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.775+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5dec004750 con 0x7f5df00ff530 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.776+0000 7f5de6ffd700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5ddc0a11e0 0x7f5ddc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.776+0000 7f5df51b3700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5ddc0a11e0 0x7f5ddc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.776+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5dec0cc860 con 0x7f5df00ff530 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.776+0000 7f5df51b3700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5ddc0a11e0 0x7f5ddc0a3690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5df0102730 tx=0x7f5de0005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:06.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.779+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5dec096000 con 0x7f5df00ff530 2023-12-14T18:24:06.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:06 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/217888112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-14T18:24:06.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:06 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/217888112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-14T18:24:06.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.974+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5df0066ea0 con 0x7f5df00ff530 2023-12-14T18:24:06.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.975+0000 7f5de6ffd700 1 -- 172.21.15.69:0/3916766117 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dec01d020 con 0x7f5df00ff530 2023-12-14T18:24:06.976 INFO:teuthology.orchestra.run.smithi069.stdout:55834574901 2023-12-14T18:24:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5ddc0a11e0 msgr2=0x7f5ddc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5ddc0a11e0 0x7f5ddc0a3690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5df0102730 tx=0x7f5de0005db0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 msgr2=0x7f5df0100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 0x7f5df0100f40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c920 tx=0x7f5dec00cce0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 shutdown_connections 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5ddc0a11e0 0x7f5ddc0a3690 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df01045d0 0x7f5df0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df00ff530 0x7f5df0100f40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 --2- 172.21.15.69:0/3916766117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df00ffed0 0x7f5df0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 >> 172.21.15.69:0/3916766117 conn(0x7f5df00760d0 msgr2=0x7f5df0069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 shutdown_connections 2023-12-14T18:24:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:06.977+0000 7f5df7c18700 1 -- 172.21.15.69:0/3916766117 wait complete. 2023-12-14T18:24:07.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:07 smithi069 ceph-mon[42047]: pgmap v239: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:07.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:07 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3916766117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-14T18:24:07.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/763185104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 msgr2=0x7fc3dc105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/763185104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc105660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc009990 tx=0x7fc3cc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/763185104 shutdown_connections 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/763185104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0ff1e0 0x7fc3dc10d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/763185104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc105660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/763185104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3dc0fe830 0x7fc3dc0feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/763185104 >> 172.21.15.69:0/763185104 conn(0x7fc3dc0758a0 msgr2=0x7fc3dc075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/763185104 shutdown_connections 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.757+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/763185104 wait complete. 2023-12-14T18:24:07.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 Processor -- start 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 -- start start 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0fe830 0x7fc3dc1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3dc0ff1e0 0x7fc3dc196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc19b2b0 con 0x7fc3dc105290 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc19b420 con 0x7fc3dc0ff1e0 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3e1b5a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc19b5e0 con 0x7fc3dc0fe830 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc19aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37372/0 (socket says 172.21.15.69:37372) 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3dbfff700 1 -- 172.21.15.69:0/1865600673 learned_addr learned my addr 172.21.15.69:0/1865600673 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:07.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3daffd700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3dc0ff1e0 0x7fc3dc196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.758+0000 7fc3db7fe700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0fe830 0x7fc3dc1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3dbfff700 1 -- 172.21.15.69:0/1865600673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0fe830 msgr2=0x7fc3dc1962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3dbfff700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0fe830 0x7fc3dc1962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3dbfff700 1 -- 172.21.15.69:0/1865600673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3dc0ff1e0 msgr2=0x7fc3dc196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3dbfff700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3dc0ff1e0 0x7fc3dc196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3dbfff700 1 -- 172.21.15.69:0/1865600673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0095f0 con 0x7fc3dc105290 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3db7fe700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0fe830 0x7fc3dc1962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3dbfff700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc19aca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4007ee0 tx=0x7fc3d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4017070 con 0x7fc3dc105290 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc110310 con 0x7fc3dc105290 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3d400f040 con 0x7fc3dc105290 2023-12-14T18:24:07.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4005710 con 0x7fc3dc105290 2023-12-14T18:24:07.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.759+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc110180 con 0x7fc3dc105290 2023-12-14T18:24:07.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.760+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc1104a0 con 0x7fc3dc105290 2023-12-14T18:24:07.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.761+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc3d4005870 con 0x7fc3dc105290 2023-12-14T18:24:07.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.762+0000 7fc3d8ff9700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3c80a11e0 0x7fc3c80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:07.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.762+0000 7fc3db7fe700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3c80a11e0 0x7fc3c80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:07.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.762+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3d40cc100 con 0x7fc3dc105290 2023-12-14T18:24:07.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.762+0000 7fc3db7fe700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3c80a11e0 0x7fc3c80a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00b5c0 tx=0x7fc3cc003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:07.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.768+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc3d40958a0 con 0x7fc3dc105290 2023-12-14T18:24:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:07 smithi119 ceph-mon[43973]: pgmap v239: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:07 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3916766117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-14T18:24:07.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:07 smithi091 ceph-mon[43601]: pgmap v239: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-14T18:24:07.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:07 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3916766117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-14T18:24:07.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.979+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc3dc1a33d0 con 0x7fc3dc105290 2023-12-14T18:24:07.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.979+0000 7fc3d8ff9700 1 -- 172.21.15.69:0/1865600673 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3d4095020 con 0x7fc3dc105290 2023-12-14T18:24:07.981 INFO:teuthology.orchestra.run.smithi069.stdout:154618822695 2023-12-14T18:24:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3c80a11e0 msgr2=0x7fc3c80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3c80a11e0 0x7fc3c80a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00b5c0 tx=0x7fc3cc003680 comp rx=0 tx=0).stop 2023-12-14T18:24:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 msgr2=0x7fc3dc19aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc19aca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4007ee0 tx=0x7fc3d400d3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 shutdown_connections 2023-12-14T18:24:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc3c80a11e0 0x7fc3c80a3690 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3dc105290 0x7fc3dc19aca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3dc0fe830 0x7fc3dc1962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 --2- 172.21.15.69:0/1865600673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3dc0ff1e0 0x7fc3dc196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:07.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 >> 172.21.15.69:0/1865600673 conn(0x7fc3dc0758a0 msgr2=0x7fc3dc0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:07.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 shutdown_connections 2023-12-14T18:24:07.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:07.982+0000 7fc3e1b5a700 1 -- 172.21.15.69:0/1865600673 wait complete. 2023-12-14T18:24:08.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 -- 172.21.15.69:0/4237797638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d480ff9e0 msgr2=0x7f4d4810c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/4237797638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d480ff9e0 0x7f4d4810c740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009990 tx=0x7f4d3c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 -- 172.21.15.69:0/4237797638 shutdown_connections 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/4237797638 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d4810cc80 0x7f4d4810f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/4237797638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d480ff0d0 0x7f4d480ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/4237797638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d480ff9e0 0x7f4d4810c740 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 -- 172.21.15.69:0/4237797638 >> 172.21.15.69:0/4237797638 conn(0x7f4d480770a0 msgr2=0x7f4d480774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 -- 172.21.15.69:0/4237797638 shutdown_connections 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 -- 172.21.15.69:0/4237797638 wait complete. 2023-12-14T18:24:08.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.205+0000 7f4d4e58a700 1 Processor -- start 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 -- start start 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d480ff0d0 0x7f4d481986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d480ff9e0 0x7f4d48198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 0x7f4d4819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4819c580 con 0x7f4d4810cc80 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4819c6f0 con 0x7f4d480ff9e0 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4e58a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4819c8b0 con 0x7f4d480ff0d0 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 0x7f4d4819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 0x7f4d4819bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37400/0 (socket says 172.21.15.69:37400) 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 -- 172.21.15.69:0/2988276804 learned_addr learned my addr 172.21.15.69:0/2988276804 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:08.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d47fff700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d480ff0d0 0x7f4d481986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d477fe700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d480ff9e0 0x7f4d48198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 -- 172.21.15.69:0/2988276804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d480ff0d0 msgr2=0x7f4d481986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d480ff0d0 0x7f4d481986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 -- 172.21.15.69:0/2988276804 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d480ff9e0 msgr2=0x7f4d48198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d480ff9e0 0x7f4d48198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.206+0000 7f4d4cb27700 1 -- 172.21.15.69:0/2988276804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0095f0 con 0x7f4d4810cc80 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.207+0000 7f4d4cb27700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 0x7f4d4819bf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000b9e0 tx=0x7f4d4000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.207+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000d8e0 con 0x7f4d4810cc80 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.207+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d40015420 con 0x7f4d4810cc80 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.207+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d481124f0 con 0x7f4d4810cc80 2023-12-14T18:24:08.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.207+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000c660 con 0x7f4d4810cc80 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.207+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d48112360 con 0x7f4d4810cc80 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.208+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d48112680 con 0x7f4d4810cc80 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.209+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4d40015590 con 0x7f4d4810cc80 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.210+0000 7f4d457fa700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d300a11e0 0x7f4d300a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.210+0000 7f4d47fff700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d300a11e0 0x7f4d300a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.210+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d40011070 con 0x7f4d4810cc80 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.210+0000 7f4d47fff700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d300a11e0 0x7f4d300a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009a10 tx=0x7f4d38009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.213+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4d40095f50 con 0x7f4d4810cc80 2023-12-14T18:24:08.307 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574899 got 55834574901 for osd.1 2023-12-14T18:24:08.307 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:08.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 -- 172.21.15.69:0/648501816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 msgr2=0x7f410010ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 --2- 172.21.15.69:0/648501816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410010ccd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b0a0 tx=0x7f40f800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 -- 172.21.15.69:0/648501816 shutdown_connections 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 --2- 172.21.15.69:0/648501816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410010ccd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 --2- 172.21.15.69:0/648501816 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4100101540 0x7f4100101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 --2- 172.21.15.69:0/648501816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 0x7f410010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 -- 172.21.15.69:0/648501816 >> 172.21.15.69:0/648501816 conn(0x7f41000770a0 msgr2=0x7f41000774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 -- 172.21.15.69:0/648501816 shutdown_connections 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.179+0000 7f4106623700 1 -- 172.21.15.69:0/648501816 wait complete. 2023-12-14T18:24:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 Processor -- start 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 -- start start 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4100101540 0x7f4100196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 0x7f41001969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410019b420 con 0x7f410010a890 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410019b590 con 0x7f4100101540 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4106623700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410019b750 con 0x7f4100101e50 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4104bc0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4104bc0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37382/0 (socket says 172.21.15.69:37382) 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.180+0000 7f4104bc0700 1 -- 172.21.15.69:0/239516394 learned_addr learned my addr 172.21.15.69:0/239516394 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f40fffff700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4100101540 0x7f4100196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f40ff7fe700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 0x7f41001969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4104bc0700 1 -- 172.21.15.69:0/239516394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 msgr2=0x7f41001969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4104bc0700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 0x7f41001969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4104bc0700 1 -- 172.21.15.69:0/239516394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4100101540 msgr2=0x7f4100196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4104bc0700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4100101540 0x7f4100196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4104bc0700 1 -- 172.21.15.69:0/239516394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8009d00 con 0x7f410010a890 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f40ff7fe700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 0x7f41001969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4104bc0700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410019ae10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b830 tx=0x7f40f80094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800e040 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40f8003e90 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f801d480 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41001101b0 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.181+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4100110020 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.182+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4100110340 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.184+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f40f8003a00 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.185+0000 7f40fd7fa700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40e80a11e0 0x7f40e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.185+0000 7f40fffff700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40e80a11e0 0x7f40e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.185+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f40f80ce6d0 con 0x7f410010a890 2023-12-14T18:24:08.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.185+0000 7f40fffff700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40e80a11e0 0x7f40e80a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40f0005950 tx=0x7f40f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.187+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f40f8097f00 con 0x7f410010a890 2023-12-14T18:24:08.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.394+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f4100066ea0 con 0x7f410010a890 2023-12-14T18:24:08.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.394+0000 7f40fd7fa700 1 -- 172.21.15.69:0/239516394 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f40f809b520 con 0x7f410010a890 2023-12-14T18:24:08.395 INFO:teuthology.orchestra.run.smithi069.stdout:317827579921 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40e80a11e0 msgr2=0x7f40e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40e80a11e0 0x7f40e80a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40f0005950 tx=0x7f40f000b410 comp rx=0 tx=0).stop 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 msgr2=0x7f410019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410019ae10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b830 tx=0x7f40f80094e0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 shutdown_connections 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f40e80a11e0 0x7f40e80a3690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f410010a890 0x7f410019ae10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4100101540 0x7f4100196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.396+0000 7f4106623700 1 --2- 172.21.15.69:0/239516394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4100101e50 0x7f41001969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.397+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 >> 172.21.15.69:0/239516394 conn(0x7f41000770a0 msgr2=0x7f41000fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:08.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.397+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 shutdown_connections 2023-12-14T18:24:08.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.397+0000 7f4106623700 1 -- 172.21.15.69:0/239516394 wait complete. 2023-12-14T18:24:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.416+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f4d48066ea0 con 0x7f4d4810cc80 2023-12-14T18:24:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.416+0000 7f4d457fa700 1 -- 172.21.15.69:0/2988276804 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d40099570 con 0x7f4d4810cc80 2023-12-14T18:24:08.417 INFO:teuthology.orchestra.run.smithi069.stdout:236223201308 2023-12-14T18:24:08.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d300a11e0 msgr2=0x7f4d300a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d300a11e0 0x7f4d300a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009a10 tx=0x7f4d38009190 comp rx=0 tx=0).stop 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 msgr2=0x7f4d4819bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 0x7f4d4819bf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000b9e0 tx=0x7f4d4000bcf0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 shutdown_connections 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d300a11e0 0x7f4d300a3690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4810cc80 0x7f4d4819bf80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d480ff0d0 0x7f4d481986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 --2- 172.21.15.69:0/2988276804 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d480ff9e0 0x7f4d48198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 >> 172.21.15.69:0/2988276804 conn(0x7f4d480770a0 msgr2=0x7f4d4810e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 shutdown_connections 2023-12-14T18:24:08.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:08.418+0000 7f4d4e58a700 1 -- 172.21.15.69:0/2988276804 wait complete. 2023-12-14T18:24:08.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:08 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1865600673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-14T18:24:08.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:08 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/239516394' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-14T18:24:08.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:08 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2988276804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-14T18:24:08.622 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822693 got 154618822695 for osd.5 2023-12-14T18:24:08.622 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:08 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1865600673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-14T18:24:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:08 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/239516394' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-14T18:24:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:08 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2988276804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-14T18:24:08.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:08 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1865600673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-14T18:24:08.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:08 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/239516394' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-14T18:24:08.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:08 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2988276804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-14T18:24:09.114 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579920 got 317827579921 for osd.11 2023-12-14T18:24:09.115 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:09.155 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201306 got 236223201308 for osd.8 2023-12-14T18:24:09.155 DEBUG:teuthology.parallel:result is None 2023-12-14T18:24:09.155 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-14T18:24:09.156 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-14T18:24:09.476 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:09.760 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:09 smithi069 ceph-mon[42047]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T18:24:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:09 smithi119 ceph-mon[43973]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T18:24:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:09 smithi091 ceph-mon[43601]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-14T18:24:10.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 -- 172.21.15.69:0/1239410981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100ef0 msgr2=0x7f9c2c104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:10.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 --2- 172.21.15.69:0/1239410981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100ef0 0x7f9c2c104ec0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c280099c0 tx=0x7f9c28009cd0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 -- 172.21.15.69:0/1239410981 shutdown_connections 2023-12-14T18:24:10.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 --2- 172.21.15.69:0/1239410981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c2c1055f0 0x7f9c2c10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 --2- 172.21.15.69:0/1239410981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c100550 0x7f9c2c100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 --2- 172.21.15.69:0/1239410981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100ef0 0x7f9c2c104ec0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 -- 172.21.15.69:0/1239410981 >> 172.21.15.69:0/1239410981 conn(0x7f9c2c0fbdb0 msgr2=0x7f9c2c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 -- 172.21.15.69:0/1239410981 shutdown_connections 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.509+0000 7f9c33993700 1 -- 172.21.15.69:0/1239410981 wait complete. 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 Processor -- start 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 -- start start 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 0x7f9c2c072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c2c100ef0 0x7f9c2c073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c1055f0 0x7f9c2c0738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1a4820 con 0x7f9c2c100550 2023-12-14T18:24:10.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1a4990 con 0x7f9c2c100ef0 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c33993700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1a4b50 con 0x7f9c2c1055f0 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 0x7f9c2c072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 0x7f9c2c072df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37422/0 (socket says 172.21.15.69:37422) 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 -- 172.21.15.69:0/160017563 learned_addr learned my addr 172.21.15.69:0/160017563 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c30f2e700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c2c100ef0 0x7f9c2c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 -- 172.21.15.69:0/160017563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c1055f0 msgr2=0x7f9c2c0738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c1055f0 0x7f9c2c0738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 -- 172.21.15.69:0/160017563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c2c100ef0 msgr2=0x7f9c2c073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c2c100ef0 0x7f9c2c073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.510+0000 7f9c3172f700 1 -- 172.21.15.69:0/160017563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280095f0 con 0x7f9c2c100550 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.511+0000 7f9c3172f700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 0x7f9c2c072df0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000b530 tx=0x7f9c2000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.511+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20011830 con 0x7f9c2c100550 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.511+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c20011e20 con 0x7f9c2c100550 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.511+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c110230 con 0x7f9c2c100550 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.511+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000f2e0 con 0x7f9c2c100550 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.511+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c1100a0 con 0x7f9c2c100550 2023-12-14T18:24:10.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.512+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c1103c0 con 0x7f9c2c100550 2023-12-14T18:24:10.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.513+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9c20011990 con 0x7f9c2c100550 2023-12-14T18:24:10.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.513+0000 7f9c1e7fc700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9c180a1260 0x7f9c180a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:10.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.513+0000 7f9c30f2e700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9c180a1260 0x7f9c180a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:10.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.514+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9c200cc430 con 0x7f9c2c100550 2023-12-14T18:24:10.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.514+0000 7f9c30f2e700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9c180a1260 0x7f9c180a3710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006010 tx=0x7f9c28009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:10.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.518+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9c20095be0 con 0x7f9c2c100550 2023-12-14T18:24:10.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.715+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c2c0fd0a0 con 0x7f9c180a1260 2023-12-14T18:24:10.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.724+0000 7f9c1e7fc700 1 -- 172.21.15.69:0/160017563 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340877 (secure 0 0 0) 0x7f9c2c0fd0a0 con 0x7f9c180a1260 2023-12-14T18:24:10.732 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:10.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9c180a1260 msgr2=0x7f9c180a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:10.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9c180a1260 0x7f9c180a3710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006010 tx=0x7f9c28009f10 comp rx=0 tx=0).stop 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 msgr2=0x7f9c2c072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 0x7f9c2c072df0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000b530 tx=0x7f9c2000b840 comp rx=0 tx=0).stop 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 shutdown_connections 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9c180a1260 0x7f9c180a3710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c1055f0 0x7f9c2c0738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c2c100550 0x7f9c2c072df0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 --2- 172.21.15.69:0/160017563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c2c100ef0 0x7f9c2c073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 >> 172.21.15.69:0/160017563 conn(0x7f9c2c0fbdb0 msgr2=0x7f9c2c0fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 shutdown_connections 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:10.727+0000 7f9c33993700 1 -- 172.21.15.69:0/160017563 wait complete. 2023-12-14T18:24:10.736 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:24:11.112 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2023-12-14T18:24:10.244034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651149,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":358,"num_read_kb":287,"num_write":333,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79512,"kb_used_data":12088,"kb_used_omap":0,"kb_used_meta":67328,"kb_avail":1124862312,"statfs":{"total":1151940427776,"available":1151859007488,"internally_reserved":0,"allocated":12378112,"data_stored":6859643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68943872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002822"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007441+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:23:32.007441+0000","last_peered":"2023-12-14T18:23:32.007441+0000","last_clean":"2023-12-14T18:23:32.007441+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:23:32.007441+0000","last_undegraded":"2023-12-14T18:23:32.007441+0000","last_fullsized":"2023-12-14T18:23:32.007441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:36:32.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963017+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:23:31.963017+0000","last_peered":"2023-12-14T18:23:31.963017+0000","last_clean":"2023-12-14T18:23:31.963017+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:23:31.963017+0000","last_undegraded":"2023-12-14T18:23:31.963017+0000","last_fullsized":"2023-12-14T18:23:31.963017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:53:14.564046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962969+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:23:31.962969+0000","last_peered":"2023-12-14T18:23:31.962969+0000","last_clean":"2023-12-14T18:23:31.962969+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:23:31.962969+0000","last_undegraded":"2023-12-14T18:23:31.962969+0000","last_fullsized":"2023-12-14T18:23:31.962969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:55:45.247027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964402+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:23:31.964402+0000","last_peered":"2023-12-14T18:23:31.964402+0000","last_clean":"2023-12-14T18:23:31.964402+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:23:31.964402+0000","last_undegraded":"2023-12-14T18:23:31.964402+0000","last_fullsized":"2023-12-14T18:23:31.964402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:33.555138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298752+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:23:30.298752+0000","last_peered":"2023-12-14T18:23:30.298752+0000","last_clean":"2023-12-14T18:23:30.298752+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:23:30.298752+0000","last_undegraded":"2023-12-14T18:23:30.298752+0000","last_fullsized":"2023-12-14T18:23:30.298752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:45.744707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964734+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:23:31.964734+0000","last_peered":"2023-12-14T18:23:31.964734+0000","last_clean":"2023-12-14T18:23:31.964734+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:23:31.964734+0000","last_undegraded":"2023-12-14T18:23:31.964734+0000","last_fullsized":"2023-12-14T18:23:31.964734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:56:29.640721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963441+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:23:31.963441+0000","last_peered":"2023-12-14T18:23:31.963441+0000","last_clean":"2023-12-14T18:23:31.963441+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:23:31.963441+0000","last_undegraded":"2023-12-14T18:23:31.963441+0000","last_fullsized":"2023-12-14T18:23:31.963441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:29:53.508232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962583+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:23:31.962583+0000","last_peered":"2023-12-14T18:23:31.962583+0000","last_clean":"2023-12-14T18:23:31.962583+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:23:31.962583+0000","last_undegraded":"2023-12-14T18:23:31.962583+0000","last_fullsized":"2023-12-14T18:23:31.962583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:39:26.030240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298994+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:23:30.298994+0000","last_peered":"2023-12-14T18:23:30.298994+0000","last_clean":"2023-12-14T18:23:30.298994+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:23:30.298994+0000","last_undegraded":"2023-12-14T18:23:30.298994+0000","last_fullsized":"2023-12-14T18:23:30.298994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:53:45.531715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964560+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:23:31.964560+0000","last_peered":"2023-12-14T18:23:31.964560+0000","last_clean":"2023-12-14T18:23:31.964560+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:23:31.964560+0000","last_undegraded":"2023-12-14T18:23:31.964560+0000","last_fullsized":"2023-12-14T18:23:31.964560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:00.231623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963488+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:23:31.963488+0000","last_peered":"2023-12-14T18:23:31.963488+0000","last_clean":"2023-12-14T18:23:31.963488+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:23:31.963488+0000","last_undegraded":"2023-12-14T18:23:31.963488+0000","last_fullsized":"2023-12-14T18:23:31.963488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:19:41.156980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964275+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:23:31.964275+0000","last_peered":"2023-12-14T18:23:31.964275+0000","last_clean":"2023-12-14T18:23:31.964275+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:23:31.964275+0000","last_undegraded":"2023-12-14T18:23:31.964275+0000","last_fullsized":"2023-12-14T18:23:31.964275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:34:33.441932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297890+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:23:30.297890+0000","last_peered":"2023-12-14T18:23:30.297890+0000","last_clean":"2023-12-14T18:23:30.297890+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:23:30.297890+0000","last_undegraded":"2023-12-14T18:23:30.297890+0000","last_fullsized":"2023-12-14T18:23:30.297890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:59.839011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963183+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:23:31.963183+0000","last_peered":"2023-12-14T18:23:31.963183+0000","last_clean":"2023-12-14T18:23:31.963183+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:23:31.963183+0000","last_undegraded":"2023-12-14T18:23:31.963183+0000","last_fullsized":"2023-12-14T18:23:31.963183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:23:22.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962782+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:23:31.962782+0000","last_peered":"2023-12-14T18:23:31.962782+0000","last_clean":"2023-12-14T18:23:31.962782+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:23:31.962782+0000","last_undegraded":"2023-12-14T18:23:31.962782+0000","last_fullsized":"2023-12-14T18:23:31.962782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:13.104079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298442+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:23:30.298442+0000","last_peered":"2023-12-14T18:23:30.298442+0000","last_clean":"2023-12-14T18:23:30.298442+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:23:30.298442+0000","last_undegraded":"2023-12-14T18:23:30.298442+0000","last_fullsized":"2023-12-14T18:23:30.298442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:57.579587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007603+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:23:32.007603+0000","last_peered":"2023-12-14T18:23:32.007603+0000","last_clean":"2023-12-14T18:23:32.007603+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:23:32.007603+0000","last_undegraded":"2023-12-14T18:23:32.007603+0000","last_fullsized":"2023-12-14T18:23:32.007603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:08.141970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217912+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:23:31.217912+0000","last_peered":"2023-12-14T18:23:31.217912+0000","last_clean":"2023-12-14T18:23:31.217912+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:23:31.217912+0000","last_undegraded":"2023-12-14T18:23:31.217912+0000","last_fullsized":"2023-12-14T18:23:31.217912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:37.822774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513258+0000","last_change":"2023-12-14T18:23:29.320811+0000","last_active":"2023-12-14T18:23:31.513258+0000","last_peered":"2023-12-14T18:23:31.513258+0000","last_clean":"2023-12-14T18:23:31.513258+0000","last_became_active":"2023-12-14T18:23:29.315538+0000","last_became_peered":"2023-12-14T18:23:29.315538+0000","last_unstale":"2023-12-14T18:23:31.513258+0000","last_undegraded":"2023-12-14T18:23:31.513258+0000","last_fullsized":"2023-12-14T18:23:31.513258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:26:01.785017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.333714+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:23:33.333714+0000","last_peered":"2023-12-14T18:23:33.333714+0000","last_clean":"2023-12-14T18:23:33.333714+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:23:33.333714+0000","last_undegraded":"2023-12-14T18:23:33.333714+0000","last_fullsized":"2023-12-14T18:23:33.333714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:15:49.986514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962770+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:23:31.962770+0000","last_peered":"2023-12-14T18:23:31.962770+0000","last_clean":"2023-12-14T18:23:31.962770+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:23:31.962770+0000","last_undegraded":"2023-12-14T18:23:31.962770+0000","last_fullsized":"2023-12-14T18:23:31.962770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:10.086046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962978+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:23:31.962978+0000","last_peered":"2023-12-14T18:23:31.962978+0000","last_clean":"2023-12-14T18:23:31.962978+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:23:31.962978+0000","last_undegraded":"2023-12-14T18:23:31.962978+0000","last_fullsized":"2023-12-14T18:23:31.962978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:08:25.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963326+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:23:31.963326+0000","last_peered":"2023-12-14T18:23:31.963326+0000","last_clean":"2023-12-14T18:23:31.963326+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:23:31.963326+0000","last_undegraded":"2023-12-14T18:23:31.963326+0000","last_fullsized":"2023-12-14T18:23:31.963326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:09:13.088758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332104+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:23:33.332104+0000","last_peered":"2023-12-14T18:23:33.332104+0000","last_clean":"2023-12-14T18:23:33.332104+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:23:33.332104+0000","last_undegraded":"2023-12-14T18:23:33.332104+0000","last_fullsized":"2023-12-14T18:23:33.332104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:29:10.775688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298727+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:23:30.298727+0000","last_peered":"2023-12-14T18:23:30.298727+0000","last_clean":"2023-12-14T18:23:30.298727+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:23:30.298727+0000","last_undegraded":"2023-12-14T18:23:30.298727+0000","last_fullsized":"2023-12-14T18:23:30.298727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:08.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299162+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:23:30.299162+0000","last_peered":"2023-12-14T18:23:30.299162+0000","last_clean":"2023-12-14T18:23:30.299162+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:23:30.299162+0000","last_undegraded":"2023-12-14T18:23:30.299162+0000","last_fullsized":"2023-12-14T18:23:30.299162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:16.688070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862680+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:23:30.862680+0000","last_peered":"2023-12-14T18:23:30.862680+0000","last_clean":"2023-12-14T18:23:30.862680+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:23:30.862680+0000","last_undegraded":"2023-12-14T18:23:30.862680+0000","last_fullsized":"2023-12-14T18:23:30.862680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:38.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:08.398184+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:24:08.398184+0000","last_peered":"2023-12-14T18:24:08.398184+0000","last_clean":"2023-12-14T18:24:08.398184+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:24:08.398184+0000","last_undegraded":"2023-12-14T18:24:08.398184+0000","last_fullsized":"2023-12-14T18:24:08.398184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:41.803316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298872+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:23:30.298872+0000","last_peered":"2023-12-14T18:23:30.298872+0000","last_clean":"2023-12-14T18:23:30.298872+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:23:30.298872+0000","last_undegraded":"2023-12-14T18:23:30.298872+0000","last_fullsized":"2023-12-14T18:23:30.298872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:00:06.468221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332593+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:23:33.332593+0000","last_peered":"2023-12-14T18:23:33.332593+0000","last_clean":"2023-12-14T18:23:33.332593+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:23:33.332593+0000","last_undegraded":"2023-12-14T18:23:33.332593+0000","last_fullsized":"2023-12-14T18:23:33.332593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:38:50.312141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862519+0000","last_change":"2023-12-14T18:23:29.314941+0000","last_active":"2023-12-14T18:23:30.862519+0000","last_peered":"2023-12-14T18:23:30.862519+0000","last_clean":"2023-12-14T18:23:30.862519+0000","last_became_active":"2023-12-14T18:23:29.314508+0000","last_became_peered":"2023-12-14T18:23:29.314508+0000","last_unstale":"2023-12-14T18:23:30.862519+0000","last_undegraded":"2023-12-14T18:23:30.862519+0000","last_fullsized":"2023-12-14T18:23:30.862519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:06:11.981373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332330+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:23:33.332330+0000","last_peered":"2023-12-14T18:23:33.332330+0000","last_clean":"2023-12-14T18:23:33.332330+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:23:33.332330+0000","last_undegraded":"2023-12-14T18:23:33.332330+0000","last_fullsized":"2023-12-14T18:23:33.332330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:53.112965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962525+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:23:31.962525+0000","last_peered":"2023-12-14T18:23:31.962525+0000","last_clean":"2023-12-14T18:23:31.962525+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:23:31.962525+0000","last_undegraded":"2023-12-14T18:23:31.962525+0000","last_fullsized":"2023-12-14T18:23:31.962525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:56.891103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862356+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:23:30.862356+0000","last_peered":"2023-12-14T18:23:30.862356+0000","last_clean":"2023-12-14T18:23:30.862356+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:23:30.862356+0000","last_undegraded":"2023-12-14T18:23:30.862356+0000","last_fullsized":"2023-12-14T18:23:30.862356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:02:39.786052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217715+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:23:31.217715+0000","last_peered":"2023-12-14T18:23:31.217715+0000","last_clean":"2023-12-14T18:23:31.217715+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:23:31.217715+0000","last_undegraded":"2023-12-14T18:23:31.217715+0000","last_fullsized":"2023-12-14T18:23:31.217715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:40:20.784196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:06.394422+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:24:06.394422+0000","last_peered":"2023-12-14T18:24:06.394422+0000","last_clean":"2023-12-14T18:24:06.394422+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:24:06.394422+0000","last_undegraded":"2023-12-14T18:24:06.394422+0000","last_fullsized":"2023-12-14T18:24:06.394422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:52:10.663306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:47.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321675+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:23:32.321675+0000","last_peered":"2023-12-14T18:23:32.321675+0000","last_clean":"2023-12-14T18:23:32.321675+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:23:32.321675+0000","last_undegraded":"2023-12-14T18:23:32.321675+0000","last_fullsized":"2023-12-14T18:23:32.321675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:07.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963309+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:23:31.963309+0000","last_peered":"2023-12-14T18:23:31.963309+0000","last_clean":"2023-12-14T18:23:31.963309+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:23:31.963309+0000","last_undegraded":"2023-12-14T18:23:31.963309+0000","last_fullsized":"2023-12-14T18:23:31.963309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:30.502067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321701+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:23:32.321701+0000","last_peered":"2023-12-14T18:23:32.321701+0000","last_clean":"2023-12-14T18:23:32.321701+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:23:32.321701+0000","last_undegraded":"2023-12-14T18:23:32.321701+0000","last_fullsized":"2023-12-14T18:23:32.321701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:01:37.437148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298957+0000","last_change":"2023-12-14T18:23:29.311912+0000","last_active":"2023-12-14T18:23:30.298957+0000","last_peered":"2023-12-14T18:23:30.298957+0000","last_clean":"2023-12-14T18:23:30.298957+0000","last_became_active":"2023-12-14T18:23:29.310752+0000","last_became_peered":"2023-12-14T18:23:29.310752+0000","last_unstale":"2023-12-14T18:23:30.298957+0000","last_undegraded":"2023-12-14T18:23:30.298957+0000","last_fullsized":"2023-12-14T18:23:30.298957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:29:06.495199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'27","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:07.400829+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:24:07.400829+0000","last_peered":"2023-12-14T18:24:07.400829+0000","last_clean":"2023-12-14T18:24:07.400829+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:24:07.400829+0000","last_undegraded":"2023-12-14T18:24:07.400829+0000","last_fullsized":"2023-12-14T18:24:07.400829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:01.303699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":91,"num_write":28,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299079+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:23:30.299079+0000","last_peered":"2023-12-14T18:23:30.299079+0000","last_clean":"2023-12-14T18:23:30.299079+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:23:30.299079+0000","last_undegraded":"2023-12-14T18:23:30.299079+0000","last_fullsized":"2023-12-14T18:23:30.299079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:03.844259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332293+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:23:33.332293+0000","last_peered":"2023-12-14T18:23:33.332293+0000","last_clean":"2023-12-14T18:23:33.332293+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:23:33.332293+0000","last_undegraded":"2023-12-14T18:23:33.332293+0000","last_fullsized":"2023-12-14T18:23:33.332293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:16:46.098127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297832+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:23:30.297832+0000","last_peered":"2023-12-14T18:23:30.297832+0000","last_clean":"2023-12-14T18:23:30.297832+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:23:30.297832+0000","last_undegraded":"2023-12-14T18:23:30.297832+0000","last_fullsized":"2023-12-14T18:23:30.297832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:06:04.096044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321149+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:23:32.321149+0000","last_peered":"2023-12-14T18:23:32.321149+0000","last_clean":"2023-12-14T18:23:32.321149+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:23:32.321149+0000","last_undegraded":"2023-12-14T18:23:32.321149+0000","last_fullsized":"2023-12-14T18:23:32.321149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:28:23.739941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964105+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:23:31.964105+0000","last_peered":"2023-12-14T18:23:31.964105+0000","last_clean":"2023-12-14T18:23:31.964105+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:23:31.964105+0000","last_undegraded":"2023-12-14T18:23:31.964105+0000","last_fullsized":"2023-12-14T18:23:31.964105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:55:38.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:05.398629+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:24:05.398629+0000","last_peered":"2023-12-14T18:24:05.398629+0000","last_clean":"2023-12-14T18:24:05.398629+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:24:05.398629+0000","last_undegraded":"2023-12-14T18:24:05.398629+0000","last_fullsized":"2023-12-14T18:24:05.398629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:17:49.846098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963126+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:23:31.963126+0000","last_peered":"2023-12-14T18:23:31.963126+0000","last_clean":"2023-12-14T18:23:31.963126+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:23:31.963126+0000","last_undegraded":"2023-12-14T18:23:31.963126+0000","last_fullsized":"2023-12-14T18:23:31.963126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:38:37.985717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.334587+0000","last_change":"2023-12-14T18:23:28.904227+0000","last_active":"2023-12-14T18:23:33.334587+0000","last_peered":"2023-12-14T18:23:33.334587+0000","last_clean":"2023-12-14T18:23:33.334587+0000","last_became_active":"2023-12-14T18:23:28.903844+0000","last_became_peered":"2023-12-14T18:23:28.903844+0000","last_unstale":"2023-12-14T18:23:33.334587+0000","last_undegraded":"2023-12-14T18:23:33.334587+0000","last_fullsized":"2023-12-14T18:23:33.334587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:03:09.233743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862403+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:23:30.862403+0000","last_peered":"2023-12-14T18:23:30.862403+0000","last_clean":"2023-12-14T18:23:30.862403+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:23:30.862403+0000","last_undegraded":"2023-12-14T18:23:30.862403+0000","last_fullsized":"2023-12-14T18:23:30.862403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:06:02.516476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:34.344874+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:23:34.344874+0000","last_peered":"2023-12-14T18:23:34.344874+0000","last_clean":"2023-12-14T18:23:34.344874+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:23:34.344874+0000","last_undegraded":"2023-12-14T18:23:34.344874+0000","last_fullsized":"2023-12-14T18:23:34.344874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:49:05.274081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007430+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:23:32.007430+0000","last_peered":"2023-12-14T18:23:32.007430+0000","last_clean":"2023-12-14T18:23:32.007430+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:23:32.007430+0000","last_undegraded":"2023-12-14T18:23:32.007430+0000","last_fullsized":"2023-12-14T18:23:32.007430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:20:31.928572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217770+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:23:31.217770+0000","last_peered":"2023-12-14T18:23:31.217770+0000","last_clean":"2023-12-14T18:23:31.217770+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:23:31.217770+0000","last_undegraded":"2023-12-14T18:23:31.217770+0000","last_fullsized":"2023-12-14T18:23:31.217770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:41:07.717205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.646131+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:23:32.646131+0000","last_peered":"2023-12-14T18:23:32.646131+0000","last_clean":"2023-12-14T18:23:32.646131+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:23:32.646131+0000","last_undegraded":"2023-12-14T18:23:32.646131+0000","last_fullsized":"2023-12-14T18:23:32.646131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:14.386800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965740+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:23:31.965740+0000","last_peered":"2023-12-14T18:23:31.965740+0000","last_clean":"2023-12-14T18:23:31.965740+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:23:31.965740+0000","last_undegraded":"2023-12-14T18:23:31.965740+0000","last_fullsized":"2023-12-14T18:23:31.965740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:04.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964456+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:23:31.964456+0000","last_peered":"2023-12-14T18:23:31.964456+0000","last_clean":"2023-12-14T18:23:31.964456+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:23:31.964456+0000","last_undegraded":"2023-12-14T18:23:31.964456+0000","last_fullsized":"2023-12-14T18:23:31.964456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:44.704602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862512+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:23:30.862512+0000","last_peered":"2023-12-14T18:23:30.862512+0000","last_clean":"2023-12-14T18:23:30.862512+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:23:30.862512+0000","last_undegraded":"2023-12-14T18:23:30.862512+0000","last_fullsized":"2023-12-14T18:23:30.862512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:26:23.141463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:05.397864+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:24:05.397864+0000","last_peered":"2023-12-14T18:24:05.397864+0000","last_clean":"2023-12-14T18:24:05.397864+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:24:05.397864+0000","last_undegraded":"2023-12-14T18:24:05.397864+0000","last_fullsized":"2023-12-14T18:24:05.397864+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:05.438111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963266+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:23:31.963266+0000","last_peered":"2023-12-14T18:23:31.963266+0000","last_clean":"2023-12-14T18:23:31.963266+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:23:31.963266+0000","last_undegraded":"2023-12-14T18:23:31.963266+0000","last_fullsized":"2023-12-14T18:23:31.963266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:15:26.892489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:34.343096+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:23:34.343096+0000","last_peered":"2023-12-14T18:23:34.343096+0000","last_clean":"2023-12-14T18:23:34.343096+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:23:34.343096+0000","last_undegraded":"2023-12-14T18:23:34.343096+0000","last_fullsized":"2023-12-14T18:23:34.343096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:20.683055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963247+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:23:31.963247+0000","last_peered":"2023-12-14T18:23:31.963247+0000","last_clean":"2023-12-14T18:23:31.963247+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:23:31.963247+0000","last_undegraded":"2023-12-14T18:23:31.963247+0000","last_fullsized":"2023-12-14T18:23:31.963247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:25:43.576640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297606+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:23:30.297606+0000","last_peered":"2023-12-14T18:23:30.297606+0000","last_clean":"2023-12-14T18:23:30.297606+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:23:30.297606+0000","last_undegraded":"2023-12-14T18:23:30.297606+0000","last_fullsized":"2023-12-14T18:23:30.297606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:42.044013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332781+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:23:33.332781+0000","last_peered":"2023-12-14T18:23:33.332781+0000","last_clean":"2023-12-14T18:23:33.332781+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:23:33.332781+0000","last_undegraded":"2023-12-14T18:23:33.332781+0000","last_fullsized":"2023-12-14T18:23:33.332781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:18.549174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321295+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:23:32.321295+0000","last_peered":"2023-12-14T18:23:32.321295+0000","last_clean":"2023-12-14T18:23:32.321295+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:23:32.321295+0000","last_undegraded":"2023-12-14T18:23:32.321295+0000","last_fullsized":"2023-12-14T18:23:32.321295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:59:20.753750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297936+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:23:30.297936+0000","last_peered":"2023-12-14T18:23:30.297936+0000","last_clean":"2023-12-14T18:23:30.297936+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:23:30.297936+0000","last_undegraded":"2023-12-14T18:23:30.297936+0000","last_fullsized":"2023-12-14T18:23:30.297936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:42.595546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:38.613650+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:23:38.613650+0000","last_peered":"2023-12-14T18:23:38.613650+0000","last_clean":"2023-12-14T18:23:38.613650+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:23:38.613650+0000","last_undegraded":"2023-12-14T18:23:38.613650+0000","last_fullsized":"2023-12-14T18:23:38.613650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:48:44.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963156+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:23:31.963156+0000","last_peered":"2023-12-14T18:23:31.963156+0000","last_clean":"2023-12-14T18:23:31.963156+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:23:31.963156+0000","last_undegraded":"2023-12-14T18:23:31.963156+0000","last_fullsized":"2023-12-14T18:23:31.963156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:46.733098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320452+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:23:32.320452+0000","last_peered":"2023-12-14T18:23:32.320452+0000","last_clean":"2023-12-14T18:23:32.320452+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:23:32.320452+0000","last_undegraded":"2023-12-14T18:23:32.320452+0000","last_fullsized":"2023-12-14T18:23:32.320452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:34:04.103111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963119+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:23:31.963119+0000","last_peered":"2023-12-14T18:23:31.963119+0000","last_clean":"2023-12-14T18:23:31.963119+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:23:31.963119+0000","last_undegraded":"2023-12-14T18:23:31.963119+0000","last_fullsized":"2023-12-14T18:23:31.963119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:13:05.096473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320457+0000","last_change":"2023-12-14T18:23:28.902315+0000","last_active":"2023-12-14T18:23:32.320457+0000","last_peered":"2023-12-14T18:23:32.320457+0000","last_clean":"2023-12-14T18:23:32.320457+0000","last_became_active":"2023-12-14T18:23:28.901654+0000","last_became_peered":"2023-12-14T18:23:28.901654+0000","last_unstale":"2023-12-14T18:23:32.320457+0000","last_undegraded":"2023-12-14T18:23:32.320457+0000","last_fullsized":"2023-12-14T18:23:32.320457+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:27:11.302617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298674+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:23:30.298674+0000","last_peered":"2023-12-14T18:23:30.298674+0000","last_clean":"2023-12-14T18:23:30.298674+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:23:30.298674+0000","last_undegraded":"2023-12-14T18:23:30.298674+0000","last_fullsized":"2023-12-14T18:23:30.298674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.125688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321569+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:23:32.321569+0000","last_peered":"2023-12-14T18:23:32.321569+0000","last_clean":"2023-12-14T18:23:32.321569+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:23:32.321569+0000","last_undegraded":"2023-12-14T18:23:32.321569+0000","last_fullsized":"2023-12-14T18:23:32.321569+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:07.935972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007227+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:23:32.007227+0000","last_peered":"2023-12-14T18:23:32.007227+0000","last_clean":"2023-12-14T18:23:32.007227+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:23:32.007227+0000","last_undegraded":"2023-12-14T18:23:32.007227+0000","last_fullsized":"2023-12-14T18:23:32.007227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:59:48.805805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.560471+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:23:31.560471+0000","last_peered":"2023-12-14T18:23:31.560471+0000","last_clean":"2023-12-14T18:23:31.560471+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:23:31.560471+0000","last_undegraded":"2023-12-14T18:23:31.560471+0000","last_fullsized":"2023-12-14T18:23:31.560471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:44:06.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962946+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:23:31.962946+0000","last_peered":"2023-12-14T18:23:31.962946+0000","last_clean":"2023-12-14T18:23:31.962946+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:23:31.962946+0000","last_undegraded":"2023-12-14T18:23:31.962946+0000","last_fullsized":"2023-12-14T18:23:31.962946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:13.860488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.322302+0000","last_change":"2023-12-14T18:23:28.904705+0000","last_active":"2023-12-14T18:23:32.322302+0000","last_peered":"2023-12-14T18:23:32.322302+0000","last_clean":"2023-12-14T18:23:32.322302+0000","last_became_active":"2023-12-14T18:23:28.904353+0000","last_became_peered":"2023-12-14T18:23:28.904353+0000","last_unstale":"2023-12-14T18:23:32.322302+0000","last_undegraded":"2023-12-14T18:23:32.322302+0000","last_fullsized":"2023-12-14T18:23:32.322302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:20.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965850+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:23:31.965850+0000","last_peered":"2023-12-14T18:23:31.965850+0000","last_clean":"2023-12-14T18:23:31.965850+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:23:31.965850+0000","last_undegraded":"2023-12-14T18:23:31.965850+0000","last_fullsized":"2023-12-14T18:23:31.965850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:43:44.219611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.334109+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:23:33.334109+0000","last_peered":"2023-12-14T18:23:33.334109+0000","last_clean":"2023-12-14T18:23:33.334109+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:23:33.334109+0000","last_undegraded":"2023-12-14T18:23:33.334109+0000","last_fullsized":"2023-12-14T18:23:33.334109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:28.258373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963737+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:23:31.963737+0000","last_peered":"2023-12-14T18:23:31.963737+0000","last_clean":"2023-12-14T18:23:31.963737+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:23:31.963737+0000","last_undegraded":"2023-12-14T18:23:31.963737+0000","last_fullsized":"2023-12-14T18:23:31.963737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:40:30.090113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862732+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:23:30.862732+0000","last_peered":"2023-12-14T18:23:30.862732+0000","last_clean":"2023-12-14T18:23:30.862732+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:23:30.862732+0000","last_undegraded":"2023-12-14T18:23:30.862732+0000","last_fullsized":"2023-12-14T18:23:30.862732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:04.942766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964201+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:23:31.964201+0000","last_peered":"2023-12-14T18:23:31.964201+0000","last_clean":"2023-12-14T18:23:31.964201+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:23:31.964201+0000","last_undegraded":"2023-12-14T18:23:31.964201+0000","last_fullsized":"2023-12-14T18:23:31.964201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:09.415831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297796+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:23:30.297796+0000","last_peered":"2023-12-14T18:23:30.297796+0000","last_clean":"2023-12-14T18:23:30.297796+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:23:30.297796+0000","last_undegraded":"2023-12-14T18:23:30.297796+0000","last_fullsized":"2023-12-14T18:23:30.297796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:39:55.556069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963945+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:23:31.963945+0000","last_peered":"2023-12-14T18:23:31.963945+0000","last_clean":"2023-12-14T18:23:31.963945+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:23:31.963945+0000","last_undegraded":"2023-12-14T18:23:31.963945+0000","last_fullsized":"2023-12-14T18:23:31.963945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:04:04.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007274+0000","last_change":"2023-12-14T18:23:29.319776+0000","last_active":"2023-12-14T18:23:32.007274+0000","last_peered":"2023-12-14T18:23:32.007274+0000","last_clean":"2023-12-14T18:23:32.007274+0000","last_became_active":"2023-12-14T18:23:29.319397+0000","last_became_peered":"2023-12-14T18:23:29.319397+0000","last_unstale":"2023-12-14T18:23:32.007274+0000","last_undegraded":"2023-12-14T18:23:32.007274+0000","last_fullsized":"2023-12-14T18:23:32.007274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:52:14.926646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512919+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:23:31.512919+0000","last_peered":"2023-12-14T18:23:31.512919+0000","last_clean":"2023-12-14T18:23:31.512919+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:23:31.512919+0000","last_undegraded":"2023-12-14T18:23:31.512919+0000","last_fullsized":"2023-12-14T18:23:31.512919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:34:15.547356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512973+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:23:31.512973+0000","last_peered":"2023-12-14T18:23:31.512973+0000","last_clean":"2023-12-14T18:23:31.512973+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:23:31.512973+0000","last_undegraded":"2023-12-14T18:23:31.512973+0000","last_fullsized":"2023-12-14T18:23:31.512973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:43:54.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962924+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:23:31.962924+0000","last_peered":"2023-12-14T18:23:31.962924+0000","last_clean":"2023-12-14T18:23:31.962924+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:23:31.962924+0000","last_undegraded":"2023-12-14T18:23:31.962924+0000","last_fullsized":"2023-12-14T18:23:31.962924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:19:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297898+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:23:30.297898+0000","last_peered":"2023-12-14T18:23:30.297898+0000","last_clean":"2023-12-14T18:23:30.297898+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:23:30.297898+0000","last_undegraded":"2023-12-14T18:23:30.297898+0000","last_fullsized":"2023-12-14T18:23:30.297898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:05:37.463585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007445+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:23:32.007445+0000","last_peered":"2023-12-14T18:23:32.007445+0000","last_clean":"2023-12-14T18:23:32.007445+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:23:32.007445+0000","last_undegraded":"2023-12-14T18:23:32.007445+0000","last_fullsized":"2023-12-14T18:23:32.007445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:40:25.331281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513248+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:23:31.513248+0000","last_peered":"2023-12-14T18:23:31.513248+0000","last_clean":"2023-12-14T18:23:31.513248+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:23:31.513248+0000","last_undegraded":"2023-12-14T18:23:31.513248+0000","last_fullsized":"2023-12-14T18:23:31.513248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:51:19.618834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963026+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:23:31.963026+0000","last_peered":"2023-12-14T18:23:31.963026+0000","last_clean":"2023-12-14T18:23:31.963026+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:23:31.963026+0000","last_undegraded":"2023-12-14T18:23:31.963026+0000","last_fullsized":"2023-12-14T18:23:31.963026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:51:46.572510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862373+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:23:30.862373+0000","last_peered":"2023-12-14T18:23:30.862373+0000","last_clean":"2023-12-14T18:23:30.862373+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:23:30.862373+0000","last_undegraded":"2023-12-14T18:23:30.862373+0000","last_fullsized":"2023-12-14T18:23:30.862373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:29.432206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962870+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:23:31.962870+0000","last_peered":"2023-12-14T18:23:31.962870+0000","last_clean":"2023-12-14T18:23:31.962870+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:23:31.962870+0000","last_undegraded":"2023-12-14T18:23:31.962870+0000","last_fullsized":"2023-12-14T18:23:31.962870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:48:20.698154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:49.538405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297941+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:23:30.297941+0000","last_peered":"2023-12-14T18:23:30.297941+0000","last_clean":"2023-12-14T18:23:30.297941+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:23:30.297941+0000","last_undegraded":"2023-12-14T18:23:30.297941+0000","last_fullsized":"2023-12-14T18:23:30.297941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:01:30.384170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007163+0000","last_change":"2023-12-14T18:23:29.325433+0000","last_active":"2023-12-14T18:23:32.007163+0000","last_peered":"2023-12-14T18:23:32.007163+0000","last_clean":"2023-12-14T18:23:32.007163+0000","last_became_active":"2023-12-14T18:23:29.325027+0000","last_became_peered":"2023-12-14T18:23:29.325027+0000","last_unstale":"2023-12-14T18:23:32.007163+0000","last_undegraded":"2023-12-14T18:23:32.007163+0000","last_fullsized":"2023-12-14T18:23:32.007163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:03:16.376515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60535,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":232,"num_read_kb":178,"num_write":150,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5896,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739256,"statfs":{"total":95995035648,"available":95988998144,"internally_reserved":0,"allocated":851968,"data_stored":409482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.879}]},{"osd":1,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.624}]},{"osd":2,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.69899999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":9.1150000000000002,"5min":9.1150000000000002,"15min":9.1150000000000002},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68899999999999995}]}]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6888,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738264,"statfs":{"total":95995035648,"available":95987982336,"internally_reserved":0,"allocated":1540096,"data_stored":1057221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.436},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.626}]},{"osd":6,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.79000000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Dec 14 18:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83599999999999997}]}]},{"osd":9,"up_from":62,"seq":266287972377,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6040,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739112,"statfs":{"total":95995035648,"available":95988850688,"internally_reserved":0,"allocated":868352,"data_stored":409718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.504},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.438}]},{"osd":3,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.52900000000000003}]},{"osd":8,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.621},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.56299999999999994}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.497}]}]},{"osd":8,"up_from":55,"seq":236223201309,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6232,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738920,"statfs":{"total":95995035648,"available":95988654080,"internally_reserved":0,"allocated":868352,"data_stored":409638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.877,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.629},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.746},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.879},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.95799999999999996}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":1.0049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430240,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6876,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738276,"statfs":{"total":95995035648,"available":95987994624,"internally_reserved":0,"allocated":1462272,"data_stored":1001867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.748},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82199999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.622}]},{"osd":5,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.622,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93400000000000005,"5min":1.986,"15min":1.986},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":6,"up_from":43,"seq":184683593764,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":856064,"data_stored":409113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.379,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.745,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.313}]},{"osd":4,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74299999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.48499999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.432},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.441}]},{"osd":7,"last update":"Thu Dec 14 18:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.54200000000000004}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45500000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48599999999999999}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7236,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737916,"statfs":{"total":95995035648,"available":95987625984,"internally_reserved":0,"allocated":913408,"data_stored":465141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.19,"15min":0.19},"max":{"1min":0.77500000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48499999999999999,"15min":0.45500000000000002},"min":{"1min":0.379,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.40100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.38700000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78100000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Dec 14 18:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.45200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83299999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73999999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80100000000000005,"5min":0.878,"15min":0.878},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.872},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Dec 14 18:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.93200000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.95399999999999996}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.89500000000000002}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7136,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738016,"statfs":{"total":95995035648,"available":95987728384,"internally_reserved":0,"allocated":876544,"data_stored":410378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.46400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.32000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.627,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79300000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71299999999999997,"5min":0.876,"15min":0.876},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55500000000000005}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47599999999999998}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57699999999999996}]},{"osd":11,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52800000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7320,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737832,"statfs":{"total":95995035648,"available":95987539968,"internally_reserved":0,"allocated":933888,"data_stored":466560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.68000000000000005,"5min":0.747,"15min":0.747},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.39200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.438}]},{"osd":4,"last update":"Thu Dec 14 18:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:23:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.747,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.50900000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.48599999999999999}]},{"osd":10,"last update":"Thu Dec 14 18:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6492,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738660,"statfs":{"total":95995035648,"available":95988387840,"internally_reserved":0,"allocated":872448,"data_stored":409430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.33500000000000002},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.27900000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.495}]},{"osd":1,"last update":"Thu Dec 14 18:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.38500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Dec 14 18:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.379,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68000000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56599999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":4,"up_from":31,"seq":133143986219,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":860160,"data_stored":409886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.376,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38,"15min":0.37},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.373,"15min":0.373},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47999999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63600000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.623}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":36,"seq":154618822696,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6952,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738200,"statfs":{"total":95995035648,"available":95987916800,"internally_reserved":0,"allocated":1474560,"data_stored":1001209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.442,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.496},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.752},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82099999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69399999999999995}]},{"osd":9,"last update":"Thu Dec 14 18:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.85799999999999998}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.89100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:24:11.119 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-14T18:24:11.435 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:11.858 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:11 smithi069 ceph-mon[42047]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:11.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:11 smithi119 ceph-mon[43973]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:11.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:11 smithi091 ceph-mon[43601]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:12.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 -- 172.21.15.69:0/3995257190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 msgr2=0x7f0260103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:12.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 --2- 172.21.15.69:0/3995257190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260103e40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f024c0099c0 tx=0x7f024c009cd0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 -- 172.21.15.69:0/3995257190 shutdown_connections 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 --2- 172.21.15.69:0/3995257190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0260104570 0x7f026010c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 --2- 172.21.15.69:0/3995257190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02600ffba0 0x7f02600fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 --2- 172.21.15.69:0/3995257190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260103e40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 -- 172.21.15.69:0/3995257190 >> 172.21.15.69:0/3995257190 conn(0x7f02600758a0 msgr2=0x7f0260075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 -- 172.21.15.69:0/3995257190 shutdown_connections 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.542+0000 7f0266e4d700 1 -- 172.21.15.69:0/3995257190 wait complete. 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 Processor -- start 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 -- start start 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02600ffba0 0x7f02601952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:12.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0260104570 0x7f0260199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026019a2b0 con 0x7f0260100540 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026019a420 con 0x7f0260104570 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0266e4d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026019a5e0 con 0x7f02600ffba0 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37432/0 (socket says 172.21.15.69:37432) 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 -- 172.21.15.69:0/455884864 learned_addr learned my addr 172.21.15.69:0/455884864 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f0264be9700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02600ffba0 0x7f02601952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f02653ea700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0260104570 0x7f0260199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 -- 172.21.15.69:0/455884864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02600ffba0 msgr2=0x7f02601952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02600ffba0 0x7f02601952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 -- 172.21.15.69:0/455884864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0260104570 msgr2=0x7f0260199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0260104570 0x7f0260199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.543+0000 7f025ffff700 1 -- 172.21.15.69:0/455884864 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0095f0 con 0x7f0260100540 2023-12-14T18:24:12.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.544+0000 7f025ffff700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260195830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c010 tx=0x7f024c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:12.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.544+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c01d070 con 0x7f0260100540 2023-12-14T18:24:12.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.544+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026010f240 con 0x7f0260100540 2023-12-14T18:24:12.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.544+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f024c0041a0 con 0x7f0260100540 2023-12-14T18:24:12.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.544+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c022e40 con 0x7f0260100540 2023-12-14T18:24:12.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.544+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026010f0b0 con 0x7f0260100540 2023-12-14T18:24:12.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.545+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026010f3d0 con 0x7f0260100540 2023-12-14T18:24:12.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.546+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f024c0225e0 con 0x7f0260100540 2023-12-14T18:24:12.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.546+0000 7f025dffb700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f02500a11e0 0x7f02500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:12.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.547+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f024c0ce4d0 con 0x7f0260100540 2023-12-14T18:24:12.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.547+0000 7f0264be9700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f02500a11e0 0x7f02500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:12.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.547+0000 7f0264be9700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f02500a11e0 0x7f02500a3690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0254009a10 tx=0x7f0254009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:12.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.550+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f024c097d00 con 0x7f0260100540 2023-12-14T18:24:12.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:12 smithi069 ceph-mon[42047]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:12.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.737+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02600fcd60 con 0x7f02500a11e0 2023-12-14T18:24:12.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.747+0000 7f025dffb700 1 -- 172.21.15.69:0/455884864 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340849 (secure 0 0 0) 0x7f02600fcd60 con 0x7f02500a11e0 2023-12-14T18:24:12.753 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f02500a11e0 msgr2=0x7f02500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f02500a11e0 0x7f02500a3690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0254009a10 tx=0x7f0254009190 comp rx=0 tx=0).stop 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 msgr2=0x7f0260195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260195830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c010 tx=0x7f024c004730 comp rx=0 tx=0).stop 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 shutdown_connections 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f02500a11e0 0x7f02500a3690 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0260104570 0x7f0260199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02600ffba0 0x7f02601952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 --2- 172.21.15.69:0/455884864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0260100540 0x7f0260195830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 >> 172.21.15.69:0/455884864 conn(0x7f02600758a0 msgr2=0x7f02600fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 shutdown_connections 2023-12-14T18:24:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:12.750+0000 7f0266e4d700 1 -- 172.21.15.69:0/455884864 wait complete. 2023-12-14T18:24:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:24:12.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:12 smithi119 ceph-mon[43973]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:12.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:12 smithi091 ceph-mon[43601]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:13.106 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-12-14T18:24:12.244580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651149,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":358,"num_read_kb":287,"num_write":333,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79512,"kb_used_data":12088,"kb_used_omap":0,"kb_used_meta":67328,"kb_avail":1124862312,"statfs":{"total":1151940427776,"available":1151859007488,"internally_reserved":0,"allocated":12378112,"data_stored":6859643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68943872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002956"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007441+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:23:32.007441+0000","last_peered":"2023-12-14T18:23:32.007441+0000","last_clean":"2023-12-14T18:23:32.007441+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:23:32.007441+0000","last_undegraded":"2023-12-14T18:23:32.007441+0000","last_fullsized":"2023-12-14T18:23:32.007441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:36:32.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963017+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:23:31.963017+0000","last_peered":"2023-12-14T18:23:31.963017+0000","last_clean":"2023-12-14T18:23:31.963017+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:23:31.963017+0000","last_undegraded":"2023-12-14T18:23:31.963017+0000","last_fullsized":"2023-12-14T18:23:31.963017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:53:14.564046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962969+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:23:31.962969+0000","last_peered":"2023-12-14T18:23:31.962969+0000","last_clean":"2023-12-14T18:23:31.962969+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:23:31.962969+0000","last_undegraded":"2023-12-14T18:23:31.962969+0000","last_fullsized":"2023-12-14T18:23:31.962969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:55:45.247027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964402+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:23:31.964402+0000","last_peered":"2023-12-14T18:23:31.964402+0000","last_clean":"2023-12-14T18:23:31.964402+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:23:31.964402+0000","last_undegraded":"2023-12-14T18:23:31.964402+0000","last_fullsized":"2023-12-14T18:23:31.964402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:33.555138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298752+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:23:30.298752+0000","last_peered":"2023-12-14T18:23:30.298752+0000","last_clean":"2023-12-14T18:23:30.298752+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:23:30.298752+0000","last_undegraded":"2023-12-14T18:23:30.298752+0000","last_fullsized":"2023-12-14T18:23:30.298752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:45.744707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964734+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:23:31.964734+0000","last_peered":"2023-12-14T18:23:31.964734+0000","last_clean":"2023-12-14T18:23:31.964734+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:23:31.964734+0000","last_undegraded":"2023-12-14T18:23:31.964734+0000","last_fullsized":"2023-12-14T18:23:31.964734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:56:29.640721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963441+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:23:31.963441+0000","last_peered":"2023-12-14T18:23:31.963441+0000","last_clean":"2023-12-14T18:23:31.963441+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:23:31.963441+0000","last_undegraded":"2023-12-14T18:23:31.963441+0000","last_fullsized":"2023-12-14T18:23:31.963441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:29:53.508232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962583+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:23:31.962583+0000","last_peered":"2023-12-14T18:23:31.962583+0000","last_clean":"2023-12-14T18:23:31.962583+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:23:31.962583+0000","last_undegraded":"2023-12-14T18:23:31.962583+0000","last_fullsized":"2023-12-14T18:23:31.962583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:39:26.030240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298994+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:23:30.298994+0000","last_peered":"2023-12-14T18:23:30.298994+0000","last_clean":"2023-12-14T18:23:30.298994+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:23:30.298994+0000","last_undegraded":"2023-12-14T18:23:30.298994+0000","last_fullsized":"2023-12-14T18:23:30.298994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:53:45.531715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964560+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:23:31.964560+0000","last_peered":"2023-12-14T18:23:31.964560+0000","last_clean":"2023-12-14T18:23:31.964560+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:23:31.964560+0000","last_undegraded":"2023-12-14T18:23:31.964560+0000","last_fullsized":"2023-12-14T18:23:31.964560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:00.231623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963488+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:23:31.963488+0000","last_peered":"2023-12-14T18:23:31.963488+0000","last_clean":"2023-12-14T18:23:31.963488+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:23:31.963488+0000","last_undegraded":"2023-12-14T18:23:31.963488+0000","last_fullsized":"2023-12-14T18:23:31.963488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:19:41.156980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964275+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:23:31.964275+0000","last_peered":"2023-12-14T18:23:31.964275+0000","last_clean":"2023-12-14T18:23:31.964275+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:23:31.964275+0000","last_undegraded":"2023-12-14T18:23:31.964275+0000","last_fullsized":"2023-12-14T18:23:31.964275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:34:33.441932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297890+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:23:30.297890+0000","last_peered":"2023-12-14T18:23:30.297890+0000","last_clean":"2023-12-14T18:23:30.297890+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:23:30.297890+0000","last_undegraded":"2023-12-14T18:23:30.297890+0000","last_fullsized":"2023-12-14T18:23:30.297890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:59.839011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963183+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:23:31.963183+0000","last_peered":"2023-12-14T18:23:31.963183+0000","last_clean":"2023-12-14T18:23:31.963183+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:23:31.963183+0000","last_undegraded":"2023-12-14T18:23:31.963183+0000","last_fullsized":"2023-12-14T18:23:31.963183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:23:22.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962782+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:23:31.962782+0000","last_peered":"2023-12-14T18:23:31.962782+0000","last_clean":"2023-12-14T18:23:31.962782+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:23:31.962782+0000","last_undegraded":"2023-12-14T18:23:31.962782+0000","last_fullsized":"2023-12-14T18:23:31.962782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:13.104079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298442+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:23:30.298442+0000","last_peered":"2023-12-14T18:23:30.298442+0000","last_clean":"2023-12-14T18:23:30.298442+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:23:30.298442+0000","last_undegraded":"2023-12-14T18:23:30.298442+0000","last_fullsized":"2023-12-14T18:23:30.298442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:57.579587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007603+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:23:32.007603+0000","last_peered":"2023-12-14T18:23:32.007603+0000","last_clean":"2023-12-14T18:23:32.007603+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:23:32.007603+0000","last_undegraded":"2023-12-14T18:23:32.007603+0000","last_fullsized":"2023-12-14T18:23:32.007603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:08.141970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217912+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:23:31.217912+0000","last_peered":"2023-12-14T18:23:31.217912+0000","last_clean":"2023-12-14T18:23:31.217912+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:23:31.217912+0000","last_undegraded":"2023-12-14T18:23:31.217912+0000","last_fullsized":"2023-12-14T18:23:31.217912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:24:37.822774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513258+0000","last_change":"2023-12-14T18:23:29.320811+0000","last_active":"2023-12-14T18:23:31.513258+0000","last_peered":"2023-12-14T18:23:31.513258+0000","last_clean":"2023-12-14T18:23:31.513258+0000","last_became_active":"2023-12-14T18:23:29.315538+0000","last_became_peered":"2023-12-14T18:23:29.315538+0000","last_unstale":"2023-12-14T18:23:31.513258+0000","last_undegraded":"2023-12-14T18:23:31.513258+0000","last_fullsized":"2023-12-14T18:23:31.513258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:26:01.785017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.333714+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:23:33.333714+0000","last_peered":"2023-12-14T18:23:33.333714+0000","last_clean":"2023-12-14T18:23:33.333714+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:23:33.333714+0000","last_undegraded":"2023-12-14T18:23:33.333714+0000","last_fullsized":"2023-12-14T18:23:33.333714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:15:49.986514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962770+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:23:31.962770+0000","last_peered":"2023-12-14T18:23:31.962770+0000","last_clean":"2023-12-14T18:23:31.962770+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:23:31.962770+0000","last_undegraded":"2023-12-14T18:23:31.962770+0000","last_fullsized":"2023-12-14T18:23:31.962770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:10.086046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962978+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:23:31.962978+0000","last_peered":"2023-12-14T18:23:31.962978+0000","last_clean":"2023-12-14T18:23:31.962978+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:23:31.962978+0000","last_undegraded":"2023-12-14T18:23:31.962978+0000","last_fullsized":"2023-12-14T18:23:31.962978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:08:25.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963326+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:23:31.963326+0000","last_peered":"2023-12-14T18:23:31.963326+0000","last_clean":"2023-12-14T18:23:31.963326+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:23:31.963326+0000","last_undegraded":"2023-12-14T18:23:31.963326+0000","last_fullsized":"2023-12-14T18:23:31.963326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:09:13.088758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332104+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:23:33.332104+0000","last_peered":"2023-12-14T18:23:33.332104+0000","last_clean":"2023-12-14T18:23:33.332104+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:23:33.332104+0000","last_undegraded":"2023-12-14T18:23:33.332104+0000","last_fullsized":"2023-12-14T18:23:33.332104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:29:10.775688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298727+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:23:30.298727+0000","last_peered":"2023-12-14T18:23:30.298727+0000","last_clean":"2023-12-14T18:23:30.298727+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:23:30.298727+0000","last_undegraded":"2023-12-14T18:23:30.298727+0000","last_fullsized":"2023-12-14T18:23:30.298727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:08.979468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299162+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:23:30.299162+0000","last_peered":"2023-12-14T18:23:30.299162+0000","last_clean":"2023-12-14T18:23:30.299162+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:23:30.299162+0000","last_undegraded":"2023-12-14T18:23:30.299162+0000","last_fullsized":"2023-12-14T18:23:30.299162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:16.688070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862680+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:23:30.862680+0000","last_peered":"2023-12-14T18:23:30.862680+0000","last_clean":"2023-12-14T18:23:30.862680+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:23:30.862680+0000","last_undegraded":"2023-12-14T18:23:30.862680+0000","last_fullsized":"2023-12-14T18:23:30.862680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:38.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:08.398184+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:24:08.398184+0000","last_peered":"2023-12-14T18:24:08.398184+0000","last_clean":"2023-12-14T18:24:08.398184+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:24:08.398184+0000","last_undegraded":"2023-12-14T18:24:08.398184+0000","last_fullsized":"2023-12-14T18:24:08.398184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:54:41.803316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298872+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:23:30.298872+0000","last_peered":"2023-12-14T18:23:30.298872+0000","last_clean":"2023-12-14T18:23:30.298872+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:23:30.298872+0000","last_undegraded":"2023-12-14T18:23:30.298872+0000","last_fullsized":"2023-12-14T18:23:30.298872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:00:06.468221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332593+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:23:33.332593+0000","last_peered":"2023-12-14T18:23:33.332593+0000","last_clean":"2023-12-14T18:23:33.332593+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:23:33.332593+0000","last_undegraded":"2023-12-14T18:23:33.332593+0000","last_fullsized":"2023-12-14T18:23:33.332593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:38:50.312141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862519+0000","last_change":"2023-12-14T18:23:29.314941+0000","last_active":"2023-12-14T18:23:30.862519+0000","last_peered":"2023-12-14T18:23:30.862519+0000","last_clean":"2023-12-14T18:23:30.862519+0000","last_became_active":"2023-12-14T18:23:29.314508+0000","last_became_peered":"2023-12-14T18:23:29.314508+0000","last_unstale":"2023-12-14T18:23:30.862519+0000","last_undegraded":"2023-12-14T18:23:30.862519+0000","last_fullsized":"2023-12-14T18:23:30.862519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:06:11.981373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332330+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:23:33.332330+0000","last_peered":"2023-12-14T18:23:33.332330+0000","last_clean":"2023-12-14T18:23:33.332330+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:23:33.332330+0000","last_undegraded":"2023-12-14T18:23:33.332330+0000","last_fullsized":"2023-12-14T18:23:33.332330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:53.112965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962525+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:23:31.962525+0000","last_peered":"2023-12-14T18:23:31.962525+0000","last_clean":"2023-12-14T18:23:31.962525+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:23:31.962525+0000","last_undegraded":"2023-12-14T18:23:31.962525+0000","last_fullsized":"2023-12-14T18:23:31.962525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:19:56.891103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862356+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:23:30.862356+0000","last_peered":"2023-12-14T18:23:30.862356+0000","last_clean":"2023-12-14T18:23:30.862356+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:23:30.862356+0000","last_undegraded":"2023-12-14T18:23:30.862356+0000","last_fullsized":"2023-12-14T18:23:30.862356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:02:39.786052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217715+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:23:31.217715+0000","last_peered":"2023-12-14T18:23:31.217715+0000","last_clean":"2023-12-14T18:23:31.217715+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:23:31.217715+0000","last_undegraded":"2023-12-14T18:23:31.217715+0000","last_fullsized":"2023-12-14T18:23:31.217715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:40:20.784196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:06.394422+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:24:06.394422+0000","last_peered":"2023-12-14T18:24:06.394422+0000","last_clean":"2023-12-14T18:24:06.394422+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:24:06.394422+0000","last_undegraded":"2023-12-14T18:24:06.394422+0000","last_fullsized":"2023-12-14T18:24:06.394422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:52:10.663306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:27:47.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321675+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:23:32.321675+0000","last_peered":"2023-12-14T18:23:32.321675+0000","last_clean":"2023-12-14T18:23:32.321675+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:23:32.321675+0000","last_undegraded":"2023-12-14T18:23:32.321675+0000","last_fullsized":"2023-12-14T18:23:32.321675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:07.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963309+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:23:31.963309+0000","last_peered":"2023-12-14T18:23:31.963309+0000","last_clean":"2023-12-14T18:23:31.963309+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:23:31.963309+0000","last_undegraded":"2023-12-14T18:23:31.963309+0000","last_fullsized":"2023-12-14T18:23:31.963309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:15:30.502067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321701+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:23:32.321701+0000","last_peered":"2023-12-14T18:23:32.321701+0000","last_clean":"2023-12-14T18:23:32.321701+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:23:32.321701+0000","last_undegraded":"2023-12-14T18:23:32.321701+0000","last_fullsized":"2023-12-14T18:23:32.321701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:01:37.437148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298957+0000","last_change":"2023-12-14T18:23:29.311912+0000","last_active":"2023-12-14T18:23:30.298957+0000","last_peered":"2023-12-14T18:23:30.298957+0000","last_clean":"2023-12-14T18:23:30.298957+0000","last_became_active":"2023-12-14T18:23:29.310752+0000","last_became_peered":"2023-12-14T18:23:29.310752+0000","last_unstale":"2023-12-14T18:23:30.298957+0000","last_undegraded":"2023-12-14T18:23:30.298957+0000","last_fullsized":"2023-12-14T18:23:30.298957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:29:06.495199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'27","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:07.400829+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:24:07.400829+0000","last_peered":"2023-12-14T18:24:07.400829+0000","last_clean":"2023-12-14T18:24:07.400829+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:24:07.400829+0000","last_undegraded":"2023-12-14T18:24:07.400829+0000","last_fullsized":"2023-12-14T18:24:07.400829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:08:01.303699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":91,"num_write":28,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.299079+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:23:30.299079+0000","last_peered":"2023-12-14T18:23:30.299079+0000","last_clean":"2023-12-14T18:23:30.299079+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:23:30.299079+0000","last_undegraded":"2023-12-14T18:23:30.299079+0000","last_fullsized":"2023-12-14T18:23:30.299079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:32:03.844259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332293+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:23:33.332293+0000","last_peered":"2023-12-14T18:23:33.332293+0000","last_clean":"2023-12-14T18:23:33.332293+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:23:33.332293+0000","last_undegraded":"2023-12-14T18:23:33.332293+0000","last_fullsized":"2023-12-14T18:23:33.332293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:16:46.098127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297832+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:23:30.297832+0000","last_peered":"2023-12-14T18:23:30.297832+0000","last_clean":"2023-12-14T18:23:30.297832+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:23:30.297832+0000","last_undegraded":"2023-12-14T18:23:30.297832+0000","last_fullsized":"2023-12-14T18:23:30.297832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:06:04.096044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321149+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:23:32.321149+0000","last_peered":"2023-12-14T18:23:32.321149+0000","last_clean":"2023-12-14T18:23:32.321149+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:23:32.321149+0000","last_undegraded":"2023-12-14T18:23:32.321149+0000","last_fullsized":"2023-12-14T18:23:32.321149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:28:23.739941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964105+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:23:31.964105+0000","last_peered":"2023-12-14T18:23:31.964105+0000","last_clean":"2023-12-14T18:23:31.964105+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:23:31.964105+0000","last_undegraded":"2023-12-14T18:23:31.964105+0000","last_fullsized":"2023-12-14T18:23:31.964105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:55:38.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:05.398629+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:24:05.398629+0000","last_peered":"2023-12-14T18:24:05.398629+0000","last_clean":"2023-12-14T18:24:05.398629+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:24:05.398629+0000","last_undegraded":"2023-12-14T18:24:05.398629+0000","last_fullsized":"2023-12-14T18:24:05.398629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:17:49.846098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963126+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:23:31.963126+0000","last_peered":"2023-12-14T18:23:31.963126+0000","last_clean":"2023-12-14T18:23:31.963126+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:23:31.963126+0000","last_undegraded":"2023-12-14T18:23:31.963126+0000","last_fullsized":"2023-12-14T18:23:31.963126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:38:37.985717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.334587+0000","last_change":"2023-12-14T18:23:28.904227+0000","last_active":"2023-12-14T18:23:33.334587+0000","last_peered":"2023-12-14T18:23:33.334587+0000","last_clean":"2023-12-14T18:23:33.334587+0000","last_became_active":"2023-12-14T18:23:28.903844+0000","last_became_peered":"2023-12-14T18:23:28.903844+0000","last_unstale":"2023-12-14T18:23:33.334587+0000","last_undegraded":"2023-12-14T18:23:33.334587+0000","last_fullsized":"2023-12-14T18:23:33.334587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:03:09.233743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862403+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:23:30.862403+0000","last_peered":"2023-12-14T18:23:30.862403+0000","last_clean":"2023-12-14T18:23:30.862403+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:23:30.862403+0000","last_undegraded":"2023-12-14T18:23:30.862403+0000","last_fullsized":"2023-12-14T18:23:30.862403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:06:02.516476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:34.344874+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:23:34.344874+0000","last_peered":"2023-12-14T18:23:34.344874+0000","last_clean":"2023-12-14T18:23:34.344874+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:23:34.344874+0000","last_undegraded":"2023-12-14T18:23:34.344874+0000","last_fullsized":"2023-12-14T18:23:34.344874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:49:05.274081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007430+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:23:32.007430+0000","last_peered":"2023-12-14T18:23:32.007430+0000","last_clean":"2023-12-14T18:23:32.007430+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:23:32.007430+0000","last_undegraded":"2023-12-14T18:23:32.007430+0000","last_fullsized":"2023-12-14T18:23:32.007430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:20:31.928572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.217770+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:23:31.217770+0000","last_peered":"2023-12-14T18:23:31.217770+0000","last_clean":"2023-12-14T18:23:31.217770+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:23:31.217770+0000","last_undegraded":"2023-12-14T18:23:31.217770+0000","last_fullsized":"2023-12-14T18:23:31.217770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:41:07.717205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.646131+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:23:32.646131+0000","last_peered":"2023-12-14T18:23:32.646131+0000","last_clean":"2023-12-14T18:23:32.646131+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:23:32.646131+0000","last_undegraded":"2023-12-14T18:23:32.646131+0000","last_fullsized":"2023-12-14T18:23:32.646131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:14.386800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965740+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:23:31.965740+0000","last_peered":"2023-12-14T18:23:31.965740+0000","last_clean":"2023-12-14T18:23:31.965740+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:23:31.965740+0000","last_undegraded":"2023-12-14T18:23:31.965740+0000","last_fullsized":"2023-12-14T18:23:31.965740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:54:04.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964456+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:23:31.964456+0000","last_peered":"2023-12-14T18:23:31.964456+0000","last_clean":"2023-12-14T18:23:31.964456+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:23:31.964456+0000","last_undegraded":"2023-12-14T18:23:31.964456+0000","last_fullsized":"2023-12-14T18:23:31.964456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:57:44.704602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862512+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:23:30.862512+0000","last_peered":"2023-12-14T18:23:30.862512+0000","last_clean":"2023-12-14T18:23:30.862512+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:23:30.862512+0000","last_undegraded":"2023-12-14T18:23:30.862512+0000","last_fullsized":"2023-12-14T18:23:30.862512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:26:23.141463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:24:05.397864+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:24:05.397864+0000","last_peered":"2023-12-14T18:24:05.397864+0000","last_clean":"2023-12-14T18:24:05.397864+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:24:05.397864+0000","last_undegraded":"2023-12-14T18:24:05.397864+0000","last_fullsized":"2023-12-14T18:24:05.397864+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:05.438111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963266+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:23:31.963266+0000","last_peered":"2023-12-14T18:23:31.963266+0000","last_clean":"2023-12-14T18:23:31.963266+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:23:31.963266+0000","last_undegraded":"2023-12-14T18:23:31.963266+0000","last_fullsized":"2023-12-14T18:23:31.963266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:15:26.892489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:34.343096+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:23:34.343096+0000","last_peered":"2023-12-14T18:23:34.343096+0000","last_clean":"2023-12-14T18:23:34.343096+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:23:34.343096+0000","last_undegraded":"2023-12-14T18:23:34.343096+0000","last_fullsized":"2023-12-14T18:23:34.343096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:49:20.683055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963247+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:23:31.963247+0000","last_peered":"2023-12-14T18:23:31.963247+0000","last_clean":"2023-12-14T18:23:31.963247+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:23:31.963247+0000","last_undegraded":"2023-12-14T18:23:31.963247+0000","last_fullsized":"2023-12-14T18:23:31.963247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:25:43.576640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297606+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:23:30.297606+0000","last_peered":"2023-12-14T18:23:30.297606+0000","last_clean":"2023-12-14T18:23:30.297606+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:23:30.297606+0000","last_undegraded":"2023-12-14T18:23:30.297606+0000","last_fullsized":"2023-12-14T18:23:30.297606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:42.044013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.332781+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:23:33.332781+0000","last_peered":"2023-12-14T18:23:33.332781+0000","last_clean":"2023-12-14T18:23:33.332781+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:23:33.332781+0000","last_undegraded":"2023-12-14T18:23:33.332781+0000","last_fullsized":"2023-12-14T18:23:33.332781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:19:18.549174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321295+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:23:32.321295+0000","last_peered":"2023-12-14T18:23:32.321295+0000","last_clean":"2023-12-14T18:23:32.321295+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:23:32.321295+0000","last_undegraded":"2023-12-14T18:23:32.321295+0000","last_fullsized":"2023-12-14T18:23:32.321295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:59:20.753750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297936+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:23:30.297936+0000","last_peered":"2023-12-14T18:23:30.297936+0000","last_clean":"2023-12-14T18:23:30.297936+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:23:30.297936+0000","last_undegraded":"2023-12-14T18:23:30.297936+0000","last_fullsized":"2023-12-14T18:23:30.297936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:18:42.595546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:38.613650+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:23:38.613650+0000","last_peered":"2023-12-14T18:23:38.613650+0000","last_clean":"2023-12-14T18:23:38.613650+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:23:38.613650+0000","last_undegraded":"2023-12-14T18:23:38.613650+0000","last_fullsized":"2023-12-14T18:23:38.613650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:48:44.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963156+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:23:31.963156+0000","last_peered":"2023-12-14T18:23:31.963156+0000","last_clean":"2023-12-14T18:23:31.963156+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:23:31.963156+0000","last_undegraded":"2023-12-14T18:23:31.963156+0000","last_fullsized":"2023-12-14T18:23:31.963156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:46.733098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320452+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:23:32.320452+0000","last_peered":"2023-12-14T18:23:32.320452+0000","last_clean":"2023-12-14T18:23:32.320452+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:23:32.320452+0000","last_undegraded":"2023-12-14T18:23:32.320452+0000","last_fullsized":"2023-12-14T18:23:32.320452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:34:04.103111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963119+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:23:31.963119+0000","last_peered":"2023-12-14T18:23:31.963119+0000","last_clean":"2023-12-14T18:23:31.963119+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:23:31.963119+0000","last_undegraded":"2023-12-14T18:23:31.963119+0000","last_fullsized":"2023-12-14T18:23:31.963119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:13:05.096473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.320457+0000","last_change":"2023-12-14T18:23:28.902315+0000","last_active":"2023-12-14T18:23:32.320457+0000","last_peered":"2023-12-14T18:23:32.320457+0000","last_clean":"2023-12-14T18:23:32.320457+0000","last_became_active":"2023-12-14T18:23:28.901654+0000","last_became_peered":"2023-12-14T18:23:28.901654+0000","last_unstale":"2023-12-14T18:23:32.320457+0000","last_undegraded":"2023-12-14T18:23:32.320457+0000","last_fullsized":"2023-12-14T18:23:32.320457+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:27:11.302617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298674+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:23:30.298674+0000","last_peered":"2023-12-14T18:23:30.298674+0000","last_clean":"2023-12-14T18:23:30.298674+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:23:30.298674+0000","last_undegraded":"2023-12-14T18:23:30.298674+0000","last_fullsized":"2023-12-14T18:23:30.298674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.125688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.321569+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:23:32.321569+0000","last_peered":"2023-12-14T18:23:32.321569+0000","last_clean":"2023-12-14T18:23:32.321569+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:23:32.321569+0000","last_undegraded":"2023-12-14T18:23:32.321569+0000","last_fullsized":"2023-12-14T18:23:32.321569+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:07.935972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007227+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:23:32.007227+0000","last_peered":"2023-12-14T18:23:32.007227+0000","last_clean":"2023-12-14T18:23:32.007227+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:23:32.007227+0000","last_undegraded":"2023-12-14T18:23:32.007227+0000","last_fullsized":"2023-12-14T18:23:32.007227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:59:48.805805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.560471+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:23:31.560471+0000","last_peered":"2023-12-14T18:23:31.560471+0000","last_clean":"2023-12-14T18:23:31.560471+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:23:31.560471+0000","last_undegraded":"2023-12-14T18:23:31.560471+0000","last_fullsized":"2023-12-14T18:23:31.560471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:44:06.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962946+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:23:31.962946+0000","last_peered":"2023-12-14T18:23:31.962946+0000","last_clean":"2023-12-14T18:23:31.962946+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:23:31.962946+0000","last_undegraded":"2023-12-14T18:23:31.962946+0000","last_fullsized":"2023-12-14T18:23:31.962946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:09:13.860488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.322302+0000","last_change":"2023-12-14T18:23:28.904705+0000","last_active":"2023-12-14T18:23:32.322302+0000","last_peered":"2023-12-14T18:23:32.322302+0000","last_clean":"2023-12-14T18:23:32.322302+0000","last_became_active":"2023-12-14T18:23:28.904353+0000","last_became_peered":"2023-12-14T18:23:28.904353+0000","last_unstale":"2023-12-14T18:23:32.322302+0000","last_undegraded":"2023-12-14T18:23:32.322302+0000","last_fullsized":"2023-12-14T18:23:32.322302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:20.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.965850+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:23:31.965850+0000","last_peered":"2023-12-14T18:23:31.965850+0000","last_clean":"2023-12-14T18:23:31.965850+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:23:31.965850+0000","last_undegraded":"2023-12-14T18:23:31.965850+0000","last_fullsized":"2023-12-14T18:23:31.965850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:43:44.219611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:33.334109+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:23:33.334109+0000","last_peered":"2023-12-14T18:23:33.334109+0000","last_clean":"2023-12-14T18:23:33.334109+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:23:33.334109+0000","last_undegraded":"2023-12-14T18:23:33.334109+0000","last_fullsized":"2023-12-14T18:23:33.334109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:15:28.258373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963737+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:23:31.963737+0000","last_peered":"2023-12-14T18:23:31.963737+0000","last_clean":"2023-12-14T18:23:31.963737+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:23:31.963737+0000","last_undegraded":"2023-12-14T18:23:31.963737+0000","last_fullsized":"2023-12-14T18:23:31.963737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:40:30.090113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862732+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:23:30.862732+0000","last_peered":"2023-12-14T18:23:30.862732+0000","last_clean":"2023-12-14T18:23:30.862732+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:23:30.862732+0000","last_undegraded":"2023-12-14T18:23:30.862732+0000","last_fullsized":"2023-12-14T18:23:30.862732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:04.942766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.964201+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:23:31.964201+0000","last_peered":"2023-12-14T18:23:31.964201+0000","last_clean":"2023-12-14T18:23:31.964201+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:23:31.964201+0000","last_undegraded":"2023-12-14T18:23:31.964201+0000","last_fullsized":"2023-12-14T18:23:31.964201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:09.415831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297796+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:23:30.297796+0000","last_peered":"2023-12-14T18:23:30.297796+0000","last_clean":"2023-12-14T18:23:30.297796+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:23:30.297796+0000","last_undegraded":"2023-12-14T18:23:30.297796+0000","last_fullsized":"2023-12-14T18:23:30.297796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:39:55.556069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963945+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:23:31.963945+0000","last_peered":"2023-12-14T18:23:31.963945+0000","last_clean":"2023-12-14T18:23:31.963945+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:23:31.963945+0000","last_undegraded":"2023-12-14T18:23:31.963945+0000","last_fullsized":"2023-12-14T18:23:31.963945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:04:04.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007274+0000","last_change":"2023-12-14T18:23:29.319776+0000","last_active":"2023-12-14T18:23:32.007274+0000","last_peered":"2023-12-14T18:23:32.007274+0000","last_clean":"2023-12-14T18:23:32.007274+0000","last_became_active":"2023-12-14T18:23:29.319397+0000","last_became_peered":"2023-12-14T18:23:29.319397+0000","last_unstale":"2023-12-14T18:23:32.007274+0000","last_undegraded":"2023-12-14T18:23:32.007274+0000","last_fullsized":"2023-12-14T18:23:32.007274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:52:14.926646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512919+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:23:31.512919+0000","last_peered":"2023-12-14T18:23:31.512919+0000","last_clean":"2023-12-14T18:23:31.512919+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:23:31.512919+0000","last_undegraded":"2023-12-14T18:23:31.512919+0000","last_fullsized":"2023-12-14T18:23:31.512919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:34:15.547356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.512973+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:23:31.512973+0000","last_peered":"2023-12-14T18:23:31.512973+0000","last_clean":"2023-12-14T18:23:31.512973+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:23:31.512973+0000","last_undegraded":"2023-12-14T18:23:31.512973+0000","last_fullsized":"2023-12-14T18:23:31.512973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:43:54.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962924+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:23:31.962924+0000","last_peered":"2023-12-14T18:23:31.962924+0000","last_clean":"2023-12-14T18:23:31.962924+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:23:31.962924+0000","last_undegraded":"2023-12-14T18:23:31.962924+0000","last_fullsized":"2023-12-14T18:23:31.962924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:19:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297898+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:23:30.297898+0000","last_peered":"2023-12-14T18:23:30.297898+0000","last_clean":"2023-12-14T18:23:30.297898+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:23:30.297898+0000","last_undegraded":"2023-12-14T18:23:30.297898+0000","last_fullsized":"2023-12-14T18:23:30.297898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:05:37.463585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007445+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:23:32.007445+0000","last_peered":"2023-12-14T18:23:32.007445+0000","last_clean":"2023-12-14T18:23:32.007445+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:23:32.007445+0000","last_undegraded":"2023-12-14T18:23:32.007445+0000","last_fullsized":"2023-12-14T18:23:32.007445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:40:25.331281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.513248+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:23:31.513248+0000","last_peered":"2023-12-14T18:23:31.513248+0000","last_clean":"2023-12-14T18:23:31.513248+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:23:31.513248+0000","last_undegraded":"2023-12-14T18:23:31.513248+0000","last_fullsized":"2023-12-14T18:23:31.513248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:51:19.618834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.963026+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:23:31.963026+0000","last_peered":"2023-12-14T18:23:31.963026+0000","last_clean":"2023-12-14T18:23:31.963026+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:23:31.963026+0000","last_undegraded":"2023-12-14T18:23:31.963026+0000","last_fullsized":"2023-12-14T18:23:31.963026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:51:46.572510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.862373+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:23:30.862373+0000","last_peered":"2023-12-14T18:23:30.862373+0000","last_clean":"2023-12-14T18:23:30.862373+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:23:30.862373+0000","last_undegraded":"2023-12-14T18:23:30.862373+0000","last_fullsized":"2023-12-14T18:23:30.862373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:29.432206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:31.962870+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:23:31.962870+0000","last_peered":"2023-12-14T18:23:31.962870+0000","last_clean":"2023-12-14T18:23:31.962870+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:23:31.962870+0000","last_undegraded":"2023-12-14T18:23:31.962870+0000","last_fullsized":"2023-12-14T18:23:31.962870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:48:20.698154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.298819+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:23:30.298819+0000","last_peered":"2023-12-14T18:23:30.298819+0000","last_clean":"2023-12-14T18:23:30.298819+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:23:30.298819+0000","last_undegraded":"2023-12-14T18:23:30.298819+0000","last_fullsized":"2023-12-14T18:23:30.298819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:29:49.538405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:30.297941+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:23:30.297941+0000","last_peered":"2023-12-14T18:23:30.297941+0000","last_clean":"2023-12-14T18:23:30.297941+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:23:30.297941+0000","last_undegraded":"2023-12-14T18:23:30.297941+0000","last_fullsized":"2023-12-14T18:23:30.297941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:01:30.384170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-14T18:23:32.007163+0000","last_change":"2023-12-14T18:23:29.325433+0000","last_active":"2023-12-14T18:23:32.007163+0000","last_peered":"2023-12-14T18:23:32.007163+0000","last_clean":"2023-12-14T18:23:32.007163+0000","last_became_active":"2023-12-14T18:23:29.325027+0000","last_became_peered":"2023-12-14T18:23:29.325027+0000","last_unstale":"2023-12-14T18:23:32.007163+0000","last_undegraded":"2023-12-14T18:23:32.007163+0000","last_fullsized":"2023-12-14T18:23:32.007163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:03:16.376515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60535,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":232,"num_read_kb":178,"num_write":150,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5896,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739256,"statfs":{"total":95995035648,"available":95988998144,"internally_reserved":0,"allocated":851968,"data_stored":409482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.435},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":0.627}]},{"osd":7,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55500000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":9.1150000000000002,"5min":9.1150000000000002,"15min":9.1150000000000002},"last":0.68999999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.79000000000000004}]}]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6888,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738264,"statfs":{"total":95995035648,"available":95987982336,"internally_reserved":0,"allocated":1540096,"data_stored":1057221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.436},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.626}]},{"osd":6,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.79000000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Dec 14 18:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83599999999999997}]}]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6040,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739112,"statfs":{"total":95995035648,"available":95988850688,"internally_reserved":0,"allocated":868352,"data_stored":409718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.311}]},{"osd":4,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.67600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61099999999999999}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.66800000000000004}]}]},{"osd":8,"up_from":55,"seq":236223201309,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6232,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738920,"statfs":{"total":95995035648,"available":95988654080,"internally_reserved":0,"allocated":868352,"data_stored":409638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.877,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.629},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.746},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.879},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.95799999999999996}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":1.0049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430240,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6876,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738276,"statfs":{"total":95995035648,"available":95987994624,"internally_reserved":0,"allocated":1462272,"data_stored":1001867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.748},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82199999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.622}]},{"osd":5,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.622,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93400000000000005,"5min":1.986,"15min":1.986},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":6,"up_from":43,"seq":184683593764,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":856064,"data_stored":409113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.379,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.745,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.313}]},{"osd":4,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74299999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.48499999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.432},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.441}]},{"osd":7,"last update":"Thu Dec 14 18:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.54200000000000004}]},{"osd":8,"last update":"Thu Dec 14 18:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45500000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48599999999999999}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7236,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737916,"statfs":{"total":95995035648,"available":95987625984,"internally_reserved":0,"allocated":913408,"data_stored":465141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.19,"15min":0.19},"max":{"1min":0.77500000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48499999999999999,"15min":0.45500000000000002},"min":{"1min":0.379,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.40100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80500000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.38700000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78100000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Dec 14 18:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.45200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83299999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73999999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80100000000000005,"5min":0.878,"15min":0.878},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.872},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Dec 14 18:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.93200000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.95399999999999996}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.89500000000000002}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7136,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93738016,"statfs":{"total":95995035648,"available":95987728384,"internally_reserved":0,"allocated":876544,"data_stored":410378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.46400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.495},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Dec 14 18:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.32000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.374}]},{"osd":4,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.627,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.501},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71299999999999997,"5min":0.876,"15min":0.876},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47799999999999998}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63300000000000001}]},{"osd":11,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.59099999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411378,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7320,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737832,"statfs":{"total":95995035648,"available":95987539968,"internally_reserved":0,"allocated":933888,"data_stored":466560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.68000000000000005,"5min":0.747,"15min":0.747},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.39200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.746},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Dec 14 18:23:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.747,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.504},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60599999999999998}]},{"osd":10,"last update":"Thu Dec 14 18:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.71899999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":24,"seq":103079215150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6492,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738660,"statfs":{"total":95995035648,"available":95988387840,"internally_reserved":0,"allocated":872448,"data_stored":409430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.33500000000000002},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.27900000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.495}]},{"osd":1,"last update":"Thu Dec 14 18:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.38500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Dec 14 18:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.379,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Dec 14 18:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68000000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56599999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":4,"up_from":31,"seq":133143986219,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":860160,"data_stored":409886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.376,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38,"15min":0.37},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.373,"15min":0.373},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Dec 14 18:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47999999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63600000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.623}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":36,"seq":154618822696,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6952,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738200,"statfs":{"total":95995035648,"available":95987916800,"internally_reserved":0,"allocated":1474560,"data_stored":1001209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.442,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.496},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.752},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82099999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69399999999999995}]},{"osd":9,"last update":"Thu Dec 14 18:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.85799999999999998}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.89100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:24:13.112 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-14T18:24:13.112 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-14T18:24:13.112 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-14T18:24:13.112 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-14T18:24:13.424 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:13.833 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:13 smithi069 ceph-mon[42047]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:13 smithi119 ceph-mon[43973]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:13.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:13 smithi091 ceph-mon[43601]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 -- 172.21.15.69:0/868825892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 msgr2=0x7fcdcc0ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/868825892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc0ff830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0099c0 tx=0x7fcdbc009cd0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 -- 172.21.15.69:0/868825892 shutdown_connections 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/868825892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc104500 0x7fcdcc10c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/868825892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc0ff830 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/868825892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdcc0ffe00 0x7fcdcc103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 -- 172.21.15.69:0/868825892 >> 172.21.15.69:0/868825892 conn(0x7fcdcc0770a0 msgr2=0x7fcdcc0774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 -- 172.21.15.69:0/868825892 shutdown_connections 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.432+0000 7fcdd24e0700 1 -- 172.21.15.69:0/868825892 wait complete. 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 Processor -- start 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 -- start start 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0ffe00 0x7fcdcc1957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdcc104500 0x7fcdcc199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc19a240 con 0x7fcdcc0ff460 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc19a3b0 con 0x7fcdcc104500 2023-12-14T18:24:14.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd24e0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc19a570 con 0x7fcdcc0ffe00 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc195280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37444/0 (socket says 172.21.15.69:37444) 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcbfff700 1 -- 172.21.15.69:0/3173063077 learned_addr learned my addr 172.21.15.69:0/3173063077 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcbfff700 1 -- 172.21.15.69:0/3173063077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0ffe00 msgr2=0x7fcdcc1957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcb7fe700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0ffe00 0x7fcdcc1957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcbfff700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0ffe00 0x7fcdcc1957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdd0a7d700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdcc104500 0x7fcdcc199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.433+0000 7fcdcbfff700 1 -- 172.21.15.69:0/3173063077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdcc104500 msgr2=0x7fcdcc199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdcbfff700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdcc104500 0x7fcdcc199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdcbfff700 1 -- 172.21.15.69:0/3173063077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0095f0 con 0x7fcdcc0ff460 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdcb7fe700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0ffe00 0x7fcdcc1957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdcbfff700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc195280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009f50 tx=0x7fcdbc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc01f070 con 0x7fcdcc0ff460 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcdbc01ac20 con 0x7fcdcc0ff460 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc003fe0 con 0x7fcdcc0ff460 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc10f0f0 con 0x7fcdcc0ff460 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.434+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc10ef60 con 0x7fcdcc0ff460 2023-12-14T18:24:14.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.435+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc10f280 con 0x7fcdcc0ff460 2023-12-14T18:24:14.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.437+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fcdbc023070 con 0x7fcdcc0ff460 2023-12-14T18:24:14.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.437+0000 7fcdc97fa700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcdb40a1260 0x7fcdb40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:14.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.437+0000 7fcdcb7fe700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcdb40a1260 0x7fcdb40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:14.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.437+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcdbc0cfe30 con 0x7fcdcc0ff460 2023-12-14T18:24:14.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.438+0000 7fcdcb7fe700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcdb40a1260 0x7fcdb40a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0005fd0 tx=0x7fcdc0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:14.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.441+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fcdbc099660 con 0x7fcdcc0ff460 2023-12-14T18:24:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.675+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcdcc196690 con 0x7fcdcc0ff460 2023-12-14T18:24:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.675+0000 7fcdc97fa700 1 -- 172.21.15.69:0/3173063077 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcdbc09cc80 con 0x7fcdcc0ff460 2023-12-14T18:24:14.678 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:14.678 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-14T18:24:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcdb40a1260 msgr2=0x7fcdb40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcdb40a1260 0x7fcdb40a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0005fd0 tx=0x7fcdc0005dc0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 msgr2=0x7fcdcc195280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc195280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009f50 tx=0x7fcdbc0047c0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 shutdown_connections 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fcdb40a1260 0x7fcdb40a3710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcdcc104500 0x7fcdcc199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdcc0ff460 0x7fcdcc195280 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 --2- 172.21.15.69:0/3173063077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0ffe00 0x7fcdcc1957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 >> 172.21.15.69:0/3173063077 conn(0x7fcdcc0770a0 msgr2=0x7fcdcc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.677+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 shutdown_connections 2023-12-14T18:24:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:14.678+0000 7fcdd24e0700 1 -- 172.21.15.69:0/3173063077 wait complete. 2023-12-14T18:24:14.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:14 smithi069 ceph-mon[42047]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:14.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:14 smithi119 ceph-mon[43973]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:14.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:14 smithi091 ceph-mon[43601]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:15.086 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-14T18:24:15.087 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 -- 172.21.15.69:0/1679537942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 msgr2=0x7f90b8100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 --2- 172.21.15.69:0/1679537942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b8100ba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009990 tx=0x7f90a8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 -- 172.21.15.69:0/1679537942 shutdown_connections 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 --2- 172.21.15.69:0/1679537942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ffde0 0x7f90b8107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 --2- 172.21.15.69:0/1679537942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b8100ba0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 --2- 172.21.15.69:0/1679537942 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90b80ff430 0x7f90b80ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 -- 172.21.15.69:0/1679537942 >> 172.21.15.69:0/1679537942 conn(0x7f90b80f9f30 msgr2=0x7f90b80fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 -- 172.21.15.69:0/1679537942 shutdown_connections 2023-12-14T18:24:15.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.211+0000 7f90bf861700 1 -- 172.21.15.69:0/1679537942 wait complete. 2023-12-14T18:24:15.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.212+0000 7f90bf861700 1 Processor -- start 2023-12-14T18:24:15.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 -- start start 2023-12-14T18:24:15.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90b80ff430 0x7f90b8194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ffde0 0x7f90b81953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b819c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819c9e0 con 0x7f90b8100790 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819cb20 con 0x7f90b80ff430 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bf861700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819ccb0 con 0x7f90b80ffde0 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b819c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b819c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37470/0 (socket says 172.21.15.69:37470) 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 -- 172.21.15.69:0/1066765813 learned_addr learned my addr 172.21.15.69:0/1066765813 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bd5fd700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90b80ff430 0x7f90b8194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 -- 172.21.15.69:0/1066765813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ffde0 msgr2=0x7f90b81953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bcdfc700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ffde0 0x7f90b81953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ffde0 0x7f90b81953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 -- 172.21.15.69:0/1066765813 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90b80ff430 msgr2=0x7f90b8194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90b80ff430 0x7f90b8194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 -- 172.21.15.69:0/1066765813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80095f0 con 0x7f90b8100790 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.213+0000 7f90bddfe700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b819c410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f90b000b970 tx=0x7f90b000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.214+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000c9b0 con 0x7f90b8100790 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.214+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b810aa40 con 0x7f90b8100790 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.214+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90b0014440 con 0x7f90b8100790 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.214+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00075d0 con 0x7f90b8100790 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.214+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b810a8b0 con 0x7f90b8100790 2023-12-14T18:24:15.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.215+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b81061d0 con 0x7f90b8100790 2023-12-14T18:24:15.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.216+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f90b00145b0 con 0x7f90b8100790 2023-12-14T18:24:15.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.216+0000 7f90ae7fc700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90a40a11e0 0x7f90a40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.216+0000 7f90bd5fd700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90a40a11e0 0x7f90a40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.216+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f90b0006e40 con 0x7f90b8100790 2023-12-14T18:24:15.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.217+0000 7f90bd5fd700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90a40a11e0 0x7f90a40a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c010 tx=0x7f90a800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:15.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.220+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f90b0096020 con 0x7f90b8100790 2023-12-14T18:24:15.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.410+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b802cfe0 con 0x7f90b8100790 2023-12-14T18:24:15.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.412+0000 7f90ae7fc700 1 -- 172.21.15.69:0/1066765813 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22082 (secure 0 0 0) 0x7f90b0019090 con 0x7f90b8100790 2023-12-14T18:24:15.414 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:15.415 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:30.294739+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90a40a11e0 msgr2=0x7f90a40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90a40a11e0 0x7f90a40a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c010 tx=0x7f90a800b540 comp rx=0 tx=0).stop 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 msgr2=0x7f90b819c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b819c410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f90b000b970 tx=0x7f90b000bd30 comp rx=0 tx=0).stop 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 shutdown_connections 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90a40a11e0 0x7f90a40a3690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90b8100790 0x7f90b819c410 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90b80ff430 0x7f90b8194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 --2- 172.21.15.69:0/1066765813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ffde0 0x7f90b81953a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 >> 172.21.15.69:0/1066765813 conn(0x7f90b80f9f30 msgr2=0x7f90b80fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 shutdown_connections 2023-12-14T18:24:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.414+0000 7f90bf861700 1 -- 172.21.15.69:0/1066765813 wait complete. 2023-12-14T18:24:15.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:15.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:15.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 -- 172.21.15.69:0/64389224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0fe890 msgr2=0x7fef0c0feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 --2- 172.21.15.69:0/64389224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0fe890 0x7fef0c0feca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef00009990 tx=0x7fef00009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 -- 172.21.15.69:0/64389224 shutdown_connections 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 --2- 172.21.15.69:0/64389224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 0x7fef0c106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 --2- 172.21.15.69:0/64389224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0fe890 0x7fef0c0feca0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 --2- 172.21.15.69:0/64389224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef0c0ffa80 0x7fef0c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 -- 172.21.15.69:0/64389224 >> 172.21.15.69:0/64389224 conn(0x7fef0c0f9ed0 msgr2=0x7fef0c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 -- 172.21.15.69:0/64389224 shutdown_connections 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 -- 172.21.15.69:0/64389224 wait complete. 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.554+0000 7fef11aa3700 1 Processor -- start 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 -- start start 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef0c0fe890 0x7fef0c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 0x7fef0c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 0x7fef0c19d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c19da70 con 0x7fef0c0ffa80 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c19dbb0 con 0x7fef0c0fe890 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c19dd40 con 0x7fef0c100410 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 0x7fef0c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 0x7fef0c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50966/0 (socket says 172.21.15.69:50966) 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 -- 172.21.15.69:0/1421464472 learned_addr learned my addr 172.21.15.69:0/1421464472 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0b7fe700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef0c0fe890 0x7fef0c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0bfff700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 0x7fef0c19d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 -- 172.21.15.69:0/1421464472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 msgr2=0x7fef0c19d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 0x7fef0c19d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 -- 172.21.15.69:0/1421464472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef0c0fe890 msgr2=0x7fef0c195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef0c0fe890 0x7fef0c195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 -- 172.21.15.69:0/1421464472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000095f0 con 0x7fef0c0ffa80 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0bfff700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 0x7fef0c19d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef0affd700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 0x7fef0c196430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feefc00c920 tx=0x7feefc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc007b00 con 0x7fef0c0ffa80 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feefc004cc0 con 0x7fef0c0ffa80 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c10a930 con 0x7fef0c0ffa80 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc005490 con 0x7fef0c0ffa80 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.555+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c10a7a0 con 0x7fef0c0ffa80 2023-12-14T18:24:15.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.556+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c19e3d0 con 0x7fef0c0ffa80 2023-12-14T18:24:15.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.558+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7feefc004750 con 0x7fef0c0ffa80 2023-12-14T18:24:15.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.558+0000 7fef08ff9700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feef40a11e0 0x7feef40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.558+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feefc0cc8c0 con 0x7fef0c0ffa80 2023-12-14T18:24:15.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.558+0000 7fef0b7fe700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feef40a11e0 0x7feef40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.559+0000 7fef0b7fe700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feef40a11e0 0x7feef40a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef0000c010 tx=0x7fef0000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:15.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.561+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7feefc096060 con 0x7fef0c0ffa80 2023-12-14T18:24:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:15 smithi069 ceph-mon[42047]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T18:24:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:15 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3173063077' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-14T18:24:15.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:15 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1066765813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.751+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef0c19e980 con 0x7fef0c0ffa80 2023-12-14T18:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.752+0000 7fef08ff9700 1 -- 172.21.15.69:0/1421464472 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7feefc01d020 con 0x7fef0c0ffa80 2023-12-14T18:24:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feef40a11e0 msgr2=0x7feef40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feef40a11e0 0x7feef40a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef0000c010 tx=0x7fef0000b540 comp rx=0 tx=0).stop 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 msgr2=0x7fef0c196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 0x7fef0c196430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feefc00c920 tx=0x7feefc00cce0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 shutdown_connections 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7feef40a11e0 0x7feef40a3690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef0c100410 0x7fef0c19d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef0c0fe890 0x7fef0c195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 --2- 172.21.15.69:0/1421464472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef0c0ffa80 0x7fef0c196430 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 >> 172.21.15.69:0/1421464472 conn(0x7fef0c0f9ed0 msgr2=0x7fef0c107620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 shutdown_connections 2023-12-14T18:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.754+0000 7fef11aa3700 1 -- 172.21.15.69:0/1421464472 wait complete. 2023-12-14T18:24:15.768 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:15 smithi119 ceph-mon[43973]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T18:24:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:15 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3173063077' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-14T18:24:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:15 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1066765813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:15 smithi091 ceph-mon[43601]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T18:24:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:15 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3173063077' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-14T18:24:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:15 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1066765813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 -- 172.21.15.69:0/3576821850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280fe890 msgr2=0x7f21280feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 --2- 172.21.15.69:0/3576821850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280fe890 0x7f21280feca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2118009990 tx=0x7f2118009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 -- 172.21.15.69:0/3576821850 shutdown_connections 2023-12-14T18:24:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 --2- 172.21.15.69:0/3576821850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2128100410 0x7f2128106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 --2- 172.21.15.69:0/3576821850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280fe890 0x7f21280feca0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 --2- 172.21.15.69:0/3576821850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21280ffa80 0x7f21280ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 -- 172.21.15.69:0/3576821850 >> 172.21.15.69:0/3576821850 conn(0x7f21280f9ed0 msgr2=0x7f21280fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 -- 172.21.15.69:0/3576821850 shutdown_connections 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 -- 172.21.15.69:0/3576821850 wait complete. 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 Processor -- start 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 -- start start 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21280fe890 0x7f21280fc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.891+0000 7f212f384700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 0x7f212819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212f384700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2128100410 0x7f212819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212f384700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212819db80 con 0x7f21280ffa80 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212f384700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212819dcf0 con 0x7f21280fe890 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212f384700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212819deb0 con 0x7f2128100410 2023-12-14T18:24:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 0x7f212819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 0x7f212819ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50984/0 (socket says 172.21.15.69:50984) 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 -- 172.21.15.69:0/1771696134 learned_addr learned my addr 172.21.15.69:0/1771696134 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212d120700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21280fe890 0x7f21280fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212d921700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2128100410 0x7f212819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 -- 172.21.15.69:0/1771696134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2128100410 msgr2=0x7f212819d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2128100410 0x7f212819d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 -- 172.21.15.69:0/1771696134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21280fe890 msgr2=0x7f21280fc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21280fe890 0x7f21280fc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 -- 172.21.15.69:0/1771696134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180095f0 con 0x7f21280ffa80 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212c91f700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 0x7f212819ad60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f212400b530 tx=0x7f212400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011830 con 0x7f21280ffa80 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212810a120 con 0x7f21280ffa80 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2124011e20 con 0x7f21280ffa80 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124010db0 con 0x7f21280ffa80 2023-12-14T18:24:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.892+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2128109f90 con 0x7f21280ffa80 2023-12-14T18:24:15.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.893+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128106400 con 0x7f21280ffa80 2023-12-14T18:24:15.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.894+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2124011990 con 0x7f21280ffa80 2023-12-14T18:24:15.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.895+0000 7f211e7fc700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f21140a11e0 0x7f21140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:15.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.895+0000 7f212d120700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f21140a11e0 0x7f21140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.895+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f21240cc1b0 con 0x7f21280ffa80 2023-12-14T18:24:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.895+0000 7f212d120700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f21140a11e0 0x7f21140a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f211800b5c0 tx=0x7f2118005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:15.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:15.899+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2124095a60 con 0x7f21280ffa80 2023-12-14T18:24:16.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.088+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2128061bc0 con 0x7f21280ffa80 2023-12-14T18:24:16.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.088+0000 7f211e7fc700 1 -- 172.21.15.69:0/1771696134 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2124099080 con 0x7f21280ffa80 2023-12-14T18:24:16.090 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f21140a11e0 msgr2=0x7f21140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f21140a11e0 0x7f21140a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f211800b5c0 tx=0x7f2118005960 comp rx=0 tx=0).stop 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 msgr2=0x7f212819ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 0x7f212819ad60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f212400b530 tx=0x7f212400b840 comp rx=0 tx=0).stop 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 shutdown_connections 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f21140a11e0 0x7f21140a3690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2128100410 0x7f212819d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21280fe890 0x7f21280fc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 --2- 172.21.15.69:0/1771696134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21280ffa80 0x7f212819ad60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 >> 172.21.15.69:0/1771696134 conn(0x7f21280f9ed0 msgr2=0x7f2128103540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:16.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 shutdown_connections 2023-12-14T18:24:16.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.090+0000 7f212f384700 1 -- 172.21.15.69:0/1771696134 wait complete. 2023-12-14T18:24:16.104 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:16.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 -- 172.21.15.69:0/3075080567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c0ff120 msgr2=0x7f285c0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 --2- 172.21.15.69:0/3075080567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c0ff120 0x7f285c0ff530 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2850009990 tx=0x7f2850009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 -- 172.21.15.69:0/3075080567 shutdown_connections 2023-12-14T18:24:16.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 --2- 172.21.15.69:0/3075080567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c100ca0 0x7f285c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 --2- 172.21.15.69:0/3075080567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c0ff120 0x7f285c0ff530 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 --2- 172.21.15.69:0/3075080567 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c100310 0x7f285c100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 -- 172.21.15.69:0/3075080567 >> 172.21.15.69:0/3075080567 conn(0x7f285c0fa740 msgr2=0x7f285c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 -- 172.21.15.69:0/3075080567 shutdown_connections 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 -- 172.21.15.69:0/3075080567 wait complete. 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.227+0000 7f286153c700 1 Processor -- start 2023-12-14T18:24:16.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 -- start start 2023-12-14T18:24:16.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c0ff120 0x7f285c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 0x7f285c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c100ca0 0x7f285c19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19da60 con 0x7f285c100310 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19dbd0 con 0x7f285c100ca0 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19dd90 con 0x7f285c0ff120 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 0x7f285c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 0x7f285c19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51002/0 (socket says 172.21.15.69:51002) 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 -- 172.21.15.69:0/627198192 learned_addr learned my addr 172.21.15.69:0/627198192 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285b7fe700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c100ca0 0x7f285c19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 -- 172.21.15.69:0/627198192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c0ff120 msgr2=0x7f285c068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c0ff120 0x7f285c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 -- 172.21.15.69:0/627198192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c100ca0 msgr2=0x7f285c19d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c100ca0 0x7f285c19d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 -- 172.21.15.69:0/627198192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500095f0 con 0x7f285c100310 2023-12-14T18:24:16.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f285a7fc700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 0x7f285c19ac40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d950 tx=0x7f284c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:16.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c009940 con 0x7f285c100310 2023-12-14T18:24:16.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.228+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c10a940 con 0x7f285c100310 2023-12-14T18:24:16.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.229+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f284c010460 con 0x7f285c100310 2023-12-14T18:24:16.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.229+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00f620 con 0x7f285c100310 2023-12-14T18:24:16.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.229+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c10a7b0 con 0x7f285c100310 2023-12-14T18:24:16.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.229+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c19e4d0 con 0x7f285c100310 2023-12-14T18:24:16.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.230+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f284c0105d0 con 0x7f285c100310 2023-12-14T18:24:16.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.231+0000 7f2843fff700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a11e0 0x7f28440a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.231+0000 7f285affd700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a11e0 0x7f28440a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.231+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f284c0cc740 con 0x7f285c100310 2023-12-14T18:24:16.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.232+0000 7f285affd700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a11e0 0x7f28440a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f285000b5c0 tx=0x7f2850005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:16.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.236+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f284c095ee0 con 0x7f285c100310 2023-12-14T18:24:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.426+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f285c106120 con 0x7f285c100310 2023-12-14T18:24:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.426+0000 7f2843fff700 1 -- 172.21.15.69:0/627198192 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f284c099500 con 0x7f285c100310 2023-12-14T18:24:16.428 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a11e0 msgr2=0x7f28440a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a11e0 0x7f28440a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f285000b5c0 tx=0x7f2850005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 msgr2=0x7f285c19ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 0x7f285c19ac40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d950 tx=0x7f284c00dc60 comp rx=0 tx=0).stop 2023-12-14T18:24:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 shutdown_connections 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a11e0 0x7f28440a3690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c100ca0 0x7f285c19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c0ff120 0x7f285c068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 --2- 172.21.15.69:0/627198192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f285c100310 0x7f285c19ac40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 >> 172.21.15.69:0/627198192 conn(0x7f285c0fa740 msgr2=0x7f285c0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 shutdown_connections 2023-12-14T18:24:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.428+0000 7f286153c700 1 -- 172.21.15.69:0/627198192 wait complete. 2023-12-14T18:24:16.443 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 -- 172.21.15.69:0/2341739200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100300 msgr2=0x7f400c100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 --2- 172.21.15.69:0/2341739200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100300 0x7f400c100750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009990 tx=0x7f3ffc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 -- 172.21.15.69:0/2341739200 shutdown_connections 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 --2- 172.21.15.69:0/2341739200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f400c100c90 0x7f400c107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 --2- 172.21.15.69:0/2341739200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f400c0ff110 0x7f400c0ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 --2- 172.21.15.69:0/2341739200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100300 0x7f400c100750 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.563+0000 7f40121ec700 1 -- 172.21.15.69:0/2341739200 >> 172.21.15.69:0/2341739200 conn(0x7f400c0fa6f0 msgr2=0x7f400c0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 -- 172.21.15.69:0/2341739200 shutdown_connections 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 -- 172.21.15.69:0/2341739200 wait complete. 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 Processor -- start 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 -- start start 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f400c0ff110 0x7f400c195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f400c100300 0x7f400c196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 0x7f400c19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c19d9d0 con 0x7f400c100c90 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c19db10 con 0x7f400c100300 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.564+0000 7f40121ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c19dca0 con 0x7f400c0ff110 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 0x7f400c19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 0x7f400c19d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51016/0 (socket says 172.21.15.69:51016) 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 -- 172.21.15.69:0/384630262 learned_addr learned my addr 172.21.15.69:0/384630262 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400affd700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f400c100300 0x7f400c196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400b7fe700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f400c0ff110 0x7f400c195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 -- 172.21.15.69:0/384630262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f400c0ff110 msgr2=0x7f400c195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f400c0ff110 0x7f400c195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 -- 172.21.15.69:0/384630262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f400c100300 msgr2=0x7f400c196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f400c100300 0x7f400c196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 -- 172.21.15.69:0/384630262 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0095f0 con 0x7f400c100c90 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f400bfff700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 0x7f400c19d400 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f400400ada0 tx=0x7f400400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400f070 con 0x7f400c100c90 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4004007b30 con 0x7f400c100c90 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c10ba90 con 0x7f400c100c90 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004005280 con 0x7f400c100c90 2023-12-14T18:24:16.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.565+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c10b900 con 0x7f400c100c90 2023-12-14T18:24:16.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.566+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c1066a0 con 0x7f400c100c90 2023-12-14T18:24:16.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.567+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f400400a090 con 0x7f400c100c90 2023-12-14T18:24:16.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.568+0000 7f4008ff9700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ff80a11e0 0x7f3ff80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.568+0000 7f400b7fe700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ff80a11e0 0x7f3ff80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.568+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f40040cc3c0 con 0x7f400c100c90 2023-12-14T18:24:16.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.568+0000 7f400b7fe700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ff80a11e0 0x7f3ff80a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f400c100160 tx=0x7f3ff400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:16.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.571+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4004095bf0 con 0x7f400c100c90 2023-12-14T18:24:16.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:16 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1421464472' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:16 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1771696134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:16 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/627198192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.801+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f400c02cfe0 con 0x7f400c100c90 2023-12-14T18:24:16.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.802+0000 7f4008ff9700 1 -- 172.21.15.69:0/384630262 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7f4004099210 con 0x7f400c100c90 2023-12-14T18:24:16.803 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ff80a11e0 msgr2=0x7f3ff80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ff80a11e0 0x7f3ff80a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f400c100160 tx=0x7f3ff400a3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 msgr2=0x7f400c19d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 0x7f400c19d400 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f400400ada0 tx=0x7f400400c330 comp rx=0 tx=0).stop 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 shutdown_connections 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ff80a11e0 0x7f3ff80a3690 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f400c100c90 0x7f400c19d400 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f400c0ff110 0x7f400c195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 --2- 172.21.15.69:0/384630262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f400c100300 0x7f400c196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 >> 172.21.15.69:0/384630262 conn(0x7f400c0fa6f0 msgr2=0x7f400c1037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 shutdown_connections 2023-12-14T18:24:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.804+0000 7f40121ec700 1 -- 172.21.15.69:0/384630262 wait complete. 2023-12-14T18:24:16.807 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:16.818 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:16 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1421464472' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:16 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1771696134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:16 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/627198192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:16 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1421464472' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:16 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1771696134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:16 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/627198192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 -- 172.21.15.69:0/60981319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff000100330 msgr2=0x7ff000100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 --2- 172.21.15.69:0/60981319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff000100330 0x7ff000100780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feff0009990 tx=0x7feff0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 -- 172.21.15.69:0/60981319 shutdown_connections 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 --2- 172.21.15.69:0/60981319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff000100cc0 0x7ff000107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 --2- 172.21.15.69:0/60981319 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0000ff140 0x7ff0000ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 --2- 172.21.15.69:0/60981319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff000100330 0x7ff000100780 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 -- 172.21.15.69:0/60981319 >> 172.21.15.69:0/60981319 conn(0x7ff0000fa720 msgr2=0x7ff0000fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 -- 172.21.15.69:0/60981319 shutdown_connections 2023-12-14T18:24:16.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 -- 172.21.15.69:0/60981319 wait complete. 2023-12-14T18:24:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 Processor -- start 2023-12-14T18:24:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.939+0000 7ff005ed9700 1 -- start start 2023-12-14T18:24:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 0x7ff0001030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff000100330 0x7ff000101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff000100cc0 0x7ff000101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0001023f0 con 0x7ff0000ff140 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff000102560 con 0x7ff000100cc0 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00019ff10 con 0x7ff000100330 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 0x7ff0001030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 0x7ff0001030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51038/0 (socket says 172.21.15.69:51038) 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 -- 172.21.15.69:0/3462599609 learned_addr learned my addr 172.21.15.69:0/3462599609 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7feffeffd700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff000100330 0x7ff000101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7feffffff700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff000100cc0 0x7ff000101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 -- 172.21.15.69:0/3462599609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff000100330 msgr2=0x7ff000101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff000100330 0x7ff000101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 -- 172.21.15.69:0/3462599609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff000100cc0 msgr2=0x7ff000101c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff000100cc0 0x7ff000101c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 -- 172.21.15.69:0/3462599609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00095f0 con 0x7ff0000ff140 2023-12-14T18:24:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7fefff7fe700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 0x7ff0001030d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feff400e970 tx=0x7feff400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4009790 con 0x7ff0000ff140 2023-12-14T18:24:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feff400c7e0 con 0x7ff0000ff140 2023-12-14T18:24:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4003bd0 con 0x7ff0000ff140 2023-12-14T18:24:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00010a950 con 0x7ff0000ff140 2023-12-14T18:24:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.940+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00010a7c0 con 0x7ff0000ff140 2023-12-14T18:24:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.941+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0001a0610 con 0x7ff0000ff140 2023-12-14T18:24:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.943+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7feff400c950 con 0x7ff0000ff140 2023-12-14T18:24:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.943+0000 7feffcff9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fefe80a1260 0x7fefe80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.943+0000 7feffeffd700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fefe80a1260 0x7fefe80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.944+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feff4014070 con 0x7ff0000ff140 2023-12-14T18:24:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.944+0000 7feffeffd700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fefe80a1260 0x7fefe80a3710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feff000b2e0 tx=0x7feff0004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:16.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:16.947+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7feff4096320 con 0x7ff0000ff140 2023-12-14T18:24:17.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.136+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0001a0bc0 con 0x7ff0000ff140 2023-12-14T18:24:17.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.138+0000 7feffcff9700 1 -- 172.21.15.69:0/3462599609 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22082 (secure 0 0 0) 0x7feff4099940 con 0x7ff0000ff140 2023-12-14T18:24:17.140 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:17.140 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:30.294739+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:17.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fefe80a1260 msgr2=0x7fefe80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fefe80a1260 0x7fefe80a3710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feff000b2e0 tx=0x7feff0004000 comp rx=0 tx=0).stop 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 msgr2=0x7ff0001030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 0x7ff0001030d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feff400e970 tx=0x7feff400ec80 comp rx=0 tx=0).stop 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 shutdown_connections 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fefe80a1260 0x7fefe80a3710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff000100cc0 0x7ff000101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0000ff140 0x7ff0001030d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 --2- 172.21.15.69:0/3462599609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff000100330 0x7ff000101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.140+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 >> 172.21.15.69:0/3462599609 conn(0x7ff0000fa720 msgr2=0x7ff000068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.141+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 shutdown_connections 2023-12-14T18:24:17.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.141+0000 7ff005ed9700 1 -- 172.21.15.69:0/3462599609 wait complete. 2023-12-14T18:24:17.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:17.155 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.277+0000 7f286039d700 1 -- 172.21.15.69:0/3022788145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 msgr2=0x7f28580ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.277+0000 7f286039d700 1 --2- 172.21.15.69:0/3022788145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f28580ff570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2854009990 tx=0x7f2854009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 -- 172.21.15.69:0/3022788145 shutdown_connections 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 --2- 172.21.15.69:0/3022788145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2858100ce0 0x7f28581075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 --2- 172.21.15.69:0/3022788145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f28580ff570 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 --2- 172.21.15.69:0/3022788145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100350 0x7f28581007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 -- 172.21.15.69:0/3022788145 >> 172.21.15.69:0/3022788145 conn(0x7f28580fa780 msgr2=0x7f28580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 -- 172.21.15.69:0/3022788145 shutdown_connections 2023-12-14T18:24:17.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 -- 172.21.15.69:0/3022788145 wait complete. 2023-12-14T18:24:17.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 Processor -- start 2023-12-14T18:24:17.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.278+0000 7f286039d700 1 -- start start 2023-12-14T18:24:17.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f2858194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2858100350 0x7f2858195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100ce0 0x7f285819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285819c980 con 0x7f28580ff160 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285819cac0 con 0x7f2858100350 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285819cc50 con 0x7f2858100ce0 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f2858194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f2858194e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51056/0 (socket says 172.21.15.69:51056) 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 -- 172.21.15.69:0/2068533239 learned_addr learned my addr 172.21.15.69:0/2068533239 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e93a700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100ce0 0x7f285819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285d938700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2858100350 0x7f2858195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 -- 172.21.15.69:0/2068533239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100ce0 msgr2=0x7f285819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100ce0 0x7f285819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 -- 172.21.15.69:0/2068533239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2858100350 msgr2=0x7f2858195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2858100350 0x7f2858195340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 -- 172.21.15.69:0/2068533239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540095f0 con 0x7f28580ff160 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e93a700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100ce0 0x7f285819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:17.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f285e139700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f2858194e00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2854000c00 tx=0x7f2854009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285401d070 con 0x7f28580ff160 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28540040b0 con 0x7f28580ff160 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285810a980 con 0x7f28580ff160 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854022cb0 con 0x7f28580ff160 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.279+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285810a7f0 con 0x7f28580ff160 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.280+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285819d1f0 con 0x7f28580ff160 2023-12-14T18:24:17.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.281+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2854022470 con 0x7f28580ff160 2023-12-14T18:24:17.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.282+0000 7f284f7fe700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a1260 0x7f28440a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.282+0000 7f285d938700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a1260 0x7f28440a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.282+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f28540ce510 con 0x7f28580ff160 2023-12-14T18:24:17.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.282+0000 7f285d938700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a1260 0x7f28440a3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2848005950 tx=0x7f28480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:17.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.285+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2854097c40 con 0x7f28580ff160 2023-12-14T18:24:17.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.476+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28581060b0 con 0x7f28580ff160 2023-12-14T18:24:17.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.477+0000 7f284f7fe700 1 -- 172.21.15.69:0/2068533239 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f285409b260 con 0x7f28580ff160 2023-12-14T18:24:17.478 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a1260 msgr2=0x7f28440a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a1260 0x7f28440a3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2848005950 tx=0x7f28480058e0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 msgr2=0x7f2858194e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f2858194e00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2854000c00 tx=0x7f2854009f90 comp rx=0 tx=0).stop 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 shutdown_connections 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f28440a1260 0x7f28440a3710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2858100ce0 0x7f285819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28580ff160 0x7f2858194e00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 --2- 172.21.15.69:0/2068533239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2858100350 0x7f2858195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 >> 172.21.15.69:0/2068533239 conn(0x7f28580fa780 msgr2=0x7f28580fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:17.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 shutdown_connections 2023-12-14T18:24:17.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.479+0000 7f286039d700 1 -- 172.21.15.69:0/2068533239 wait complete. 2023-12-14T18:24:17.493 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:17.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- 172.21.15.69:0/2247444564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e80ffda0 msgr2=0x7fd6e8107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2247444564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e80ffda0 0x7fd6e8107650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000b0a0 tx=0x7fd6e000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- 172.21.15.69:0/2247444564 shutdown_connections 2023-12-14T18:24:17.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2247444564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e80ffda0 0x7fd6e8107650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2247444564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e81007a0 0x7fd6e8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2247444564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80ff3f0 0x7fd6e80ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- 172.21.15.69:0/2247444564 >> 172.21.15.69:0/2247444564 conn(0x7fd6e80f9f70 msgr2=0x7fd6e80fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- 172.21.15.69:0/2247444564 shutdown_connections 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- 172.21.15.69:0/2247444564 wait complete. 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 Processor -- start 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- start start 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80ff3f0 0x7fd6e8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e80ffda0 0x7fd6e8196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 0x7fd6e819d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e819db70 con 0x7fd6e81007a0 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e819dcb0 con 0x7fd6e80ffda0 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.617+0000 7fd6ed856700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e819de40 con 0x7fd6e80ff3f0 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 0x7fd6e819d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 0x7fd6e819d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51072/0 (socket says 172.21.15.69:51072) 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 -- 172.21.15.69:0/2730750448 learned_addr learned my addr 172.21.15.69:0/2730750448 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e67fc700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e80ffda0 0x7fd6e8196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e6ffd700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80ff3f0 0x7fd6e8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 -- 172.21.15.69:0/2730750448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80ff3f0 msgr2=0x7fd6e8195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80ff3f0 0x7fd6e8195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 -- 172.21.15.69:0/2730750448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e80ffda0 msgr2=0x7fd6e8196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e80ffda0 0x7fd6e8196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 -- 172.21.15.69:0/2730750448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009d00 con 0x7fd6e81007a0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6e77fe700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 0x7fd6e819d5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00062a0 tx=0x7fd6e0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000e040 con 0x7fd6e81007a0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6e001db20 con 0x7fd6e81007a0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e810aa00 con 0x7fd6e81007a0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e001bac0 con 0x7fd6e81007a0 2023-12-14T18:24:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.618+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e810a870 con 0x7fd6e81007a0 2023-12-14T18:24:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.619+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e8107390 con 0x7fd6e81007a0 2023-12-14T18:24:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.620+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd6e001dc90 con 0x7fd6e81007a0 2023-12-14T18:24:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.621+0000 7fd6ec854700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd6d00a11e0 0x7fd6d00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.621+0000 7fd6e6ffd700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd6d00a11e0 0x7fd6d00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.621+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd6e00ceaf0 con 0x7fd6e81007a0 2023-12-14T18:24:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.621+0000 7fd6e6ffd700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd6d00a11e0 0x7fd6d00a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8068ad0 tx=0x7fd6dc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:17.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.624+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd6e00983e0 con 0x7fd6e81007a0 2023-12-14T18:24:17.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.814+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6e80617b0 con 0x7fd6e81007a0 2023-12-14T18:24:17.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.815+0000 7fd6ec854700 1 -- 172.21.15.69:0/2730750448 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6e00210a0 con 0x7fd6e81007a0 2023-12-14T18:24:17.816 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd6d00a11e0 msgr2=0x7fd6d00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd6d00a11e0 0x7fd6d00a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8068ad0 tx=0x7fd6dc00a380 comp rx=0 tx=0).stop 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 msgr2=0x7fd6e819d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 0x7fd6e819d5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00062a0 tx=0x7fd6e0004d00 comp rx=0 tx=0).stop 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 shutdown_connections 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd6d00a11e0 0x7fd6d00a3690 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6e81007a0 0x7fd6e819d5a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80ff3f0 0x7fd6e8195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 --2- 172.21.15.69:0/2730750448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e80ffda0 0x7fd6e8196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 >> 172.21.15.69:0/2730750448 conn(0x7fd6e80f9f70 msgr2=0x7fd6e80fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 shutdown_connections 2023-12-14T18:24:17.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.817+0000 7fd6ed856700 1 -- 172.21.15.69:0/2730750448 wait complete. 2023-12-14T18:24:17.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:17 smithi069 ceph-mon[42047]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:17.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:17 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/384630262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:17.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:17 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3462599609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:17.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:17 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2068533239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:17.831 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:17 smithi119 ceph-mon[43973]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:17 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/384630262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:17 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3462599609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:17 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2068533239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:17 smithi091 ceph-mon[43601]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:24:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:17 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/384630262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:17 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3462599609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:17 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2068533239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 -- 172.21.15.69:0/2250583369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 msgr2=0x7fae481075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 --2- 172.21.15.69:0/2250583369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae481075a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b0a0 tx=0x7fae4000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 -- 172.21.15.69:0/2250583369 shutdown_connections 2023-12-14T18:24:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 --2- 172.21.15.69:0/2250583369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae481075a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 --2- 172.21.15.69:0/2250583369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae480ff160 0x7fae480ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 --2- 172.21.15.69:0/2250583369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae48100350 0x7fae481007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 -- 172.21.15.69:0/2250583369 >> 172.21.15.69:0/2250583369 conn(0x7fae480fa780 msgr2=0x7fae480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:17.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 -- 172.21.15.69:0/2250583369 shutdown_connections 2023-12-14T18:24:17.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.954+0000 7fae4f594700 1 -- 172.21.15.69:0/2250583369 wait complete. 2023-12-14T18:24:17.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 Processor -- start 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 -- start start 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae480ff160 0x7fae48196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae48100350 0x7fae48196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae4819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4819db90 con 0x7fae48100ce0 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4819dcd0 con 0x7fae48100350 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4f594700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4819de60 con 0x7fae480ff160 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4db31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae4819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4db31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae4819d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51086/0 (socket says 172.21.15.69:51086) 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4db31700 1 -- 172.21.15.69:0/1308163992 learned_addr learned my addr 172.21.15.69:0/1308163992 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4cb2f700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae48100350 0x7fae48196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4d330700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae480ff160 0x7fae48196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4db31700 1 -- 172.21.15.69:0/1308163992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae480ff160 msgr2=0x7fae48196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.955+0000 7fae4db31700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae480ff160 0x7fae48196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae4db31700 1 -- 172.21.15.69:0/1308163992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae48100350 msgr2=0x7fae48196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae4db31700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae48100350 0x7fae48196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae4db31700 1 -- 172.21.15.69:0/1308163992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40009d00 con 0x7fae48100ce0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae4db31700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae4819d5c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b070 tx=0x7fae40004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000e040 con 0x7fae48100ce0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae40003e90 con 0x7fae48100ce0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4810a9e0 con 0x7fae48100ce0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40004020 con 0x7fae48100ce0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.956+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4810a850 con 0x7fae48100ce0 2023-12-14T18:24:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.957+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae481071c0 con 0x7fae48100ce0 2023-12-14T18:24:17.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.958+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fae4001b660 con 0x7fae48100ce0 2023-12-14T18:24:17.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.958+0000 7fae3e7fc700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fae340a11e0 0x7fae340a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:17.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.959+0000 7fae4d330700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fae340a11e0 0x7fae340a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:17.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.959+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fae400ce760 con 0x7fae48100ce0 2023-12-14T18:24:17.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.959+0000 7fae4d330700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fae340a11e0 0x7fae340a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae481001b0 tx=0x7fae3800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:17.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:17.962+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fae40097e90 con 0x7fae48100ce0 2023-12-14T18:24:18.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.149+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae48067160 con 0x7fae48100ce0 2023-12-14T18:24:18.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.149+0000 7fae3e7fc700 1 -- 172.21.15.69:0/1308163992 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae4009b4b0 con 0x7fae48100ce0 2023-12-14T18:24:18.151 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fae340a11e0 msgr2=0x7fae340a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fae340a11e0 0x7fae340a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae481001b0 tx=0x7fae3800b5b0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 msgr2=0x7fae4819d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae4819d5c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b070 tx=0x7fae40004d30 comp rx=0 tx=0).stop 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 shutdown_connections 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fae340a11e0 0x7fae340a3690 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae48100ce0 0x7fae4819d5c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae480ff160 0x7fae48196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 --2- 172.21.15.69:0/1308163992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae48100350 0x7fae48196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 >> 172.21.15.69:0/1308163992 conn(0x7fae480fa780 msgr2=0x7fae480fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 shutdown_connections 2023-12-14T18:24:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.152+0000 7fae4f594700 1 -- 172.21.15.69:0/1308163992 wait complete. 2023-12-14T18:24:18.166 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:18.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 -- 172.21.15.69:0/2521618044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180fea80 msgr2=0x7f83180fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 --2- 172.21.15.69:0/2521618044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180fea80 0x7f83180fee90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8314009990 tx=0x7f8314009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 -- 172.21.15.69:0/2521618044 shutdown_connections 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 --2- 172.21.15.69:0/2521618044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83180ffd80 0x7f83181001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 --2- 172.21.15.69:0/2521618044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180fea80 0x7f83180fee90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 --2- 172.21.15.69:0/2521618044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f83180ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 -- 172.21.15.69:0/2521618044 >> 172.21.15.69:0/2521618044 conn(0x7f83180fa6f0 msgr2=0x7f83180fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 -- 172.21.15.69:0/2521618044 shutdown_connections 2023-12-14T18:24:18.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.285+0000 7f831fa27700 1 -- 172.21.15.69:0/2521618044 wait complete. 2023-12-14T18:24:18.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.286+0000 7f831fa27700 1 Processor -- start 2023-12-14T18:24:18.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.286+0000 7f831fa27700 1 -- start start 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.286+0000 7f831fa27700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83180fea80 0x7f8318198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.286+0000 7f831fa27700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f8318198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.286+0000 7f831fa27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 0x7f831819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.286+0000 7f831fa27700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831819fc80 con 0x7f83180ffd80 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831fa27700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831819fdc0 con 0x7f83180ff3d0 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831fa27700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831819ff50 con 0x7f83180fea80 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 0x7f831819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831cfc2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f8318198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831d7c3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83180fea80 0x7f8318198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 0x7f831819f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51098/0 (socket says 172.21.15.69:51098) 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831cfc2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f8318198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:48336/0 (socket says 172.21.15.69:48336) 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 -- 172.21.15.69:0/119824318 learned_addr learned my addr 172.21.15.69:0/119824318 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 -- 172.21.15.69:0/119824318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83180fea80 msgr2=0x7f8318198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83180fea80 0x7f8318198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 -- 172.21.15.69:0/119824318 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 msgr2=0x7f8318198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f8318198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 -- 172.21.15.69:0/119824318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140095f0 con 0x7f83180ffd80 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831cfc2700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f8318198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831dfc4700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 0x7f831819f6b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8310007ee0 tx=0x7f831000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310017070 con 0x7f83180ffd80 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f831000f040 con 0x7f83180ffd80 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831810dc60 con 0x7f83180ffd80 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310005570 con 0x7f83180ffd80 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.287+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831810dad0 con 0x7f83180ffd80 2023-12-14T18:24:18.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.288+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318109860 con 0x7f83180ffd80 2023-12-14T18:24:18.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.289+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f831000db20 con 0x7f83180ffd80 2023-12-14T18:24:18.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.290+0000 7f830e7fc700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f83040a11e0 0x7f83040a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.290+0000 7f831d7c3700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f83040a11e0 0x7f83040a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.290+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f83100cc6c0 con 0x7f83180ffd80 2023-12-14T18:24:18.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.290+0000 7f831d7c3700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f83040a11e0 0x7f83040a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f831400b5c0 tx=0x7f8314009f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:18.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.293+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8310095e60 con 0x7f83180ffd80 2023-12-14T18:24:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.526+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f831802cfe0 con 0x7f83180ffd80 2023-12-14T18:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.527+0000 7f830e7fc700 1 -- 172.21.15.69:0/119824318 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7f8310099480 con 0x7f83180ffd80 2023-12-14T18:24:18.529 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:18.529 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f83040a11e0 msgr2=0x7f83040a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f83040a11e0 0x7f83040a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f831400b5c0 tx=0x7f8314009f00 comp rx=0 tx=0).stop 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 msgr2=0x7f831819f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 0x7f831819f6b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8310007ee0 tx=0x7f831000d3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 shutdown_connections 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f83040a11e0 0x7f83040a3690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83180ffd80 0x7f831819f6b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83180fea80 0x7f8318198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 --2- 172.21.15.69:0/119824318 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83180ff3d0 0x7f8318198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 >> 172.21.15.69:0/119824318 conn(0x7f83180fa6f0 msgr2=0x7f83180fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 shutdown_connections 2023-12-14T18:24:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.529+0000 7f831fa27700 1 -- 172.21.15.69:0/119824318 wait complete. 2023-12-14T18:24:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:18.543 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:18.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 -- 172.21.15.69:0/2720845657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200fe8a0 msgr2=0x7f51200fecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 --2- 172.21.15.69:0/2720845657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200fe8a0 0x7f51200fecb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5108009990 tx=0x7f5108009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 -- 172.21.15.69:0/2720845657 shutdown_connections 2023-12-14T18:24:18.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 --2- 172.21.15.69:0/2720845657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5120100420 0x7f5120106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 --2- 172.21.15.69:0/2720845657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200fe8a0 0x7f51200fecb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 --2- 172.21.15.69:0/2720845657 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200ffa90 0x7f51200ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 -- 172.21.15.69:0/2720845657 >> 172.21.15.69:0/2720845657 conn(0x7f51200f9e80 msgr2=0x7f51200fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:18.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 -- 172.21.15.69:0/2720845657 shutdown_connections 2023-12-14T18:24:18.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.663+0000 7f51248a3700 1 -- 172.21.15.69:0/2720845657 wait complete. 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 Processor -- start 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 -- start start 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200fe8a0 0x7f5120108180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 0x7f512019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5120100420 0x7f512019d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512019da90 con 0x7f51200ffa90 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512019dc00 con 0x7f51200fe8a0 2023-12-14T18:24:18.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.664+0000 7f51248a3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512019ddc0 con 0x7f5120100420 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 0x7f512019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 0x7f512019acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51114/0 (socket says 172.21.15.69:51114) 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 -- 172.21.15.69:0/2123396023 learned_addr learned my addr 172.21.15.69:0/2123396023 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511ed9d700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5120100420 0x7f512019d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511e59c700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200fe8a0 0x7f5120108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 -- 172.21.15.69:0/2123396023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5120100420 msgr2=0x7f512019d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5120100420 0x7f512019d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 -- 172.21.15.69:0/2123396023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200fe8a0 msgr2=0x7f5120108180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200fe8a0 0x7f5120108180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 -- 172.21.15.69:0/2123396023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080095f0 con 0x7f51200ffa90 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511e59c700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200fe8a0 0x7f5120108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f511dd9b700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 0x7f512019acb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f511000c9b0 tx=0x7f511000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110007b00 con 0x7f51200ffa90 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512010a980 con 0x7f51200ffa90 2023-12-14T18:24:18.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5110007c60 con 0x7f51200ffa90 2023-12-14T18:24:18.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110018660 con 0x7f51200ffa90 2023-12-14T18:24:18.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.665+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512010a7f0 con 0x7f51200ffa90 2023-12-14T18:24:18.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.666+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5120105850 con 0x7f51200ffa90 2023-12-14T18:24:18.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.667+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f511000f450 con 0x7f51200ffa90 2023-12-14T18:24:18.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.668+0000 7f51177fe700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f510c0a1260 0x7f510c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:18.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.668+0000 7f511e59c700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f510c0a1260 0x7f510c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:18.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.668+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f51100cca10 con 0x7f51200ffa90 2023-12-14T18:24:18.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.668+0000 7f511e59c700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f510c0a1260 0x7f510c0a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f510800b5c0 tx=0x7f5108005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:18.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.672+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f51100960b0 con 0x7f51200ffa90 2023-12-14T18:24:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.862+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f512002cfe0 con 0x7f51200ffa90 2023-12-14T18:24:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.863+0000 7f51177fe700 1 -- 172.21.15.69:0/2123396023 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22082 (secure 0 0 0) 0x7f511000fe60 con 0x7f51200ffa90 2023-12-14T18:24:18.865 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:18.865 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:23:30.294739+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.865+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f510c0a1260 msgr2=0x7f510c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.865+0000 7f51248a3700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f510c0a1260 0x7f510c0a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f510800b5c0 tx=0x7f5108005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.865+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 msgr2=0x7f512019acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.865+0000 7f51248a3700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 0x7f512019acb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f511000c9b0 tx=0x7f511000ccc0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 shutdown_connections 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f510c0a1260 0x7f510c0a3710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5120100420 0x7f512019d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51200fe8a0 0x7f5120108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 --2- 172.21.15.69:0/2123396023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51200ffa90 0x7f512019acb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 >> 172.21.15.69:0/2123396023 conn(0x7f51200f9e80 msgr2=0x7f51200fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 shutdown_connections 2023-12-14T18:24:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.866+0000 7f51248a3700 1 -- 172.21.15.69:0/2123396023 wait complete. 2023-12-14T18:24:18.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:18 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2730750448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:18.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:18 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1308163992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:18.878 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:18 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2730750448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:18.879 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:18 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1308163992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:18.880 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:18.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:18 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2730750448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:18.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:18 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1308163992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:19.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 -- 172.21.15.69:0/1009639266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2500ff700 msgr2=0x7fc2500ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 --2- 172.21.15.69:0/1009639266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2500ff700 0x7fc2500ffb10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc238009990 tx=0x7fc238009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 -- 172.21.15.69:0/1009639266 shutdown_connections 2023-12-14T18:24:19.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 --2- 172.21.15.69:0/1009639266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc250100dc0 0x7fc250107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 --2- 172.21.15.69:0/1009639266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2500ff700 0x7fc2500ffb10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 --2- 172.21.15.69:0/1009639266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100410 0x7fc250100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 -- 172.21.15.69:0/1009639266 >> 172.21.15.69:0/1009639266 conn(0x7fc2500f9f80 msgr2=0x7fc2500fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 -- 172.21.15.69:0/1009639266 shutdown_connections 2023-12-14T18:24:19.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.998+0000 7fc256168700 1 -- 172.21.15.69:0/1009639266 wait complete. 2023-12-14T18:24:19.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 Processor -- start 2023-12-14T18:24:19.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 -- start start 2023-12-14T18:24:19.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2500ff700 0x7fc250195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 0x7fc250196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100dc0 0x7fc25019d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25019da80 con 0x7fc250100410 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25019dbc0 con 0x7fc250100dc0 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc256168700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25019dd50 con 0x7fc2500ff700 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 0x7fc250196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 0x7fc250196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51144/0 (socket says 172.21.15.69:51144) 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 -- 172.21.15.69:0/233346109 learned_addr learned my addr 172.21.15.69:0/233346109 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24ffff700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100dc0 0x7fc25019d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24f7fe700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2500ff700 0x7fc250195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 -- 172.21.15.69:0/233346109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2500ff700 msgr2=0x7fc250195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2500ff700 0x7fc250195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 -- 172.21.15.69:0/233346109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100dc0 msgr2=0x7fc25019d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100dc0 0x7fc25019d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 -- 172.21.15.69:0/233346109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380095f0 con 0x7fc250100410 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24ffff700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100dc0 0x7fc25019d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:19.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24f7fe700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2500ff700 0x7fc250195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:18.999+0000 7fc24effd700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 0x7fc250196440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d980 tx=0x7fc24000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.000+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000bb60 con 0x7fc250100410 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.000+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc240007620 con 0x7fc250100410 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.000+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25010a990 con 0x7fc250100410 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.000+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f3c0 con 0x7fc250100410 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.000+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25010a800 con 0x7fc250100410 2023-12-14T18:24:19.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.001+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc250067e40 con 0x7fc250100410 2023-12-14T18:24:19.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.002+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc240010460 con 0x7fc250100410 2023-12-14T18:24:19.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.002+0000 7fc24cff9700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc23c0a1260 0x7fc23c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.002+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc2400cc940 con 0x7fc250100410 2023-12-14T18:24:19.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.002+0000 7fc24f7fe700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc23c0a1260 0x7fc23c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.003+0000 7fc24f7fe700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc23c0a1260 0x7fc23c0a3710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc23800b5c0 tx=0x7fc238005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.006+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc2400960e0 con 0x7fc250100410 2023-12-14T18:24:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.237+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc25019e7f0 con 0x7fc250100410 2023-12-14T18:24:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.238+0000 7fc24cff9700 1 -- 172.21.15.69:0/233346109 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7fc240016090 con 0x7fc250100410 2023-12-14T18:24:19.240 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:19.240 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc23c0a1260 msgr2=0x7fc23c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc23c0a1260 0x7fc23c0a3710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc23800b5c0 tx=0x7fc238005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 msgr2=0x7fc250196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 0x7fc250196440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d980 tx=0x7fc24000dd40 comp rx=0 tx=0).stop 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 shutdown_connections 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc23c0a1260 0x7fc23c0a3710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc250100dc0 0x7fc25019d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2500ff700 0x7fc250195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 --2- 172.21.15.69:0/233346109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc250100410 0x7fc250196440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 >> 172.21.15.69:0/233346109 conn(0x7fc2500f9f80 msgr2=0x7fc2500fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 shutdown_connections 2023-12-14T18:24:19.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.240+0000 7fc256168700 1 -- 172.21.15.69:0/233346109 wait complete. 2023-12-14T18:24:19.243 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:19.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-14T18:23:29.291233+0000', 'modified': '2023-12-14T18:23:34.332024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24482, 'mds_2': 24458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/1476188818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 1476188818}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 1476188818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/3442609233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3442609233}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3442609233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6839/771447970', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 771447970}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 771447970}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.91:6835/426473742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6834', 'nonce': 426473742}, {'type': 'v1', 'addr': '172.21.15.91:6835', 'nonce': 426473742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.91:6837/3727199285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6836', 'nonce': 3727199285}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 3727199285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.91:6839/311589557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6838', 'nonce': 311589557}, {'type': 'v1', 'addr': '172.21.15.91:6839', 'nonce': 311589557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-14T18:24:19.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-14T18:24:19.255 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 -- 172.21.15.69:0/1734670759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 msgr2=0x7f1afc1002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 --2- 172.21.15.69:0/1734670759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc1002f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1af400b0a0 tx=0x7f1af400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 -- 172.21.15.69:0/1734670759 shutdown_connections 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 --2- 172.21.15.69:0/1734670759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc1002f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 --2- 172.21.15.69:0/1734670759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc0feb80 0x7f1afc0fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 --2- 172.21.15.69:0/1734670759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 0x7f1afc0ff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 -- 172.21.15.69:0/1734670759 >> 172.21.15.69:0/1734670759 conn(0x7f1afc0fa7b0 msgr2=0x7f1afc0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 -- 172.21.15.69:0/1734670759 shutdown_connections 2023-12-14T18:24:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.376+0000 7f1b018f5700 1 -- 172.21.15.69:0/1734670759 wait complete. 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 Processor -- start 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 -- start start 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc0feb80 0x7f1afc1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 0x7f1afc198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc19fd40 con 0x7f1afc0ffe80 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc19fe80 con 0x7f1afc0ff4d0 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1b018f5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc1a0010 con 0x7f1afc0feb80 2023-12-14T18:24:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afa7fc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 0x7f1afc198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51160/0 (socket says 172.21.15.69:51160) 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afa7fc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 0x7f1afc198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:48370/0 (socket says 172.21.15.69:48370) 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 -- 172.21.15.69:0/2294804761 learned_addr learned my addr 172.21.15.69:0/2294804761 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc0feb80 0x7f1afc1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 -- 172.21.15.69:0/2294804761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc0feb80 msgr2=0x7f1afc1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc0feb80 0x7f1afc1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 -- 172.21.15.69:0/2294804761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 msgr2=0x7f1afc198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 0x7f1afc198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.377+0000 7f1afb7fe700 1 -- 172.21.15.69:0/2294804761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4009d00 con 0x7f1afc0ffe80 2023-12-14T18:24:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.378+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc19f770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009fd0 tx=0x7f1af400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.379+0000 7f1b008f3700 1 -- 172.21.15.69:0/2294804761 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400e040 con 0x7f1afc0ffe80 2023-12-14T18:24:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.379+0000 7f1b008f3700 1 -- 172.21.15.69:0/2294804761 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1af4007760 con 0x7f1afc0ffe80 2023-12-14T18:24:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.379+0000 7f1b008f3700 1 -- 172.21.15.69:0/2294804761 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af401b6c0 con 0x7f1afc0ffe80 2023-12-14T18:24:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.379+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc10dce0 con 0x7f1afc0ffe80 2023-12-14T18:24:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.379+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc10db50 con 0x7f1afc0ffe80 2023-12-14T18:24:19.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.381+0000 7f1b008f3700 1 -- 172.21.15.69:0/2294804761 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1af401d470 con 0x7f1afc0ffe80 2023-12-14T18:24:19.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.382+0000 7f1b008f3700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1ae40a1260 0x7f1ae40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.382+0000 7f1b008f3700 1 -- 172.21.15.69:0/2294804761 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1af40cd900 con 0x7f1afc0ffe80 2023-12-14T18:24:19.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.382+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1ae40a1260 0x7f1ae40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.382+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1ae40a1260 0x7f1ae40a3710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009c60 tx=0x7f1af0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 Processor -- start 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 -- start start 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d2124098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21240a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d21240b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2122f2590 con 0x55d212409e00 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d212361820 con 0x55d21240acb0 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21235acb0 con 0x55d2124094b0 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afa7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21240a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afa7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21240a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51164/0 (socket says 172.21.15.69:51164) 2023-12-14T18:24:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afa7fc700 1 -- 172.21.15.69:0/2167424605 learned_addr learned my addr 172.21.15.69:0/2167424605 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d2124098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d21240b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afa7fc700 1 -- 172.21.15.69:0/2167424605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 msgr2=0x55d2124098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.383+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d2124098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1afa7fc700 1 -- 172.21.15.69:0/2167424605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 msgr2=0x55d21240b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d21240b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1afa7fc700 1 -- 172.21.15.69:0/2167424605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2121dc360 con 0x55d212409e00 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21240a720 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00bd70 tx=0x7f1aec0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e86202a153c83c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1ae1ffb700 1 -- 172.21.15.69:0/2167424605 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec010e10 con 0x55d212409e00 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1ae1ffb700 1 -- 172.21.15.69:0/2167424605 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aec015070 con 0x55d212409e00 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1ae1ffb700 1 -- 172.21.15.69:0/2167424605 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0116a0 con 0x55d212409e00 2023-12-14T18:24:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2167424605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 msgr2=0x55d21240a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.384+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21240a720 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00bd70 tx=0x7f1aec0106b0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2167424605 shutdown_connections 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d21240b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d2124098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2167424605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21240a720 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2167424605 >> 172.21.15.69:0/2167424605 conn(0x55d2123fec50 msgr2=0x55d2124043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2167424605 shutdown_connections 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2167424605 wait complete. 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- start start 2023-12-14T18:24:19.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 Processor -- start 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d2124094b0 0x55d212413130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d212409e00 0x55d212413670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 0x55d21241a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2122f6f40 con 0x55d21240acb0 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2122f6be0 con 0x55d2124094b0 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2121de650 con 0x55d212409e00 2023-12-14T18:24:19.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1b0da83b80 10 client.0 _ll_register_callbacks cb 0x55d21231a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.385+0000 7f1afb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 0x55d21241a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 0x55d21241a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51174/0 (socket says 172.21.15.69:51174) 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 -- 172.21.15.69:0/989637127 learned_addr learned my addr 172.21.15.69:0/989637127 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d212409e00 0x55d212413670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afaffd700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d2124094b0 0x55d212413130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 -- 172.21.15.69:0/989637127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d212409e00 msgr2=0x55d212413670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d212409e00 0x55d212413670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 -- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d2124094b0 msgr2=0x55d212413130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d2124094b0 0x55d212413130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 -- 172.21.15.69:0/989637127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec00b9a0 con 0x55d21240acb0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 0x55d21241a6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1af40a2c80 tx=0x7f1af409aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8e6686ffa20d26 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1adaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1adaffd700 1 -- 172.21.15.69:0/989637127 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af409ee20 con 0x55d21240acb0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1adaffd700 1 -- 172.21.15.69:0/989637127 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1af40a31b0 con 0x55d21240acb0 2023-12-14T18:24:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2123fc260 con 0x55d21240acb0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1adaffd700 1 -- 172.21.15.69:0/989637127 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af40b9170 con 0x55d21240acb0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1b0da83b80 10 client.15045 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d212321120 con 0x55d21240acb0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1adaffd700 1 -- 172.21.15.69:0/989637127 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d2123fc260 con 0x55d21240acb0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1adaffd700 1 -- 172.21.15.69:0/989637127 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1af409e070 con 0x55d21240acb0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.386+0000 7f1b0da83b80 10 client.15045 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1b0da83b80 10 client.15045 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1b0da83b80 20 client.15045 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d21241dfe0 0x55d21241d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1b0da83b80 4 client.15045 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d212353c90 con 0x55d21241dfe0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1afaffd700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d21241dfe0 0x55d21241d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1adaffd700 10 client.15045 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.387+0000 7f1afaffd700 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d21241dfe0 0x55d21241d630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d16def96cb64edf6 server_cookie=1ef94d7606b4692e in_seq=0 out_seq=0 2023-12-14T18:24:19.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.388+0000 7f1adaffd700 1 -- 172.21.15.69:0/989637127 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d212353c90 con 0x55d21241dfe0 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.388+0000 7f1adaffd700 10 client.15045 handle_command_reply: tid=0 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.388+0000 7f1b0da83b80 1 client.15045 shutdown 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 msgr2=0x55d21241a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 0x55d21241a6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1af40a2c80 tx=0x7f1af409aa20 comp rx=0 tx=0).stop 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 shutdown_connections 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d21241dfe0 0x55d21241d630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d21240acb0 0x55d21241a6b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d2124094b0 0x55d212413130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1adaffd700 0 client.15045 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/989637127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d212409e00 0x55d212413670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 >> 172.21.15.69:0/989637127 conn(0x55d2123fec50 msgr2=0x55d212402ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 shutdown_connections 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 1 -- 172.21.15.69:0/989637127 wait complete. 2023-12-14T18:24:19.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.389+0000 7f1b0da83b80 20 client.15045 trim_cache size 0 max 16384 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 Processor -- start 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 -- start start 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d212403980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21241a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d212411090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d212353c90 con 0x55d212409e00 2023-12-14T18:24:19.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21240a5b0 con 0x55d21240acb0 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.406+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d212329a50 con 0x55d2124094b0 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21241a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21241a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51186/0 (socket says 172.21.15.69:51186) 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 -- 172.21.15.69:0/1341162612 learned_addr learned my addr 172.21.15.69:0/1341162612 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d212411090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afaffd700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d212403980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 -- 172.21.15.69:0/1341162612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 msgr2=0x55d212403980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d212403980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 -- 172.21.15.69:0/1341162612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 msgr2=0x55d212411090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d212411090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 -- 172.21.15.69:0/1341162612 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d212320e70 con 0x55d212409e00 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d212411090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afaffd700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d212403980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:19.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21241a670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00bd70 tx=0x7f1aec005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3573618bfe459098 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1ae27fc700 1 -- 172.21.15.69:0/1341162612 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec020040 con 0x55d212409e00 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1ae27fc700 1 -- 172.21.15.69:0/1341162612 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aec010e10 con 0x55d212409e00 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.407+0000 7f1ae27fc700 1 -- 172.21.15.69:0/1341162612 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec003a60 con 0x55d212409e00 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 -- 172.21.15.69:0/1341162612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 msgr2=0x55d21241a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21241a670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00bd70 tx=0x7f1aec005950 comp rx=0 tx=0).stop 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 -- 172.21.15.69:0/1341162612 shutdown_connections 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d21240acb0 0x55d212411090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2124094b0 0x55d212403980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/1341162612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d212409e00 0x55d21241a670 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 -- 172.21.15.69:0/1341162612 >> 172.21.15.69:0/1341162612 conn(0x55d2123fec50 msgr2=0x55d21241d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 -- 172.21.15.69:0/1341162612 shutdown_connections 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 -- 172.21.15.69:0/1341162612 wait complete. 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 -- start start 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.408+0000 7f1b0da83b80 1 Processor -- start 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 0x55d212415310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d212409e00 0x55d212415850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d21240acb0 0x55d212471e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21241a880 con 0x55d2124094b0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21241a9f0 con 0x55d212409e00 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2124723a0 con 0x55d21240acb0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 10 client.0 _ll_register_callbacks cb 0x7f1af4097130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 0x55d212415310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 0x55d212415310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51188/0 (socket says 172.21.15.69:51188) 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 -- 172.21.15.69:0/2195931758 learned_addr learned my addr 172.21.15.69:0/2195931758 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afb7fe700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d21240acb0 0x55d212471e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d212409e00 0x55d212415850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 -- 172.21.15.69:0/2195931758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d21240acb0 msgr2=0x55d212471e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d21240acb0 0x55d212471e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 -- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d212409e00 msgr2=0x55d212415850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d212409e00 0x55d212415850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 -- 172.21.15.69:0/2195931758 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2121dc360 con 0x55d2124094b0 2023-12-14T18:24:19.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1afaffd700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 0x55d212415310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1af0013010 tx=0x7f1af00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7538d4ca7752e285 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1adaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1adaffd700 1 -- 172.21.15.69:0/2195931758 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0003680 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aec015070 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1adaffd700 1 -- 172.21.15.69:0/2195931758 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1af00037e0 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1adaffd700 1 -- 172.21.15.69:0/2195931758 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af00039a0 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 10 client.15051 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.409+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d212307950 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1adaffd700 1 -- 172.21.15.69:0/2195931758 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aec015070 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1adaffd700 1 -- 172.21.15.69:0/2195931758 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1af003d070 con 0x55d2124094b0 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1b0da83b80 10 client.15051 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1b0da83b80 10 client.15051 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1b0da83b80 20 client.15051 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d212477110 0x55d212473a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1b0da83b80 4 client.15051 mds_command: new command op to 24458 tid=0[{"prefix": "status"}] 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d2123539b0 con 0x55d212477110 2023-12-14T18:24:19.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.410+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d212477110 0x55d212473a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1adaffd700 10 client.15051 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:19.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1afa7fc700 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d212477110 0x55d212473a60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8438623f1294f661 server_cookie=98d70a33b863f75a in_seq=0 out_seq=0 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1adaffd700 1 -- 172.21.15.69:0/2195931758 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55d2123539b0 con 0x55d212477110 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1adaffd700 10 client.15051 handle_command_reply: tid=0 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 client.15051 shutdown 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 msgr2=0x55d212415310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 0x55d212415310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1af0013010 tx=0x7f1af00047c0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 shutdown_connections 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55d212477110 0x55d212473a60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d21240acb0 0x55d212471e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1adaffd700 0 client.15051 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2124094b0 0x55d212415310 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 --2- 172.21.15.69:0/2195931758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d212409e00 0x55d212415850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 >> 172.21.15.69:0/2195931758 conn(0x55d2123fec50 msgr2=0x55d212403980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 shutdown_connections 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 1 -- 172.21.15.69:0/2195931758 wait complete. 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.411+0000 7f1b0da83b80 20 client.15051 trim_cache size 0 max 16384 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24458, 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 46.088356843, 2023-12-14T18:24:19.419 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T18:24:19.420 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 79, 2023-12-14T18:24:19.420 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 79, 2023-12-14T18:24:19.420 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 68.132244991999997 2023-12-14T18:24:19.420 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:19.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1ae40a1260 msgr2=0x7f1ae40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1ae40a1260 0x7f1ae40a3710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009c60 tx=0x7f1af0009260 comp rx=0 tx=0).stop 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 msgr2=0x7f1afc19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc19f770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009fd0 tx=0x7f1af400bc80 comp rx=0 tx=0).stop 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 shutdown_connections 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1ae40a1260 0x7f1ae40a3710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1afc0ffe80 0x7f1afc19f770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc0feb80 0x7f1afc1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 --2- 172.21.15.69:0/2294804761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1afc0ff4d0 0x7f1afc198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 >> 172.21.15.69:0/2294804761 conn(0x7f1afc0fa7b0 msgr2=0x7f1afc0fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 shutdown_connections 2023-12-14T18:24:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.412+0000 7f1b018f5700 1 -- 172.21.15.69:0/2294804761 wait complete. 2023-12-14T18:24:19.426 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-12-14T18:24:19.503 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:19 smithi069 ceph-mon[42047]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 -- 172.21.15.69:0/2306844850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f94101e30 msgr2=0x7f7f941086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/2306844850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f94101e30 0x7f7f941086f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00b0a0 tx=0x7f7f8c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 -- 172.21.15.69:0/2306844850 shutdown_connections 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/2306844850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f94101e30 0x7f7f941086f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/2306844850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f940fe4d0 0x7f7f940fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/2306844850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f941014a0 0x7f7f941018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 -- 172.21.15.69:0/2306844850 >> 172.21.15.69:0/2306844850 conn(0x7f7f940f9ed0 msgr2=0x7f7f940fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 -- 172.21.15.69:0/2306844850 shutdown_connections 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 -- 172.21.15.69:0/2306844850 wait complete. 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 Processor -- start 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 -- start start 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f940fe4d0 0x7f7f94195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.548+0000 7f7f9b13a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 0x7f7f94196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f9b13a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f94101e30 0x7f7f9419d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f9b13a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9419dac0 con 0x7f7f941014a0 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f9b13a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9419dc00 con 0x7f7f94101e30 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f9b13a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9419dd90 con 0x7f7f940fe4d0 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 0x7f7f94196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 0x7f7f94196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51196/0 (socket says 172.21.15.69:51196) 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 -- 172.21.15.69:0/1823140269 learned_addr learned my addr 172.21.15.69:0/1823140269 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f940fe4d0 0x7f7f94195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f996d7700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f94101e30 0x7f7f9419d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 -- 172.21.15.69:0/1823140269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f940fe4d0 msgr2=0x7f7f94195f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f940fe4d0 0x7f7f94195f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 -- 172.21.15.69:0/1823140269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f94101e30 msgr2=0x7f7f9419d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f94101e30 0x7f7f9419d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 -- 172.21.15.69:0/1823140269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c009d00 con 0x7f7f941014a0 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f93fff700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 0x7f7f94196480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000c9b0 tx=0x7f7f8000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f91ffb700 1 -- 172.21.15.69:0/1823140269 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007b00 con 0x7f7f941014a0 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f91ffb700 1 -- 172.21.15.69:0/1823140269 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f80007c60 con 0x7f7f941014a0 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9410ba30 con 0x7f7f941014a0 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f91ffb700 1 -- 172.21.15.69:0/1823140269 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80018660 con 0x7f7f941014a0 2023-12-14T18:24:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.549+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9410b8a0 con 0x7f7f941014a0 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.551+0000 7f7f91ffb700 1 -- 172.21.15.69:0/1823140269 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f7f8000f450 con 0x7f7f941014a0 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.552+0000 7f7f91ffb700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f840a11e0 0x7f7f840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.552+0000 7f7f91ffb700 1 -- 172.21.15.69:0/1823140269 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7f800cc910 con 0x7f7f941014a0 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.552+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f840a11e0 0x7f7f840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.552+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f840a11e0 0x7f7f840a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f94067bd0 tx=0x7f7f8800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 Processor -- start 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 -- start start 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27448c0 0x55b7d2744cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d2745b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 0x55b7d2746530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d2629590 con 0x55b7d27460c0 2023-12-14T18:24:19.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d2698820 con 0x55b7d27448c0 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d2691cb0 con 0x55b7d2745210 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7f996d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 0x55b7d2746530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7f996d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 0x55b7d2746530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51204/0 (socket says 172.21.15.69:51204) 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.553+0000 7f7f996d7700 1 -- 172.21.15.69:0/2747135369 learned_addr learned my addr 172.21.15.69:0/2747135369 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27448c0 0x55b7d2744cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f996d7700 1 -- 172.21.15.69:0/2747135369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 msgr2=0x55b7d2745b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f996d7700 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d2745b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f996d7700 1 -- 172.21.15.69:0/2747135369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27448c0 msgr2=0x55b7d2744cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f996d7700 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27448c0 0x55b7d2744cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f996d7700 1 -- 172.21.15.69:0/2747135369 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7d2513360 con 0x55b7d27460c0 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27448c0 0x55b7d2744cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f996d7700 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 0x55b7d2746530 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00b830 tx=0x7f7f8c007560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52ea56b3e24dc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f7effd700 1 -- 172.21.15.69:0/2747135369 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00e050 con 0x55b7d27460c0 2023-12-14T18:24:19.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f7effd700 1 -- 172.21.15.69:0/2747135369 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f8c007800 con 0x55b7d27460c0 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7f7effd700 1 -- 172.21.15.69:0/2747135369 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c005640 con 0x55b7d27460c0 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/2747135369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 msgr2=0x55b7d2746530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.554+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 0x55b7d2746530 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00b830 tx=0x7f7f8c007560 comp rx=0 tx=0).stop 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/2747135369 shutdown_connections 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27460c0 0x55b7d2746530 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27448c0 0x55b7d2744cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/2747135369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d2745b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/2747135369 >> 172.21.15.69:0/2747135369 conn(0x55b7d2735c50 msgr2=0x55b7d273b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/2747135369 shutdown_connections 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/2747135369 wait complete. 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- start start 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 Processor -- start 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d274ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d2755a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d262df40 con 0x55b7d27448c0 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d262dbe0 con 0x55b7d27460c0 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d2515650 con 0x55b7d2745210 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7fa72c8b80 10 client.0 _ll_register_callbacks cb 0x55b7d26518c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7f98ed6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.555+0000 7f7f98ed6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51220/0 (socket says 172.21.15.69:51220) 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 -- 172.21.15.69:0/585268033 learned_addr learned my addr 172.21.15.69:0/585268033 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f996d7700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d2755a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f93fff700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d274ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 -- 172.21.15.69:0/585268033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 msgr2=0x55b7d274ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d274ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 -- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 msgr2=0x55b7d2755a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d2755a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 -- 172.21.15.69:0/585268033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f94108f60 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274e4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7f88011670 tx=0x7f7f880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e23b2951ab490b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f73fff700 1 -- 172.21.15.69:0/585268033 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8801e830 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f73fff700 1 -- 172.21.15.69:0/585268033 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7f88017070 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7d2733260 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f73fff700 1 -- 172.21.15.69:0/585268033 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f88010e80 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7fa72c8b80 10 client.15063 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55b7d2658120 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f73fff700 1 -- 172.21.15.69:0/585268033 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7d2733260 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7f73fff700 1 -- 172.21.15.69:0/585268033 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7f880278a0 con 0x55b7d27448c0 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.556+0000 7f7fa72c8b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7fa72c8b80 10 client.15063 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7fa72c8b80 20 client.15063 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:19.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d2759760 0x55b7d2758b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7fa72c8b80 4 client.15063 mds_command: new command op to 24482 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:19.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7d268ac90 con 0x55b7d2759760 2023-12-14T18:24:19.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7f93fff700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d2759760 0x55b7d2758b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7f93fff700 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d2759760 0x55b7d2758b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb365d278f67507 server_cookie=6871c7f16a3613b0 in_seq=0 out_seq=0 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.557+0000 7f7f73fff700 10 client.15063 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7f73fff700 1 -- 172.21.15.69:0/585268033 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b7d268ac90 con 0x55b7d2759760 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7f73fff700 10 client.15063 handle_command_reply: tid=0 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 client.15063 shutdown 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 msgr2=0x55b7d274e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274e4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7f88011670 tx=0x7f7f880047c0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 shutdown_connections 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d2759760 0x55b7d2758b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d2755a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274e4c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7f73fff700 0 client.15063 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/585268033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d2745210 0x55b7d274ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 >> 172.21.15.69:0/585268033 conn(0x55b7d2735c50 msgr2=0x55b7d2739ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 shutdown_connections 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.558+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/585268033 wait complete. 2023-12-14T18:24:19.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.559+0000 7f7fa72c8b80 20 client.15063 trim_cache size 0 max 16384 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 Processor -- start 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 -- start start 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d2745210 0x55b7d2755a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27460c0 0x55b7d2758b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d263b580 con 0x55b7d27448c0 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d2650290 con 0x55b7d2745210 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d268dda0 con 0x55b7d27460c0 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51236/0 (socket says 172.21.15.69:51236) 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 -- 172.21.15.69:0/1814560211 learned_addr learned my addr 172.21.15.69:0/1814560211 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 -- 172.21.15.69:0/1814560211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27460c0 msgr2=0x55b7d2758b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27460c0 0x55b7d2758b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 -- 172.21.15.69:0/1814560211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d2745210 msgr2=0x55b7d2755a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d2745210 0x55b7d2755a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 -- 172.21.15.69:0/1814560211 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7d2657e70 con 0x55b7d27448c0 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.576+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274c4e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f88010a40 tx=0x7f7f88005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf5e67fca45774 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7f7f7fe700 1 -- 172.21.15.69:0/1814560211 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88027670 con 0x55b7d27448c0 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7f7f7fe700 1 -- 172.21.15.69:0/1814560211 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f88015070 con 0x55b7d27448c0 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7f7f7fe700 1 -- 172.21.15.69:0/1814560211 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8801ee40 con 0x55b7d27448c0 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/1814560211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 msgr2=0x55b7d274c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274c4e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f88010a40 tx=0x7f7f88005d20 comp rx=0 tx=0).stop 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/1814560211 shutdown_connections 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27460c0 0x55b7d2758b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d27448c0 0x55b7d274c4e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/1814560211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d2745210 0x55b7d2755a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/1814560211 >> 172.21.15.69:0/1814560211 conn(0x55b7d2735c50 msgr2=0x55b7d274d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/1814560211 shutdown_connections 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/1814560211 wait complete. 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 -- start start 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.577+0000 7f7fa72c8b80 1 Processor -- start 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27448c0 0x55b7d2750850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 0x55b7d2750d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d27ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d2751430 con 0x55b7d2745210 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d27adb20 con 0x55b7d27460c0 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7d27adc90 con 0x55b7d27448c0 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7fa72c8b80 10 client.0 _ll_register_callbacks cb 0x7f7f88010ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 0x55b7d2750d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 0x55b7d2750d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51244/0 (socket says 172.21.15.69:51244) 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 -- 172.21.15.69:0/3016872008 learned_addr learned my addr 172.21.15.69:0/3016872008 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f996d7700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d27ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27448c0 0x55b7d2750850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 -- 172.21.15.69:0/3016872008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27448c0 msgr2=0x55b7d2750850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27448c0 0x55b7d2750850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 -- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 msgr2=0x55b7d27ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d27ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 -- 172.21.15.69:0/3016872008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7d2658120 con 0x55b7d2745210 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f93fff700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 0x55b7d2750d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f800074a0 tx=0x7f7f8001f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a97273b28c5370a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.578+0000 7f7f73fff700 1 -- 172.21.15.69:0/3016872008 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800a21c0 con 0x55b7d2745210 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7f73fff700 1 -- 172.21.15.69:0/3016872008 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7f80098110 con 0x55b7d2745210 2023-12-14T18:24:19.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f8c007800 con 0x55b7d2745210 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7f73fff700 1 -- 172.21.15.69:0/3016872008 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f800b81a0 con 0x55b7d2745210 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 10 client.15069 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55b7d263e950 con 0x55b7d2745210 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7f73fff700 1 -- 172.21.15.69:0/3016872008 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f800ca020 con 0x55b7d2745210 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7f73fff700 1 -- 172.21.15.69:0/3016872008 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7f8009a040 con 0x55b7d2745210 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 10 client.15069 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 10 client.15069 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 20 client.15069 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d27b29b0 0x55b7d27af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 4 client.15069 mds_command: new command op to 24482 tid=0[{"prefix": "status"}] 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b7d268a9b0 con 0x55b7d27b29b0 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.579+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d27b29b0 0x55b7d27af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7f73fff700 10 client.15069 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7f98ed6700 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d27b29b0 0x55b7d27af380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cdfdb56e5f45203 server_cookie=7921a37dba6480eb in_seq=0 out_seq=0 2023-12-14T18:24:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7f73fff700 1 -- 172.21.15.69:0/3016872008 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55b7d268a9b0 con 0x55b7d27b29b0 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7f73fff700 10 client.15069 handle_command_reply: tid=0 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 client.15069 shutdown 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 msgr2=0x55b7d2750d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 0x55b7d2750d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f800074a0 tx=0x7f7f8001f440 comp rx=0 tx=0).stop 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 shutdown_connections 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55b7d27b29b0 0x55b7d27af380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b7d27460c0 0x55b7d27ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7f73fff700 0 client.15069 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7d27448c0 0x55b7d2750850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 --2- 172.21.15.69:0/3016872008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b7d2745210 0x55b7d2750d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 >> 172.21.15.69:0/3016872008 conn(0x55b7d2735c50 msgr2=0x55b7d2758b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 shutdown_connections 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 1 -- 172.21.15.69:0/3016872008 wait complete. 2023-12-14T18:24:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.580+0000 7f7fa72c8b80 20 client.15069 trim_cache size 0 max 16384 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24482, 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 47.269687935999997, 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 79, 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 79, 2023-12-14T18:24:19.590 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 62.878121512 2023-12-14T18:24:19.591 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:19.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f840a11e0 msgr2=0x7f7f840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f840a11e0 0x7f7f840a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f94067bd0 tx=0x7f7f8800b410 comp rx=0 tx=0).stop 2023-12-14T18:24:19.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 msgr2=0x7f7f94196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 0x7f7f94196480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000c9b0 tx=0x7f7f8000ccc0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 shutdown_connections 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f840a11e0 0x7f7f840a3690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f94101e30 0x7f7f9419d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f940fe4d0 0x7f7f94195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 --2- 172.21.15.69:0/1823140269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f941014a0 0x7f7f94196480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 >> 172.21.15.69:0/1823140269 conn(0x7f7f940f9ed0 msgr2=0x7f7f940fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 shutdown_connections 2023-12-14T18:24:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.581+0000 7f7f9b13a700 1 -- 172.21.15.69:0/1823140269 wait complete. 2023-12-14T18:24:19.595 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-14T18:24:19.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.715+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1306413645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 msgr2=0x7fa8ec1019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.715+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1306413645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec1019b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009990 tx=0x7fa8dc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1306413645 shutdown_connections 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1306413645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec101ef0 0x7fa8ec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1306413645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ec0fe4f0 0x7fa8ec0fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1306413645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec1019b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1306413645 >> 172.21.15.69:0/1306413645 conn(0x7fa8ec0f9ed0 msgr2=0x7fa8ec0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1306413645 shutdown_connections 2023-12-14T18:24:19.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1306413645 wait complete. 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 Processor -- start 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- start start 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec0fe4f0 0x7fa8ec195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ec101ef0 0x7fa8ec19d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec19d950 con 0x7fa8ec101560 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec19da90 con 0x7fa8ec101ef0 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.716+0000 7fa8f1cef700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec19dc20 con 0x7fa8ec0fe4f0 2023-12-14T18:24:19.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51276/0 (socket says 172.21.15.69:51276) 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 -- 172.21.15.69:0/1906467898 learned_addr learned my addr 172.21.15.69:0/1906467898 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec0fe4f0 0x7fa8ec195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ec101ef0 0x7fa8ec19d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 -- 172.21.15.69:0/1906467898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec0fe4f0 msgr2=0x7fa8ec195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec0fe4f0 0x7fa8ec195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 -- 172.21.15.69:0/1906467898 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ec101ef0 msgr2=0x7fa8ec19d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ec101ef0 0x7fa8ec19d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 -- 172.21.15.69:0/1906467898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0095f0 con 0x7fa8ec101560 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec196310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc006010 tx=0x7fa8dc003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8e8ff9700 1 -- 172.21.15.69:0/1906467898 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc01d070 con 0x7fa8ec101560 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8e8ff9700 1 -- 172.21.15.69:0/1906467898 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8dc00bd70 con 0x7fa8ec101560 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec10ba10 con 0x7fa8ec101560 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8e8ff9700 1 -- 172.21.15.69:0/1906467898 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc022cd0 con 0x7fa8ec101560 2023-12-14T18:24:19.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.717+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec10b880 con 0x7fa8ec101560 2023-12-14T18:24:19.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.719+0000 7fa8e8ff9700 1 -- 172.21.15.69:0/1906467898 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa8dc022470 con 0x7fa8ec101560 2023-12-14T18:24:19.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.720+0000 7fa8e8ff9700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8d40a11e0 0x7fa8d40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.720+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8d40a11e0 0x7fa8d40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.720+0000 7fa8e8ff9700 1 -- 172.21.15.69:0/1906467898 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8dc0cdf20 con 0x7fa8ec101560 2023-12-14T18:24:19.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.720+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8d40a11e0 0x7fa8d40a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec067b10 tx=0x7fa8e000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 Processor -- start 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 -- start start 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd8f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd90720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffd91120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffc78590 con 0x559fffd90cb0 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffce7820 con 0x559fffd8fe00 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffce0cb0 con 0x559fffd8f4b0 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffd91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffd91120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51280/0 (socket says 172.21.15.69:51280) 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3066934519 learned_addr learned my addr 172.21.15.69:0/3066934519 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd8f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3066934519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 msgr2=0x559fffd8f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd8f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd90720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3066934519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 msgr2=0x559fffd90720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd90720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.721+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3066934519 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fffb62360 con 0x559fffd90cb0 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffd91120 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400f5a0 tx=0x7fa8e400f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d3158a9b0ddb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8d1ffb700 1 -- 172.21.15.69:0/3066934519 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4004bb0 con 0x559fffd90cb0 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8d1ffb700 1 -- 172.21.15.69:0/3066934519 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e4004d10 con 0x559fffd90cb0 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8d1ffb700 1 -- 172.21.15.69:0/3066934519 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4005130 con 0x559fffd90cb0 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3066934519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 msgr2=0x559fffd91120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffd91120 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400f5a0 tx=0x7fa8e400f8b0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3066934519 shutdown_connections 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffd91120 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd8f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3066934519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd90720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3066934519 >> 172.21.15.69:0/3066934519 conn(0x559fffd84c50 msgr2=0x559fffd8a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3066934519 shutdown_connections 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.722+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3066934519 wait complete. 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 -- start start 2023-12-14T18:24:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 Processor -- start 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8f4b0 0x559fffd99090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 0x559fffd995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffda0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffc7cf40 con 0x559fffd8fe00 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffc7cbe0 con 0x559fffd8f4b0 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffb64650 con 0x559fffd90cb0 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8fde7db80 10 client.0 _ll_register_callbacks cb 0x559fffca08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8eaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 0x559fffd995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8eaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 0x559fffd995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51294/0 (socket says 172.21.15.69:51294) 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8eaffd700 1 -- 172.21.15.69:0/146900159 learned_addr learned my addr 172.21.15.69:0/146900159 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.723+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8f4b0 0x559fffd99090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffda0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eaffd700 1 -- 172.21.15.69:0/146900159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 msgr2=0x559fffda0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffda0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eaffd700 1 -- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8f4b0 msgr2=0x559fffd99090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8f4b0 0x559fffd99090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eaffd700 1 -- 172.21.15.69:0/146900159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e400f1d0 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8f4b0 0x559fffd99090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 0x559fffd995d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc097910 tx=0x7fa8dc09ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62fd377a30c0f1c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8caffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8caffd700 1 -- 172.21.15.69:0/146900159 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0a12c0 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8caffd700 1 -- 172.21.15.69:0/146900159 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8dc09f440 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559fffd82260 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8caffd700 1 -- 172.21.15.69:0/146900159 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8dc0a37d0 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 10 client.15081 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x559fffca7120 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8caffd700 1 -- 172.21.15.69:0/146900159 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559fffd82260 con 0x559fffd8fe00 2023-12-14T18:24:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8caffd700 1 -- 172.21.15.69:0/146900159 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8dc0a3490 con 0x559fffd8fe00 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 10 client.15081 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 10 client.15081 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 20 client.15081 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffda3f10 0x559fffda3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 4 client.15081 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.724+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559fffcd9c90 con 0x559fffda3f10 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.725+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffda3f10 0x559fffda3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.725+0000 7fa8caffd700 10 client.15081 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.725+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffda3f10 0x559fffda3540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec93807c5d669e4b server_cookie=f0c7e747e5267bee in_seq=0 out_seq=0 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8caffd700 1 -- 172.21.15.69:0/146900159 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559fffcd9c90 con 0x559fffda3f10 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8caffd700 10 client.15081 handle_command_reply: tid=0 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 client.15081 shutdown 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 msgr2=0x559fffd995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 0x559fffd995d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc097910 tx=0x7fa8dc09ad70 comp rx=0 tx=0).stop 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 shutdown_connections 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffda3f10 0x559fffda3540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffda0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8caffd700 0 client.15081 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8f4b0 0x559fffd99090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/146900159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8fe00 0x559fffd995d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 >> 172.21.15.69:0/146900159 conn(0x559fffd84c50 msgr2=0x559fffd88ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 shutdown_connections 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 1 -- 172.21.15.69:0/146900159 wait complete. 2023-12-14T18:24:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.726+0000 7fa8fde7db80 20 client.15081 trim_cache size 0 max 16384 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 Processor -- start 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 -- start start 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffda05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffda0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffcd9cc0 con 0x559fffd90cb0 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffcdcdd0 con 0x559fffd8fe00 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffc8a580 con 0x559fffd8f4b0 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffda0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffda0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51298/0 (socket says 172.21.15.69:51298) 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3064667656 learned_addr learned my addr 172.21.15.69:0/3064667656 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3064667656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 msgr2=0x559fffd89980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3064667656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 msgr2=0x559fffda05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffda05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 -- 172.21.15.69:0/3064667656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fffca6e70 con 0x559fffd90cb0 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffda0e40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4007750 tx=0x7fa8e4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1d82a4ee65f914 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8d27fc700 1 -- 172.21.15.69:0/3064667656 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4003ba0 con 0x559fffd90cb0 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8d27fc700 1 -- 172.21.15.69:0/3064667656 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e4003d00 con 0x559fffd90cb0 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.744+0000 7fa8d27fc700 1 -- 172.21.15.69:0/3064667656 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e401d850 con 0x559fffd90cb0 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3064667656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 msgr2=0x559fffda0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffda0e40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4007750 tx=0x7fa8e4007780 comp rx=0 tx=0).stop 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3064667656 shutdown_connections 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd90cb0 0x559fffda0e40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd8f4b0 0x559fffd89980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/3064667656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffda05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3064667656 >> 172.21.15.69:0/3064667656 conn(0x559fffd84c50 msgr2=0x559fffda3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3064667656 shutdown_connections 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 -- 172.21.15.69:0/3064667656 wait complete. 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 -- start start 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.745+0000 7fa8fde7db80 1 Processor -- start 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 0x559fffd9b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd9b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffdf7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffda0640 con 0x559fffd8f4b0 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffda07b0 con 0x559fffd8fe00 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fffda0970 con 0x559fffd90cb0 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 10 client.0 _ll_register_callbacks cb 0x7fa8dc097800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 0x559fffd9b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 0x559fffd9b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51308/0 (socket says 172.21.15.69:51308) 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 -- 172.21.15.69:0/737317049 learned_addr learned my addr 172.21.15.69:0/737317049 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8ebfff700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffdf7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd9b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 -- 172.21.15.69:0/737317049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 msgr2=0x559fffdf7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffdf7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 -- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 msgr2=0x559fffd9b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd9b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 -- 172.21.15.69:0/737317049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fffb62360 con 0x559fffd8f4b0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd9b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8eb7fe700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 0x559fffd9b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000fa30 tx=0x7fa8e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8408ec98bf4f38 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8caffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8caffd700 1 -- 172.21.15.69:0/737317049 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0021040 con 0x559fffd8f4b0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8caffd700 1 -- 172.21.15.69:0/737317049 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8e00265c0 con 0x559fffd8f4b0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.746+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8e4004d10 con 0x559fffd8f4b0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8caffd700 1 -- 172.21.15.69:0/737317049 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8e0010630 con 0x559fffd8f4b0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 10 client.15087 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x559fffc8d950 con 0x559fffd8f4b0 2023-12-14T18:24:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8caffd700 1 -- 172.21.15.69:0/737317049 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e4004d10 con 0x559fffd8f4b0 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8caffd700 1 -- 172.21.15.69:0/737317049 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8e001b890 con 0x559fffd8f4b0 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 10 client.15087 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 10 client.15087 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 20 client.15087 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffdfcf10 0x559fffdf98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 4 client.15087 mds_command: new command op to 24509 tid=0[{"prefix": "status"}] 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559fffcd99b0 con 0x559fffdfcf10 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.747+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffdfcf10 0x559fffdf98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8caffd700 10 client.15087 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8eaffd700 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffdfcf10 0x559fffdf98e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7930aac0efa8755 server_cookie=731131e30f829b3 in_seq=0 out_seq=0 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8caffd700 1 -- 172.21.15.69:0/737317049 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x559fffcd99b0 con 0x559fffdfcf10 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8caffd700 10 client.15087 handle_command_reply: tid=0 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 client.15087 shutdown 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 msgr2=0x559fffd9b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 0x559fffd9b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000fa30 tx=0x7fa8e0004750 comp rx=0 tx=0).stop 2023-12-14T18:24:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 shutdown_connections 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x559fffdfcf10 0x559fffdf98e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fffd90cb0 0x559fffdf7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559fffd8f4b0 0x559fffd9b0d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8caffd700 0 client.15087 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 --2- 172.21.15.69:0/737317049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559fffd8fe00 0x559fffd9b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 >> 172.21.15.69:0/737317049 conn(0x559fffd84c50 msgr2=0x559fffd89980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 shutdown_connections 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 1 -- 172.21.15.69:0/737317049 wait complete. 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8fde7db80 20 client.15087 trim_cache size 0 max 16384 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:24:19.756 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24509, 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 50.452540865000003, 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 79, 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 79, 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 56.139530231000002 2023-12-14T18:24:19.757 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8d40a11e0 msgr2=0x7fa8d40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.748+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8d40a11e0 0x7fa8d40a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec067b10 tx=0x7fa8e000a3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 msgr2=0x7fa8ec196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec196310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc006010 tx=0x7fa8dc003a50 comp rx=0 tx=0).stop 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 shutdown_connections 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8d40a11e0 0x7fa8d40a3690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ec101ef0 0x7fa8ec19d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec0fe4f0 0x7fa8ec195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 --2- 172.21.15.69:0/1906467898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8ec101560 0x7fa8ec196310 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 >> 172.21.15.69:0/1906467898 conn(0x7fa8ec0f9ed0 msgr2=0x7fa8ec0fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 shutdown_connections 2023-12-14T18:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:19.749+0000 7fa8f1cef700 1 -- 172.21.15.69:0/1906467898 wait complete. 2023-12-14T18:24:19.761 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:19 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/119824318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.761 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:19 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2123396023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.762 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:19 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/233346109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.762 INFO:tasks.cephadm:Setup complete, yielding 2023-12-14T18:24:19.763 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-14T18:24:19.773 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T18:24:19.774 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-14T18:24:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:19 smithi119 ceph-mon[43973]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T18:24:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:19 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/119824318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:19 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2123396023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:19 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/233346109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:19 smithi091 ceph-mon[43601]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-12-14T18:24:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:19 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/119824318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:19 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2123396023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:19 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/233346109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 -- 172.21.15.69:0/2383165146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784100300 msgr2=0x7f2784100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 --2- 172.21.15.69:0/2383165146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784100300 0x7f2784100710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2774009990 tx=0x7f2774009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 -- 172.21.15.69:0/2383165146 shutdown_connections 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 --2- 172.21.15.69:0/2383165146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2784101e90 0x7f2784108750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 --2- 172.21.15.69:0/2383165146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784100300 0x7f2784100710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 --2- 172.21.15.69:0/2383165146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2784101500 0x7f2784101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 -- 172.21.15.69:0/2383165146 >> 172.21.15.69:0/2383165146 conn(0x7f27840fb910 msgr2=0x7f27840fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 -- 172.21.15.69:0/2383165146 shutdown_connections 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.082+0000 7f278aa01700 1 -- 172.21.15.69:0/2383165146 wait complete. 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 Processor -- start 2023-12-14T18:24:21.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 -- start start 2023-12-14T18:24:21.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2784100300 0x7f2784196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:21.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2784101500 0x7f27841965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:21.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 0x7f278419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:21.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278419dc20 con 0x7f2784101e90 2023-12-14T18:24:21.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278419dd60 con 0x7f2784100300 2023-12-14T18:24:21.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f278aa01700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278419def0 con 0x7f2784101500 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 0x7f278419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 0x7f278419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51318/0 (socket says 172.21.15.69:51318) 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 -- 172.21.15.69:0/1444499725 learned_addr learned my addr 172.21.15.69:0/1444499725 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2783fff700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2784100300 0x7f2784196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f27837fe700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2784101500 0x7f27841965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 -- 172.21.15.69:0/1444499725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2784101500 msgr2=0x7f27841965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:21.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2784101500 0x7f27841965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 -- 172.21.15.69:0/1444499725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2784100300 msgr2=0x7f2784196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.083+0000 7f2788f9e700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2784100300 0x7f2784196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f2788f9e700 1 -- 172.21.15.69:0/1444499725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740095f0 con 0x7f2784101e90 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f2788f9e700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 0x7f278419d650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f277c00b9a0 tx=0x7f277c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00d850 con 0x7f2784101e90 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278410bc00 con 0x7f2784101e90 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f277c00de40 con 0x7f2784101e90 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c017400 con 0x7f2784101e90 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.084+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278410ba70 con 0x7f2784101e90 2023-12-14T18:24:21.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.085+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27841079d0 con 0x7f2784101e90 2023-12-14T18:24:21.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.086+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f277c00d9b0 con 0x7f2784101e90 2023-12-14T18:24:21.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.086+0000 7f27817fa700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f276c0a11e0 0x7f276c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:21.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.087+0000 7f2783fff700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f276c0a11e0 0x7f276c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:21.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.087+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f277c006e40 con 0x7f2784101e90 2023-12-14T18:24:21.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.087+0000 7f2783fff700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f276c0a11e0 0x7f276c0a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f277400b5c0 tx=0x7f2774005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:21.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.090+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f277c095e50 con 0x7f2784101e90 2023-12-14T18:24:21.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.297+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2784061c40 con 0x7f276c0a11e0 2023-12-14T18:24:21.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.298+0000 7f27817fa700 1 -- 172.21.15.69:0/1444499725 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2784061c40 con 0x7f276c0a11e0 2023-12-14T18:24:21.300 INFO:teuthology.orchestra.run.smithi069.stdout:Backend: cephadm 2023-12-14T18:24:21.300 INFO:teuthology.orchestra.run.smithi069.stdout:Available: Yes 2023-12-14T18:24:21.300 INFO:teuthology.orchestra.run.smithi069.stdout:Paused: No 2023-12-14T18:24:21.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f276c0a11e0 msgr2=0x7f276c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:21.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f276c0a11e0 0x7f276c0a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f277400b5c0 tx=0x7f2774005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 msgr2=0x7f278419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:21.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 0x7f278419d650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f277c00b9a0 tx=0x7f277c00bcb0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 shutdown_connections 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f276c0a11e0 0x7f276c0a3690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2784101e90 0x7f278419d650 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2784100300 0x7f2784196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 --2- 172.21.15.69:0/1444499725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2784101500 0x7f27841965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.300+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 >> 172.21.15.69:0/1444499725 conn(0x7f27840fb910 msgr2=0x7f2784104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.301+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 shutdown_connections 2023-12-14T18:24:21.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:21.301+0000 7f278aa01700 1 -- 172.21.15.69:0/1444499725 wait complete. 2023-12-14T18:24:21.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:21 smithi069 ceph-mon[42047]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:24:21.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-14T18:24:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:21 smithi119 ceph-mon[43973]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:24:21.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:21 smithi091 ceph-mon[43601]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:24:22.015 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:22.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:22 smithi069 ceph-mon[42047]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:22.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:22 smithi119 ceph-mon[43973]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:22.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:22 smithi091 ceph-mon[43601]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 -- 172.21.15.69:0/849696956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 msgr2=0x7f637c100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 --2- 172.21.15.69:0/849696956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c100830 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6370009990 tx=0x7f6370009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 -- 172.21.15.69:0/849696956 shutdown_connections 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 --2- 172.21.15.69:0/849696956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f637c100d70 0x7f637c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 --2- 172.21.15.69:0/849696956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f637c0ff1e0 0x7f637c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 --2- 172.21.15.69:0/849696956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c100830 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 -- 172.21.15.69:0/849696956 >> 172.21.15.69:0/849696956 conn(0x7f637c0fa7f0 msgr2=0x7f637c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 -- 172.21.15.69:0/849696956 shutdown_connections 2023-12-14T18:24:23.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 -- 172.21.15.69:0/849696956 wait complete. 2023-12-14T18:24:23.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 Processor -- start 2023-12-14T18:24:23.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.015+0000 7f63828b0700 1 -- start start 2023-12-14T18:24:23.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f63828b0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f637c0ff1e0 0x7f637c069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:23.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f63828b0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:23.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f63828b0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f637c100d70 0x7f637c19d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f63828b0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c19da90 con 0x7f637c1003e0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f63828b0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c19dc00 con 0x7f637c0ff1e0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f63828b0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c19ddc0 con 0x7f637c100d70 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c19acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51344/0 (socket says 172.21.15.69:51344) 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 -- 172.21.15.69:0/3019514645 learned_addr learned my addr 172.21.15.69:0/3019514645 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f6380e4d700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f637c100d70 0x7f637c19d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637bfff700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f637c0ff1e0 0x7f637c069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 -- 172.21.15.69:0/3019514645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f637c100d70 msgr2=0x7f637c19d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f637c100d70 0x7f637c19d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 -- 172.21.15.69:0/3019514645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f637c0ff1e0 msgr2=0x7f637c069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f637c0ff1e0 0x7f637c069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 -- 172.21.15.69:0/3019514645 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700095f0 con 0x7f637c1003e0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.016+0000 7f637b7fe700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c19acb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6370005910 tx=0x7f63700047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.017+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637001d070 con 0x7f637c1003e0 2023-12-14T18:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.017+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f637000be30 con 0x7f637c1003e0 2023-12-14T18:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.017+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c10a9f0 con 0x7f637c1003e0 2023-12-14T18:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.017+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000fe20 con 0x7f637c1003e0 2023-12-14T18:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.017+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c10a860 con 0x7f637c1003e0 2023-12-14T18:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.018+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c19e3e0 con 0x7f637c1003e0 2023-12-14T18:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.018+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f637000f5f0 con 0x7f637c1003e0 2023-12-14T18:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.019+0000 7f63797fa700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f63640a11e0 0x7f63640a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.019+0000 7f637bfff700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f63640a11e0 0x7f63640a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.019+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f63700cdac0 con 0x7f637c1003e0 2023-12-14T18:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.019+0000 7f637bfff700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f63640a11e0 0x7f63640a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f637c100240 tx=0x7f636c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:23.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.023+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f63700972f0 con 0x7f637c1003e0 2023-12-14T18:24:23.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.222+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f637c060f30 con 0x7f63640a11e0 2023-12-14T18:24:23.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.235+0000 7f63797fa700 1 -- 172.21.15.69:0/3019514645 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f637c060f30 con 0x7f63640a11e0 2023-12-14T18:24:23.237 INFO:teuthology.orchestra.run.smithi069.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-14T18:24:23.237 INFO:teuthology.orchestra.run.smithi069.stdout:mds.a smithi069 running (61s) 56s ago 61s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd 58408041787f 2023-12-14T18:24:23.237 INFO:teuthology.orchestra.run.smithi069.stdout:mds.b smithi091 running (59s) 56s ago 59s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd 45db21e4a66d 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.c smithi119 running (68s) 56s ago 68s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd b67bcd5c9029 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.d smithi069 running (74s) 56s ago 73s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd 3b101a575e5b 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.e smithi091 running (72s) 56s ago 71s 14.3M - 18.0.0-3905-g1faa3533 0caf899250bd 4273adb65dde 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.f smithi119 running (70s) 56s ago 70s 13.4M - 18.0.0-3905-g1faa3533 0caf899250bd 62022658ae06 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.g smithi069 running (63s) 56s ago 63s 16.8M - 18.0.0-3905-g1faa3533 0caf899250bd da1fbbd61f49 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.h smithi091 running (66s) 56s ago 66s 15.7M - 18.0.0-3905-g1faa3533 0caf899250bd 7636a2a04836 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.i smithi119 running (65s) 56s ago 64s 16.7M - 18.0.0-3905-g1faa3533 0caf899250bd 79bed17d7d04 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.j smithi069 running (75s) 56s ago 75s 13.3M - 18.0.0-3905-g1faa3533 0caf899250bd f72978195056 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.k smithi091 running (77s) 56s ago 77s 16.8M - 18.0.0-3905-g1faa3533 0caf899250bd e650bc2d2d37 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mds.l smithi119 running (79s) 56s ago 78s 14.2M - 18.0.0-3905-g1faa3533 0caf899250bd 03ed600b9839 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.x smithi069 *:9283,8765 running (6m) 56s ago 6m 510M - 18.0.0-3905-g1faa3533 0caf899250bd fb8afe99ccd2 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.y smithi091 *:8443,8765 running (5m) 56s ago 5m 445M - 18.0.0-3905-g1faa3533 0caf899250bd 7d956068ab5c 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.z smithi119 *:8443,8765 running (5m) 56s ago 5m 443M - 18.0.0-3905-g1faa3533 0caf899250bd 87ff93856a0c 2023-12-14T18:24:23.238 INFO:teuthology.orchestra.run.smithi069.stdout:mon.a smithi069 running (6m) 56s ago 6m 80.6M 2048M 18.0.0-3905-g1faa3533 0caf899250bd bd9183de81f6 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:mon.b smithi091 running (5m) 56s ago 5m 54.8M 2048M 18.0.0-3905-g1faa3533 0caf899250bd f6804a7231df 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:mon.c smithi119 running (5m) 56s ago 5m 55.8M 2048M 18.0.0-3905-g1faa3533 0caf899250bd e1c3bec13f48 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 smithi069 running (4m) 56s ago 4m 53.6M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 026dd4bdc268 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 smithi091 running (4m) 56s ago 4m 57.3M 4278M 18.0.0-3905-g1faa3533 0caf899250bd b52018fd6e83 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 smithi119 running (4m) 56s ago 4m 55.6M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 198c874423c2 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 smithi069 running (3m) 56s ago 3m 49.8M 4278M 18.0.0-3905-g1faa3533 0caf899250bd a8322ec482d8 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 smithi091 running (3m) 56s ago 3m 47.0M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 9bdfaa8143a2 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 smithi119 running (3m) 56s ago 3m 51.2M 4278M 18.0.0-3905-g1faa3533 0caf899250bd f95804caadc8 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 smithi069 running (3m) 56s ago 3m 45.9M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 09051dbd5dc6 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 smithi091 running (2m) 56s ago 2m 52.6M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 9b70b5c09ea1 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 smithi119 running (2m) 56s ago 2m 51.4M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 20a033956822 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 smithi069 running (2m) 56s ago 2m 48.2M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 788f6cfcf304 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 smithi091 running (112s) 56s ago 111s 49.0M 4278M 18.0.0-3905-g1faa3533 0caf899250bd a4e2cb3c9796 2023-12-14T18:24:23.239 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 smithi119 running (94s) 56s ago 94s 43.3M 4278M 18.0.0-3905-g1faa3533 0caf899250bd 9a45b6c15899 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f63640a11e0 msgr2=0x7f63640a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f63640a11e0 0x7f63640a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f637c100240 tx=0x7f636c009260 comp rx=0 tx=0).stop 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 msgr2=0x7f637c19acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c19acb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6370005910 tx=0x7f63700047b0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 shutdown_connections 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f63640a11e0 0x7f63640a3690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f637c100d70 0x7f637c19d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f637c0ff1e0 0x7f637c069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 --2- 172.21.15.69:0/3019514645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637c1003e0 0x7f637c19acb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:23.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 >> 172.21.15.69:0/3019514645 conn(0x7f637c0fa7f0 msgr2=0x7f637c0fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:23.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.237+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 shutdown_connections 2023-12-14T18:24:23.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:23.238+0000 7f63828b0700 1 -- 172.21.15.69:0/3019514645 wait complete. 2023-12-14T18:24:23.634 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:23 smithi069 ceph-mon[42047]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T18:24:23.669 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-14T18:24:23.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:23 smithi119 ceph-mon[43973]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T18:24:23.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:23 smithi091 ceph-mon[43601]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T18:24:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:24.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:24 smithi069 ceph-mon[42047]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:24.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:24 smithi119 ceph-mon[43973]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:24.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:24 smithi091 ceph-mon[43601]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 -- 172.21.15.69:0/957288142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 msgr2=0x7f0ca8100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 --2- 172.21.15.69:0/957288142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8100790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009990 tx=0x7f0ca4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 -- 172.21.15.69:0/957288142 shutdown_connections 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 --2- 172.21.15.69:0/957288142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 0x7f0ca81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 --2- 172.21.15.69:0/957288142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8100790 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 --2- 172.21.15.69:0/957288142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca8101580 0x7f0ca81019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.950+0000 7f0caffa6700 1 -- 172.21.15.69:0/957288142 >> 172.21.15.69:0/957288142 conn(0x7f0ca80fb9d0 msgr2=0x7f0ca80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 -- 172.21.15.69:0/957288142 shutdown_connections 2023-12-14T18:24:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 -- 172.21.15.69:0/957288142 wait complete. 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 Processor -- start 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 -- start start 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca8101580 0x7f0ca8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 0x7f0ca8073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8073ba0 con 0x7f0ca8100380 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8073d10 con 0x7f0ca8101f10 2023-12-14T18:24:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0caffa6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81a0010 con 0x7f0ca8101580 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0cadd42700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0cadd42700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8074890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51358/0 (socket says 172.21.15.69:51358) 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0cadd42700 1 -- 172.21.15.69:0/1566756222 learned_addr learned my addr 172.21.15.69:0/1566756222 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.951+0000 7f0cae543700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 0x7f0ca8073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cad541700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca8101580 0x7f0ca8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cadd42700 1 -- 172.21.15.69:0/1566756222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca8101580 msgr2=0x7f0ca8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cadd42700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca8101580 0x7f0ca8072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cadd42700 1 -- 172.21.15.69:0/1566756222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 msgr2=0x7f0ca8073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cadd42700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 0x7f0ca8073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cadd42700 1 -- 172.21.15.69:0/1566756222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40095f0 con 0x7f0ca8100380 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cae543700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 0x7f0ca8073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0cadd42700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8074890 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400c010 tx=0x7f0ca4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca401d070 con 0x7f0ca8100380 2023-12-14T18:24:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ca4004100 con 0x7f0ca8100380 2023-12-14T18:24:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca810bc10 con 0x7f0ca8100380 2023-12-14T18:24:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4005290 con 0x7f0ca8100380 2023-12-14T18:24:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.952+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca810ba80 con 0x7f0ca8100380 2023-12-14T18:24:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.953+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca8107a20 con 0x7f0ca8100380 2023-12-14T18:24:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.954+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0ca40047e0 con 0x7f0ca8100380 2023-12-14T18:24:24.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.955+0000 7f0c9effd700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0c940a1260 0x7f0c940a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:24.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.955+0000 7f0cad541700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0c940a1260 0x7f0c940a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:24.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.955+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0ca40cdd30 con 0x7f0ca8100380 2023-12-14T18:24:24.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.955+0000 7f0cad541700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0c940a1260 0x7f0c940a3710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c98005950 tx=0x7f0c980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:24.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:24.958+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0ca4097560 con 0x7f0ca8100380 2023-12-14T18:24:25.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.156+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ca8061c80 con 0x7f0c940a1260 2023-12-14T18:24:25.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.161+0000 7f0c9effd700 1 -- 172.21.15.69:0/1566756222 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f0ca8061c80 con 0x7f0c940a1260 2023-12-14T18:24:25.163 INFO:teuthology.orchestra.run.smithi069.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-14T18:24:25.163 INFO:teuthology.orchestra.run.smithi069.stdout:mds.all 12/12 58s ago 83s smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi091=b;smithi091=e;smithi091=h;smithi091=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2023-12-14T18:24:25.163 INFO:teuthology.orchestra.run.smithi069.stdout:mgr 3/3 58s ago 5m smithi069=x;smithi091=y;smithi119=z;count:3 2023-12-14T18:24:25.163 INFO:teuthology.orchestra.run.smithi069.stdout:mon 3/3 58s ago 5m smithi069:172.21.15.69=a;smithi091:172.21.15.91=b;smithi119:172.21.15.119=c;count:3 2023-12-14T18:24:25.164 INFO:teuthology.orchestra.run.smithi069.stdout:osd 12 58s ago - 2023-12-14T18:24:25.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0c940a1260 msgr2=0x7f0c940a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:25.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0c940a1260 0x7f0c940a3710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c98005950 tx=0x7f0c980058e0 comp rx=0 tx=0).stop 2023-12-14T18:24:25.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 msgr2=0x7f0ca8074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:25.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8074890 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400c010 tx=0x7f0ca4005ef0 comp rx=0 tx=0).stop 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 shutdown_connections 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0c940a1260 0x7f0c940a3710 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ca8101f10 0x7f0ca8073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ca8100380 0x7f0ca8074890 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 --2- 172.21.15.69:0/1566756222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca8101580 0x7f0ca8072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 >> 172.21.15.69:0/1566756222 conn(0x7f0ca80fb9d0 msgr2=0x7f0ca8104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 shutdown_connections 2023-12-14T18:24:25.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:25.163+0000 7f0caffa6700 1 -- 172.21.15.69:0/1566756222 wait complete. 2023-12-14T18:24:25.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-14T18:24:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:25 smithi119 ceph-mon[43973]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:24:25.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:25 smithi091 ceph-mon[43601]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:24:25.889 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:25.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:25 smithi069 ceph-mon[42047]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:24:26.665 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-12-14T18:24:26.666 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:26 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2023-12-14T18:24:26.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 -- 172.21.15.69:0/2809505061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d01003e0 msgr2=0x7f14d0100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:26.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2809505061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d01003e0 0x7f14d0100830 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009990 tx=0x7f14bc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 -- 172.21.15.69:0/2809505061 shutdown_connections 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2809505061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d0100d70 0x7f14d0107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2809505061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14d00ff1e0 0x7f14d00ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2809505061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d01003e0 0x7f14d0100830 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 -- 172.21.15.69:0/2809505061 >> 172.21.15.69:0/2809505061 conn(0x7f14d00fa7f0 msgr2=0x7f14d00fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 -- 172.21.15.69:0/2809505061 shutdown_connections 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 -- 172.21.15.69:0/2809505061 wait complete. 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 Processor -- start 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 -- start start 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.841+0000 7f14d6cac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 0x7f14d0194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d6cac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d01003e0 0x7f14d01953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d6cac700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14d0100d70 0x7f14d019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:26.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d6cac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d019c9f0 con 0x7f14d00ff1e0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d6cac700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d019cb30 con 0x7f14d0100d70 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d6cac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d019ccc0 con 0x7f14d01003e0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 0x7f14d0194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 0x7f14d0194e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48982/0 (socket says 172.21.15.69:48982) 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 -- 172.21.15.69:0/2394674711 learned_addr learned my addr 172.21.15.69:0/2394674711 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d5249700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14d0100d70 0x7f14d019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14cffff700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d01003e0 0x7f14d01953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 -- 172.21.15.69:0/2394674711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d01003e0 msgr2=0x7f14d01953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d01003e0 0x7f14d01953a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 -- 172.21.15.69:0/2394674711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14d0100d70 msgr2=0x7f14d019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14d0100d70 0x7f14d019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 -- 172.21.15.69:0/2394674711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0095f0 con 0x7f14d00ff1e0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d4a48700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 0x7f14d0194e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d9b0 tx=0x7f14c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400b950 con 0x7f14d00ff1e0 2023-12-14T18:24:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14c4007620 con 0x7f14d00ff1e0 2023-12-14T18:24:26.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d010aa60 con 0x7f14d00ff1e0 2023-12-14T18:24:26.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.842+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400f3c0 con 0x7f14d00ff1e0 2023-12-14T18:24:26.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.843+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d010a8d0 con 0x7f14d00ff1e0 2023-12-14T18:24:26.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.843+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d0106820 con 0x7f14d00ff1e0 2023-12-14T18:24:26.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.844+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f14c400bab0 con 0x7f14d00ff1e0 2023-12-14T18:24:26.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.845+0000 7f14cdffb700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f14c00a11e0 0x7f14c00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:26.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.845+0000 7f14cffff700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f14c00a11e0 0x7f14c00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:26.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.845+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f14c40ccc40 con 0x7f14d00ff1e0 2023-12-14T18:24:26.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.845+0000 7f14cffff700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f14c00a11e0 0x7f14c00a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00b5c0 tx=0x7f14bc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:26.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:26.849+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f14c40d3080 con 0x7f14d00ff1e0 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-12-14T18:24:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:26 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2023-12-14T18:24:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-12-14T18:24:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-12-14T18:24:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2023-12-14T18:24:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-12-14T18:24:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-12-14T18:24:26.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-12-14T18:24:26.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-12-14T18:24:26.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:26 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2023-12-14T18:24:27.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.047+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d0061c60 con 0x7f14c00a11e0 2023-12-14T18:24:27.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.049+0000 7f14cdffb700 1 -- 172.21.15.69:0/2394674711 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f14d0061c60 con 0x7f14c00a11e0 2023-12-14T18:24:27.051 INFO:teuthology.orchestra.run.smithi069.stdout:HOST ADDR LABELS STATUS 2023-12-14T18:24:27.051 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 172.21.15.69 2023-12-14T18:24:27.051 INFO:teuthology.orchestra.run.smithi069.stdout:smithi091 172.21.15.91 2023-12-14T18:24:27.051 INFO:teuthology.orchestra.run.smithi069.stdout:smithi119 172.21.15.119 2023-12-14T18:24:27.051 INFO:teuthology.orchestra.run.smithi069.stdout:3 hosts in cluster 2023-12-14T18:24:27.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f14c00a11e0 msgr2=0x7f14c00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:27.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f14c00a11e0 0x7f14c00a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00b5c0 tx=0x7f14bc005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:27.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 msgr2=0x7f14d0194e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:27.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 0x7f14d0194e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d9b0 tx=0x7f14c400dcc0 comp rx=0 tx=0).stop 2023-12-14T18:24:27.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 shutdown_connections 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f14c00a11e0 0x7f14c00a3690 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14d0100d70 0x7f14d019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d00ff1e0 0x7f14d0194e60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 --2- 172.21.15.69:0/2394674711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d01003e0 0x7f14d01953a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 >> 172.21.15.69:0/2394674711 conn(0x7f14d00fa7f0 msgr2=0x7f14d0103960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 shutdown_connections 2023-12-14T18:24:27.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:27.051+0000 7f14d6cac700 1 -- 172.21.15.69:0/2394674711 wait complete. 2023-12-14T18:24:27.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-14T18:24:27.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:24:27.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-12-14T18:24:27.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: osdmap e80: 12 total, 12 up, 12 in 2023-12-14T18:24:27.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:27 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: osdmap e80: 12 total, 12 up, 12 in 2023-12-14T18:24:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:27 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:24:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:24:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-12-14T18:24:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-12-14T18:24:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2023-12-14T18:24:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-12-14T18:24:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-12-14T18:24:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-12-14T18:24:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-12-14T18:24:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2023-12-14T18:24:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: osdmap e80: 12 total, 12 up, 12 in 2023-12-14T18:24:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:27 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:24:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:28.809 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:28 smithi069 ceph-mon[42047]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:28.809 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:28 smithi069 ceph-mon[42047]: osdmap e81: 12 total, 12 up, 12 in 2023-12-14T18:24:28.809 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:28.810 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:28 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:28 smithi119 ceph-mon[43973]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:28 smithi119 ceph-mon[43973]: osdmap e81: 12 total, 12 up, 12 in 2023-12-14T18:24:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:28 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:28.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:28 smithi091 ceph-mon[43601]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:28.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:28 smithi091 ceph-mon[43601]: osdmap e81: 12 total, 12 up, 12 in 2023-12-14T18:24:28.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:28.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:28 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3930962425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4100df0 msgr2=0x7fb2c41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:29.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3930962425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4100df0 0x7fb2c41031d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009990 tx=0x7fb2b4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3930962425 shutdown_connections 2023-12-14T18:24:29.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3930962425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2c4106030 0x7fb2c4108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3930962425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4100df0 0x7fb2c41031d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3930962425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c4103710 0x7fb2c4105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3930962425 >> 172.21.15.69:0/3930962425 conn(0x7fb2c40fa7f0 msgr2=0x7fb2c40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:29.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3930962425 shutdown_connections 2023-12-14T18:24:29.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.205+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3930962425 wait complete. 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 Processor -- start 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 -- start start 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c4100df0 0x7fb2c4100750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2c4103710 0x7fb2c40feda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 0x7fb2c40ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40ffa60 con 0x7fb2c4106030 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40ffbd0 con 0x7fb2c4103710 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2ca19a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c419ffd0 con 0x7fb2c4100df0 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 0x7fb2c40ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 0x7fb2c40ff2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49006/0 (socket says 172.21.15.69:49006) 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 -- 172.21.15.69:0/3556818865 learned_addr learned my addr 172.21.15.69:0/3556818865 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c2ffd700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2c4103710 0x7fb2c40feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:29.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c37fe700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c4100df0 0x7fb2c4100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 -- 172.21.15.69:0/3556818865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c4100df0 msgr2=0x7fb2c4100750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c4100df0 0x7fb2c4100750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 -- 172.21.15.69:0/3556818865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2c4103710 msgr2=0x7fb2c40feda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2c4103710 0x7fb2c40feda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.206+0000 7fb2c3fff700 1 -- 172.21.15.69:0/3556818865 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40095f0 con 0x7fb2c4106030 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.207+0000 7fb2c3fff700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 0x7fb2c40ff2e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0094f0 tx=0x7fb2bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.207+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc004db0 con 0x7fb2c4106030 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.207+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c410bb30 con 0x7fb2c4106030 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.207+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2bc00f040 con 0x7fb2c4106030 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.207+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0058b0 con 0x7fb2c4106030 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.207+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c410b9a0 con 0x7fb2c4106030 2023-12-14T18:24:29.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.208+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c40fc360 con 0x7fb2c4106030 2023-12-14T18:24:29.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.209+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb2bc00db20 con 0x7fb2c4106030 2023-12-14T18:24:29.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.210+0000 7fb2c0ff9700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb2ac0a11e0 0x7fb2ac0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:29.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.210+0000 7fb2c37fe700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb2ac0a11e0 0x7fb2ac0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:29.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.210+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb2bc0ccb30 con 0x7fb2c4106030 2023-12-14T18:24:29.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.210+0000 7fb2c37fe700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb2ac0a11e0 0x7fb2ac0a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006010 tx=0x7fb2b400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:29.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.213+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb2bc096130 con 0x7fb2c4106030 2023-12-14T18:24:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.423+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2c40619a0 con 0x7fb2ac0a11e0 2023-12-14T18:24:29.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.425+0000 7fb2c0ff9700 1 -- 172.21.15.69:0/3556818865 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fb2c40619a0 con 0x7fb2ac0a11e0 2023-12-14T18:24:29.426 INFO:teuthology.orchestra.run.smithi069.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-14T18:24:29.426 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y0400BGN 372G No 2m ago LVM detected, locked 2023-12-14T18:24:29.426 INFO:teuthology.orchestra.run.smithi069.stdout:smithi091 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300AG400BGN 372G No 113s ago LVM detected, locked 2023-12-14T18:24:29.426 INFO:teuthology.orchestra.run.smithi069.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 95s ago LVM detected, locked 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb2ac0a11e0 msgr2=0x7fb2ac0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb2ac0a11e0 0x7fb2ac0a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006010 tx=0x7fb2b400b540 comp rx=0 tx=0).stop 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 msgr2=0x7fb2c40ff2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 0x7fb2c40ff2e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0094f0 tx=0x7fb2bc00d3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 shutdown_connections 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb2ac0a11e0 0x7fb2ac0a3690 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2c4106030 0x7fb2c40ff2e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c4100df0 0x7fb2c4100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 --2- 172.21.15.69:0/3556818865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2c4103710 0x7fb2c40feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 >> 172.21.15.69:0/3556818865 conn(0x7fb2c40fa7f0 msgr2=0x7fb2c4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 shutdown_connections 2023-12-14T18:24:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:29.427+0000 7fb2ca19a700 1 -- 172.21.15.69:0/3556818865 wait complete. 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: pgmap v252: 97 pgs: 4 peering, 93 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:24:29.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.851 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-14T18:24:29.862 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T18:24:29.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: pgmap v252: 97 pgs: 4 peering, 93 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:24:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: pgmap v252: 97 pgs: 4 peering, 93 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-12-14T18:24:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:24:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:24:29.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:24:30.173 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:30.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:30 smithi119 ceph-mon[43973]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:30.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:30 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:24:30.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:30 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:24:30.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:30 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:24:30.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:30 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:24:30.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:30 smithi091 ceph-mon[43601]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:30.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:30 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:24:30.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:30 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:24:30.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:30 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:24:30.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:30 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:24:30.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:30 smithi069 ceph-mon[42047]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-14T18:24:30.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:30 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:24:30.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:30 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:24:30.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:30 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:24:30.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:30 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:24:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 -- 172.21.15.69:0/620179877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70200ff1e0 msgr2=0x7f70200ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 --2- 172.21.15.69:0/620179877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70200ff1e0 0x7f70200ff5f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f701c009990 tx=0x7f701c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 -- 172.21.15.69:0/620179877 shutdown_connections 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 --2- 172.21.15.69:0/620179877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7020100d70 0x7f7020107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 --2- 172.21.15.69:0/620179877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70200ff1e0 0x7f70200ff5f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 --2- 172.21.15.69:0/620179877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70201003e0 0x7f7020100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 -- 172.21.15.69:0/620179877 >> 172.21.15.69:0/620179877 conn(0x7f70200fa7f0 msgr2=0x7f70200fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 -- 172.21.15.69:0/620179877 shutdown_connections 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.130+0000 7f70283c2700 1 -- 172.21.15.69:0/620179877 wait complete. 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.131+0000 7f70283c2700 1 Processor -- start 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.131+0000 7f70283c2700 1 -- start start 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70200ff1e0 0x7f7020194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:31.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70201003e0 0x7f70201953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 0x7f702019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702019ca40 con 0x7f7020100d70 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200685b0 con 0x7f70201003e0 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020068770 con 0x7f70200ff1e0 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 0x7f702019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 0x7f702019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49034/0 (socket says 172.21.15.69:49034) 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 -- 172.21.15.69:0/2675397716 learned_addr learned my addr 172.21.15.69:0/2675397716 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702595d700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70201003e0 0x7f70201953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702615e700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70200ff1e0 0x7f7020194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:31.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 -- 172.21.15.69:0/2675397716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70200ff1e0 msgr2=0x7f7020194eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70200ff1e0 0x7f7020194eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 -- 172.21.15.69:0/2675397716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70201003e0 msgr2=0x7f70201953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70201003e0 0x7f70201953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 -- 172.21.15.69:0/2675397716 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c0095f0 con 0x7f7020100d70 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f702695f700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 0x7f702019c470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7018007ee0 tx=0x7f701800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018017070 con 0x7f7020100d70 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701800f040 con 0x7f7020100d70 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702010a9e0 con 0x7f7020100d70 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018005570 con 0x7f7020100d70 2023-12-14T18:24:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.132+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702010a850 con 0x7f7020100d70 2023-12-14T18:24:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.133+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020066ea0 con 0x7f7020100d70 2023-12-14T18:24:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.134+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f701800db20 con 0x7f7020100d70 2023-12-14T18:24:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.135+0000 7f70137fe700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f700c0a11e0 0x7f700c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.135+0000 7f702615e700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f700c0a11e0 0x7f700c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.135+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f70180cc860 con 0x7f7020100d70 2023-12-14T18:24:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.135+0000 7f702615e700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f700c0a11e0 0x7f700c0a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f701c00b5c0 tx=0x7f701c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.138+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7018095e60 con 0x7f7020100d70 2023-12-14T18:24:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.368+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7020106710 con 0x7f7020100d70 2023-12-14T18:24:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.369+0000 7f70137fe700 1 -- 172.21.15.69:0/2675397716 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+2889 (secure 0 0 0) 0x7f7018099480 con 0x7f7020100d70 2023-12-14T18:24:31.370 INFO:teuthology.orchestra.run.smithi069.stdout:e22 2023-12-14T18:24:31.370 INFO:teuthology.orchestra.run.smithi069.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:legacy client fscid: 1 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:Filesystem 'cephfs' (1) 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:fs_name cephfs 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 22 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-12-14T18:23:29.291233+0000 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2023-12-14T18:23:34.332024+0000 2023-12-14T18:24:31.371 INFO:teuthology.orchestra.run.smithi069.stdout:tableserver 0 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:root 0 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:session_timeout 300 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:session_autoclose 300 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:max_file_size 1099511627776 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:max_xattr_size 65536 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:required_client_features {} 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure 0 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure_osd_epoch 0 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-14T18:24:31.372 INFO:teuthology.orchestra.run.smithi069.stdout:max_mds 3 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:in 0,1,2 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:up {0=24509,1=24482,2=24458} 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:failed 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:damaged 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:stopped 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:data_pools [3] 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:metadata_pool 2 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:inline_data disabled 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:balancer 2023-12-14T18:24:31.373 INFO:teuthology.orchestra.run.smithi069.stdout:bal_rank_mask -1 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:standby_count_wanted 0 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b{0:24509} state up:active seq 3 addr [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.i{0:24457} state up:standby-replay seq 1 addr [v2:172.21.15.119:6838/771447970,v1:172.21.15.119:6839/771447970] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.h{1:24482} state up:active seq 5 addr [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c{1:24442} state up:standby-replay seq 1 addr [v2:172.21.15.119:6836/3442609233,v1:172.21.15.119:6837/3442609233] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.e{2:24458} state up:active seq 7 addr [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.f{2:24430} state up:standby-replay seq 1 addr [v2:172.21.15.119:6834/1476188818,v1:172.21.15.119:6835/1476188818] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:31.374 INFO:teuthology.orchestra.run.smithi069.stdout:Standby daemons: 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.l{-1:14541} state up:standby seq 1 addr [v2:172.21.15.119:6832/4104371233,v1:172.21.15.119:6833/4104371233] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.j{-1:14559} state up:standby seq 1 addr [v2:172.21.15.69:6834/4151675388,v1:172.21.15.69:6835/4151675388] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d{-1:14571} state up:standby seq 1 addr [v2:172.21.15.69:6836/1672922586,v1:172.21.15.69:6837/1672922586] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.g{-1:14625} state up:standby seq 1 addr [v2:172.21.15.69:6838/3763863482,v1:172.21.15.69:6839/3763863482] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a{-1:14637} state up:standby seq 1 addr [v2:172.21.15.69:6840/3629482996,v1:172.21.15.69:6841/3629482996] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.375 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.91:6832/653738912,v1:172.21.15.91:6833/653738912] compat {c=[1],r=[1],i=[7ff]}] 2023-12-14T18:24:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f700c0a11e0 msgr2=0x7f700c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f700c0a11e0 0x7f700c0a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f701c00b5c0 tx=0x7f701c005fd0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 msgr2=0x7f702019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 0x7f702019c470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7018007ee0 tx=0x7f701800d3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 shutdown_connections 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f700c0a11e0 0x7f700c0a3690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7020100d70 0x7f702019c470 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70200ff1e0 0x7f7020194eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 --2- 172.21.15.69:0/2675397716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70201003e0 0x7f70201953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 >> 172.21.15.69:0/2675397716 conn(0x7f70200fa7f0 msgr2=0x7f7020103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 shutdown_connections 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:31.371+0000 7f70283c2700 1 -- 172.21.15.69:0/2675397716 wait complete. 2023-12-14T18:24:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:31.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:31 smithi069 ceph-mon[42047]: pgmap v253: 97 pgs: 4 peering, 1 active+recovering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:31.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:31 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2675397716' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-14T18:24:31.760 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- bash -c 'ceph osd dump' 2023-12-14T18:24:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:31 smithi119 ceph-mon[43973]: pgmap v253: 97 pgs: 4 peering, 1 active+recovering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:31 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2675397716' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-14T18:24:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:31 smithi091 ceph-mon[43601]: pgmap v253: 97 pgs: 4 peering, 1 active+recovering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:31 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2675397716' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-14T18:24:32.072 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:33.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 -- 172.21.15.69:0/1287911220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101510 msgr2=0x7fd1f4101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 --2- 172.21.15.69:0/1287911220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101510 0x7fd1f4101960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009990 tx=0x7fd1e4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 -- 172.21.15.69:0/1287911220 shutdown_connections 2023-12-14T18:24:33.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 --2- 172.21.15.69:0/1287911220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f4101ea0 0x7fd1f4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 --2- 172.21.15.69:0/1287911220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1f4100310 0x7fd1f4100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 --2- 172.21.15.69:0/1287911220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101510 0x7fd1f4101960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 -- 172.21.15.69:0/1287911220 >> 172.21.15.69:0/1287911220 conn(0x7fd1f40fb960 msgr2=0x7fd1f40fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 -- 172.21.15.69:0/1287911220 shutdown_connections 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.023+0000 7fd1fa657700 1 -- 172.21.15.69:0/1287911220 wait complete. 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 Processor -- start 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 -- start start 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f4100310 0x7fd1f4195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1f4101510 0x7fd1f4196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 0x7fd1f419d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f419da80 con 0x7fd1f4101ea0 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f419dbc0 con 0x7fd1f4101510 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1fa657700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f419dd50 con 0x7fd1f4100310 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1f8bf4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 0x7fd1f419d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1f8bf4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 0x7fd1f419d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49048/0 (socket says 172.21.15.69:49048) 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1f8bf4700 1 -- 172.21.15.69:0/2222731007 learned_addr learned my addr 172.21.15.69:0/2222731007 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1f37fe700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1f4101510 0x7fd1f4196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.024+0000 7fd1f3fff700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f4100310 0x7fd1f4195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f8bf4700 1 -- 172.21.15.69:0/2222731007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f4100310 msgr2=0x7fd1f4195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f8bf4700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f4100310 0x7fd1f4195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f8bf4700 1 -- 172.21.15.69:0/2222731007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1f4101510 msgr2=0x7fd1f4196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f8bf4700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1f4101510 0x7fd1f4196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f8bf4700 1 -- 172.21.15.69:0/2222731007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40095f0 con 0x7fd1f4101ea0 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f8bf4700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 0x7fd1f419d4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec007da0 tx=0x7fd1ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00ac50 con 0x7fd1f4101ea0 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1ec00adb0 con 0x7fd1f4101ea0 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f410bb20 con 0x7fd1f4101ea0 2023-12-14T18:24:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0115e0 con 0x7fd1f4101ea0 2023-12-14T18:24:33.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.025+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f410b990 con 0x7fd1f4101ea0 2023-12-14T18:24:33.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.026+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f4107910 con 0x7fd1f4101ea0 2023-12-14T18:24:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.027+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd1ec004ad0 con 0x7fd1f4101ea0 2023-12-14T18:24:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.028+0000 7fd1f17fa700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1dc0a11e0 0x7fd1dc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.028+0000 7fd1f3fff700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1dc0a11e0 0x7fd1dc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.028+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd1ec0ccf80 con 0x7fd1f4101ea0 2023-12-14T18:24:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.028+0000 7fd1f3fff700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1dc0a11e0 0x7fd1dc0a3690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4101370 tx=0x7fd1e800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:33.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.031+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd1ec096690 con 0x7fd1f4101ea0 2023-12-14T18:24:33.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.223+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fd1f402cfe0 con 0x7fd1f4101ea0 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.224+0000 7fd1f17fa700 1 -- 172.21.15.69:0/2222731007 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) v1 ==== 56+0+5270 (secure 0 0 0) 0x7fd1ec099cb0 con 0x7fd1f4101ea0 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 81 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stdout:fsid f1527c12-9aac-11ee-95a5-87774f69a715 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-12-14T18:17:40.156489+0000 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2023-12-14T18:24:27.525352+0000 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-12-14T18:24:33.225 INFO:teuthology.orchestra.run.smithi069.stdout:crush_version 26 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:full_ratio 0.95 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:backfillfull_ratio 0.9 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:nearfull_ratio 0.85 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:require_min_compat_client luminous 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:min_compat_client luminous 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:require_osd_release reef 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:stretch_mode_enabled false 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-12-14T18:24:33.226 INFO:teuthology.orchestra.run.smithi069.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:max_osd 12 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6802/1311409675,v1:172.21.15.69:6803/1311409675] [v2:172.21.15.69:6804/1311409675,v1:172.21.15.69:6805/1311409675] exists,up 56f72c81-c108-4731-8724-00763a3933d9 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.91:6800/3579777020,v1:172.21.15.91:6801/3579777020] [v2:172.21.15.91:6802/3579777020,v1:172.21.15.91:6803/3579777020] exists,up 3f983667-4671-4b3b-9ae7-6f87d8fc3e60 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/1861543624,v1:172.21.15.119:6801/1861543624] [v2:172.21.15.119:6802/1861543624,v1:172.21.15.119:6803/1861543624] exists,up 6bd26b89-5342-4e8a-8365-c47ce87f298d 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 up in weight 1 up_from 24 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6810/3948335762,v1:172.21.15.69:6811/3948335762] [v2:172.21.15.69:6812/3948335762,v1:172.21.15.69:6813/3948335762] exists,up 5f23d99f-7851-4905-8583-6cdd9fb6f75f 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 up in weight 1 up_from 31 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.91:6808/3884359011,v1:172.21.15.91:6809/3884359011] [v2:172.21.15.91:6810/3884359011,v1:172.21.15.91:6811/3884359011] exists,up ad340870-d572-419a-9812-e22954c498b0 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 up in weight 1 up_from 36 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/3766790322,v1:172.21.15.119:6809/3766790322] [v2:172.21.15.119:6810/3766790322,v1:172.21.15.119:6811/3766790322] exists,up 6ebe12f3-7661-4ca7-a325-44590e2cbe37 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 up in weight 1 up_from 43 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6818/2145059445,v1:172.21.15.69:6819/2145059445] [v2:172.21.15.69:6820/2145059445,v1:172.21.15.69:6821/2145059445] exists,up bc1bee25-8cfc-47b3-bee5-df0c011fb92a 2023-12-14T18:24:33.227 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 up in weight 1 up_from 48 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.91:6816/3612368750,v1:172.21.15.91:6817/3612368750] [v2:172.21.15.91:6818/3612368750,v1:172.21.15.91:6819/3612368750] exists,up 1a855d88-a81c-4556-9e92-30d841fbc57d 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 up in weight 1 up_from 55 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/1350490441,v1:172.21.15.119:6817/1350490441] [v2:172.21.15.119:6818/1350490441,v1:172.21.15.119:6819/1350490441] exists,up b512b899-9be2-4fc9-a305-589642b320e5 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 up in weight 1 up_from 62 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6826/242196071,v1:172.21.15.69:6827/242196071] [v2:172.21.15.69:6828/242196071,v1:172.21.15.69:6829/242196071] exists,up 60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 up in weight 1 up_from 67 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.91:6824/687412463,v1:172.21.15.91:6825/687412463] [v2:172.21.15.91:6826/687412463,v1:172.21.15.91:6827/687412463] exists,up 17daa9d6-173d-42ba-99d5-bf6b9e235efa 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 up in weight 1 up_from 74 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/1392075929,v1:172.21.15.119:6825/1392075929] [v2:172.21.15.119:6826/1392075929,v1:172.21.15.119:6827/1392075929] exists,up 22a093d7-7882-4043-bbd4-396c85352b5c 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.8 [2,11] 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.b [8,11] 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.10 [2,4] 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.14 [4,6] 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.1b [4,8] 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.20 [5,9] 2023-12-14T18:24:33.228 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.2c [4,9] 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.2d [3,9] 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/3699885016 expires 2023-12-15T18:18:26.173798+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/3699885016 expires 2023-12-15T18:18:26.173798+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1705055800 expires 2023-12-15T18:18:03.680568+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/786686306 expires 2023-12-15T18:18:26.173798+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/3801854408 expires 2023-12-15T18:18:03.680568+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/3054579215 expires 2023-12-15T18:18:03.680568+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/3468744885 expires 2023-12-15T18:18:03.680568+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/778280662 expires 2023-12-15T18:18:26.173798+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/904652576 expires 2023-12-15T18:18:26.173798+0000 2023-12-14T18:24:33.229 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/3801854408 expires 2023-12-15T18:18:03.680568+0000 2023-12-14T18:24:33.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1dc0a11e0 msgr2=0x7fd1dc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1dc0a11e0 0x7fd1dc0a3690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4101370 tx=0x7fd1e800b410 comp rx=0 tx=0).stop 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 msgr2=0x7fd1f419d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 0x7fd1f419d4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec007da0 tx=0x7fd1ec00a340 comp rx=0 tx=0).stop 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 shutdown_connections 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1dc0a11e0 0x7fd1dc0a3690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f4101ea0 0x7fd1f419d4b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f4100310 0x7fd1f4195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 --2- 172.21.15.69:0/2222731007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1f4101510 0x7fd1f4196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 >> 172.21.15.69:0/2222731007 conn(0x7fd1f40fb960 msgr2=0x7fd1f4104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:33.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 shutdown_connections 2023-12-14T18:24:33.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.226+0000 7fd1fa657700 1 -- 172.21.15.69:0/2222731007 wait complete. 2023-12-14T18:24:33.644 INFO:teuthology.run_tasks:Running task fs.ready... 2023-12-14T18:24:33.656 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:33.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 -- 172.21.15.69:0/3950197454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1640ff150 msgr2=0x7ff1640ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/3950197454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1640ff150 0x7ff1640ff560 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff160009990 tx=0x7ff160009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 -- 172.21.15.69:0/3950197454 shutdown_connections 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/3950197454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff164100d90 0x7ff164107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/3950197454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1640ff150 0x7ff1640ff560 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/3950197454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 0x7ff164100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 -- 172.21.15.69:0/3950197454 >> 172.21.15.69:0/3950197454 conn(0x7ff1640fa750 msgr2=0x7ff1640fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 -- 172.21.15.69:0/3950197454 shutdown_connections 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 -- 172.21.15.69:0/3950197454 wait complete. 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.781+0000 7ff16b6c9700 1 Processor -- start 2023-12-14T18:24:33.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 -- start start 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1640ff150 0x7ff164194dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 0x7ff164195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 0x7ff16419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16419c950 con 0x7ff164100d90 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16419ca90 con 0x7ff1641003e0 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16419cc20 con 0x7ff1640ff150 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 0x7ff16419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 0x7ff16419c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49058/0 (socket says 172.21.15.69:49058) 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 -- 172.21.15.69:0/1876868048 learned_addr learned my addr 172.21.15.69:0/1876868048 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169465700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1640ff150 0x7ff164194dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff168c64700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 0x7ff164195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 -- 172.21.15.69:0/1876868048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1640ff150 msgr2=0x7ff164194dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1640ff150 0x7ff164194dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 -- 172.21.15.69:0/1876868048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 msgr2=0x7ff164195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 0x7ff164195310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 -- 172.21.15.69:0/1876868048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600095f0 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff168c64700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 0x7ff164195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff169c66700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 0x7ff16419c380 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff15c007d70 tx=0x7ff15c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c00ad40 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff15c0128b0 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16410aa00 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.782+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0115a0 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.783+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16410a870 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.783+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff164069d60 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.785+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff15c012a20 con 0x7ff164100d90 2023-12-14T18:24:33.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.785+0000 7ff15a7fc700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff1500a11e0 0x7ff1500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:33.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.785+0000 7ff169465700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff1500a11e0 0x7ff1500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:33.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.785+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff15c0cd010 con 0x7ff164100d90 2023-12-14T18:24:33.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.786+0000 7ff169465700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff1500a11e0 0x7ff1500a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b5c0 tx=0x7ff160005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:33.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.789+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff15c0966c0 con 0x7ff164100d90 2023-12-14T18:24:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:33 smithi119 ceph-mon[43973]: pgmap v254: 97 pgs: 1 active+recovering, 96 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:33 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2222731007' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-14T18:24:33.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:33 smithi091 ceph-mon[43601]: pgmap v254: 97 pgs: 1 active+recovering, 96 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:33.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:33 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2222731007' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-14T18:24:33.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:33 smithi069 ceph-mon[42047]: pgmap v254: 97 pgs: 1 active+recovering, 96 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:33.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:33 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2222731007' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-14T18:24:33.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.980+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff164069ef0 con 0x7ff164100d90 2023-12-14T18:24:33.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.981+0000 7ff15a7fc700 1 -- 172.21.15.69:0/1876868048 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7ff15c099ce0 con 0x7ff164100d90 2023-12-14T18:24:33.983 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:33.983 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:33.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.983+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff1500a11e0 msgr2=0x7ff1500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.983+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff1500a11e0 0x7ff1500a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b5c0 tx=0x7ff160005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.983+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 msgr2=0x7ff16419c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:33.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 0x7ff16419c380 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff15c007d70 tx=0x7ff15c00a340 comp rx=0 tx=0).stop 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 shutdown_connections 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff1500a11e0 0x7ff1500a3690 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff164100d90 0x7ff16419c380 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1640ff150 0x7ff164194dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 --2- 172.21.15.69:0/1876868048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff1641003e0 0x7ff164195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 >> 172.21.15.69:0/1876868048 conn(0x7ff1640fa750 msgr2=0x7ff1640fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 shutdown_connections 2023-12-14T18:24:33.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:33.984+0000 7ff16b6c9700 1 -- 172.21.15.69:0/1876868048 wait complete. 2023-12-14T18:24:33.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:33.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:34.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 -- 172.21.15.69:0/1374010114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c81035e0 msgr2=0x7ff2c81059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/1374010114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c81035e0 0x7ff2c81059c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009990 tx=0x7ff2c4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 -- 172.21.15.69:0/1374010114 shutdown_connections 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/1374010114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c8105f00 0x7ff2c8108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/1374010114 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c8100cc0 0x7ff2c81030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/1374010114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c81035e0 0x7ff2c81059c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 -- 172.21.15.69:0/1374010114 >> 172.21.15.69:0/1374010114 conn(0x7ff2c80fa740 msgr2=0x7ff2c80fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 -- 172.21.15.69:0/1374010114 shutdown_connections 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 -- 172.21.15.69:0/1374010114 wait complete. 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 Processor -- start 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.123+0000 7ff2d00d1700 1 -- start start 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 0x7ff2c8195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c81035e0 0x7ff2c8196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c8105f00 0x7ff2c819d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c819d9b0 con 0x7ff2c8100cc0 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c819daf0 con 0x7ff2c81035e0 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c819dc80 con 0x7ff2c8105f00 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 0x7ff2c8195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 0x7ff2c8195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49080/0 (socket says 172.21.15.69:49080) 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 -- 172.21.15.69:0/2860772732 learned_addr learned my addr 172.21.15.69:0/2860772732 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2ce66e700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c8105f00 0x7ff2c819d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cd66c700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c81035e0 0x7ff2c8196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 -- 172.21.15.69:0/2860772732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c8105f00 msgr2=0x7ff2c819d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c8105f00 0x7ff2c819d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 -- 172.21.15.69:0/2860772732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c81035e0 msgr2=0x7ff2c8196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c81035e0 0x7ff2c8196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 -- 172.21.15.69:0/2860772732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40095f0 con 0x7ff2c8100cc0 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cd66c700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c81035e0 0x7ff2c8196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2cde6d700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 0x7ff2c8195e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c9b0 tx=0x7ff2b800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8007b00 con 0x7ff2c8100cc0 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2b8007c60 con 0x7ff2c8100cc0 2023-12-14T18:24:34.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c810ba70 con 0x7ff2c8100cc0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8018660 con 0x7ff2c8100cc0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.124+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c810b8e0 con 0x7ff2c8100cc0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.125+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80fc2b0 con 0x7ff2c8100cc0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.126+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff2b800f450 con 0x7ff2c8100cc0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.127+0000 7ff2beffd700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2b40a11e0 0x7ff2b40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.127+0000 7ff2cd66c700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2b40a11e0 0x7ff2b40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.127+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff2b80ccd50 con 0x7ff2c8100cc0 2023-12-14T18:24:34.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.127+0000 7ff2cd66c700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2b40a11e0 0x7ff2b40a3690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40095c0 tx=0x7ff2c4009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:34.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.130+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff2b80963e0 con 0x7ff2c8100cc0 2023-12-14T18:24:34.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.318+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2c8061700 con 0x7ff2c8100cc0 2023-12-14T18:24:34.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.319+0000 7ff2beffd700 1 -- 172.21.15.69:0/2860772732 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2b8099a00 con 0x7ff2c8100cc0 2023-12-14T18:24:34.320 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:34.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2b40a11e0 msgr2=0x7ff2b40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2b40a11e0 0x7ff2b40a3690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40095c0 tx=0x7ff2c4009510 comp rx=0 tx=0).stop 2023-12-14T18:24:34.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 msgr2=0x7ff2c8195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 0x7ff2c8195e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c9b0 tx=0x7ff2b800cd70 comp rx=0 tx=0).stop 2023-12-14T18:24:34.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 shutdown_connections 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2b40a11e0 0x7ff2b40a3690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c8105f00 0x7ff2c819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2c8100cc0 0x7ff2c8195e30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 --2- 172.21.15.69:0/2860772732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c81035e0 0x7ff2c8196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 >> 172.21.15.69:0/2860772732 conn(0x7ff2c80fa740 msgr2=0x7ff2c8101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 shutdown_connections 2023-12-14T18:24:34.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.321+0000 7ff2d00d1700 1 -- 172.21.15.69:0/2860772732 wait complete. 2023-12-14T18:24:34.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.458+0000 7f5e000a2700 1 -- 172.21.15.69:0/2951728174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 msgr2=0x7f5df81018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.458+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2951728174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81018f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009990 tx=0x7f5df4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- 172.21.15.69:0/2951728174 shutdown_connections 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2951728174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 0x7f5df81086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2951728174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df80fe4d0 0x7f5df80fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2951728174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81018f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- 172.21.15.69:0/2951728174 >> 172.21.15.69:0/2951728174 conn(0x7f5df80f9ed0 msgr2=0x7f5df80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- 172.21.15.69:0/2951728174 shutdown_connections 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- 172.21.15.69:0/2951728174 wait complete. 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 Processor -- start 2023-12-14T18:24:34.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- start start 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df80fe4d0 0x7f5df8195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 0x7f5df819d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df819daf0 con 0x7f5df81014a0 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df819dc30 con 0x7f5df80fe4d0 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5e000a2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df819ddc0 con 0x7f5df8101e30 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5dfd63d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.459+0000 7f5dfd63d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49094/0 (socket says 172.21.15.69:49094) 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 -- 172.21.15.69:0/2987952651 learned_addr learned my addr 172.21.15.69:0/2987952651 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfe63f700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 0x7f5df819d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfde3e700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df80fe4d0 0x7f5df8195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 -- 172.21.15.69:0/2987952651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 msgr2=0x7f5df819d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 0x7f5df819d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 -- 172.21.15.69:0/2987952651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df80fe4d0 msgr2=0x7f5df8195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df80fe4d0 0x7f5df8195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 -- 172.21.15.69:0/2987952651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40095f0 con 0x7f5df81014a0 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfe63f700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 0x7f5df819d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5dfd63d700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81964b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000c00 tx=0x7f5df4003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df401d070 con 0x7f5df81014a0 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df810bb10 con 0x7f5df81014a0 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5df400bd70 con 0x7f5df81014a0 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4022e30 con 0x7f5df81014a0 2023-12-14T18:24:34.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.460+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df810b980 con 0x7f5df81014a0 2023-12-14T18:24:34.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.461+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8107260 con 0x7f5df81014a0 2023-12-14T18:24:34.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.462+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5df4022470 con 0x7f5df81014a0 2023-12-14T18:24:34.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.462+0000 7f5deeffd700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5de40a11e0 0x7f5de40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.463+0000 7f5dfde3e700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5de40a11e0 0x7f5de40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.463+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5df40ce750 con 0x7f5df81014a0 2023-12-14T18:24:34.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.463+0000 7f5dfde3e700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5de40a11e0 0x7f5de40a3690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006fd0 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:34.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.466+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5df4097de0 con 0x7f5df81014a0 2023-12-14T18:24:34.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.657+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5df8061700 con 0x7f5df81014a0 2023-12-14T18:24:34.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.657+0000 7f5deeffd700 1 -- 172.21.15.69:0/2987952651 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5df409b400 con 0x7f5df81014a0 2023-12-14T18:24:34.659 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:34.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5de40a11e0 msgr2=0x7f5de40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5de40a11e0 0x7f5de40a3690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006fd0 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2023-12-14T18:24:34.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 msgr2=0x7f5df81964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81964b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000c00 tx=0x7f5df4003b00 comp rx=0 tx=0).stop 2023-12-14T18:24:34.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 shutdown_connections 2023-12-14T18:24:34.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5de40a11e0 0x7f5de40a3690 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5df8101e30 0x7f5df819d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df80fe4d0 0x7f5df8195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 --2- 172.21.15.69:0/2987952651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5df81014a0 0x7f5df81964b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.659+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 >> 172.21.15.69:0/2987952651 conn(0x7f5df80f9ed0 msgr2=0x7f5df80fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:34.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.660+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 shutdown_connections 2023-12-14T18:24:34.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.660+0000 7f5e000a2700 1 -- 172.21.15.69:0/2987952651 wait complete. 2023-12-14T18:24:34.672 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:34 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1876868048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:34.672 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:34 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2860772732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:34.673 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 -- 172.21.15.69:0/1468134358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 msgr2=0x7f1878105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 --2- 172.21.15.69:0/1468134358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f1878105aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f186c009990 tx=0x7f186c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 -- 172.21.15.69:0/1468134358 shutdown_connections 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 --2- 172.21.15.69:0/1468134358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878105fe0 0x7f18781083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 --2- 172.21.15.69:0/1468134358 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1878100da0 0x7f1878103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 --2- 172.21.15.69:0/1468134358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f1878105aa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 -- 172.21.15.69:0/1468134358 >> 172.21.15.69:0/1468134358 conn(0x7f18780fa780 msgr2=0x7f18780fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 -- 172.21.15.69:0/1468134358 shutdown_connections 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.797+0000 7f187de98700 1 -- 172.21.15.69:0/1468134358 wait complete. 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.798+0000 7f187de98700 1 Processor -- start 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.798+0000 7f187de98700 1 -- start start 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1878100da0 0x7f1878195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f18781963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878105fe0 0x7f187819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187819da30 con 0x7f18781036c0 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187819db70 con 0x7f1878100da0 2023-12-14T18:24:34.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187819dd00 con 0x7f1878105fe0 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f18781963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f18781963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49116/0 (socket says 172.21.15.69:49116) 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 -- 172.21.15.69:0/2297893573 learned_addr learned my addr 172.21.15.69:0/2297893573 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f18777fe700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1878100da0 0x7f1878195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1877fff700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878105fe0 0x7f187819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 -- 172.21.15.69:0/2297893573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878105fe0 msgr2=0x7f187819d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878105fe0 0x7f187819d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 -- 172.21.15.69:0/2297893573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1878100da0 msgr2=0x7f1878195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1878100da0 0x7f1878195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 -- 172.21.15.69:0/2297893573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0095f0 con 0x7f18781036c0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1876ffd700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f18781963f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f186c006010 tx=0x7f186c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c01d070 con 0x7f18781036c0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187810baf0 con 0x7f18781036c0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f186c004000 con 0x7f18781036c0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c022b90 con 0x7f18781036c0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.799+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187810b960 con 0x7f18781036c0 2023-12-14T18:24:34.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.800+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18780fc2f0 con 0x7f18781036c0 2023-12-14T18:24:34.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.801+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f186c003b70 con 0x7f18781036c0 2023-12-14T18:24:34.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.802+0000 7f1874ff9700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f18600a11e0 0x7f18600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:34.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.802+0000 7f18777fe700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f18600a11e0 0x7f18600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:34.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.802+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f186c0cdcc0 con 0x7f18781036c0 2023-12-14T18:24:34.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.802+0000 7f18777fe700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f18600a11e0 0x7f18600a3690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1868005950 tx=0x7f186800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:34.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.806+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f186c05c730 con 0x7f18781036c0 2023-12-14T18:24:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:34 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1876868048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:34 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2860772732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:34.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:34 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1876868048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:34 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2860772732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:34.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.992+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1878061700 con 0x7f18781036c0 2023-12-14T18:24:34.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.992+0000 7f1874ff9700 1 -- 172.21.15.69:0/2297893573 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f186c097350 con 0x7f18781036c0 2023-12-14T18:24:34.993 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f18600a11e0 msgr2=0x7f18600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f18600a11e0 0x7f18600a3690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1868005950 tx=0x7f186800b410 comp rx=0 tx=0).stop 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 msgr2=0x7f18781963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f18781963f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f186c006010 tx=0x7f186c004730 comp rx=0 tx=0).stop 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 shutdown_connections 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f18600a11e0 0x7f18600a3690 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878105fe0 0x7f187819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1878100da0 0x7f1878195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 --2- 172.21.15.69:0/2297893573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18781036c0 0x7f18781963f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:34.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 >> 172.21.15.69:0/2297893573 conn(0x7f18780fa780 msgr2=0x7f1878101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:34.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 shutdown_connections 2023-12-14T18:24:34.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:34.994+0000 7f187de98700 1 -- 172.21.15.69:0/2297893573 wait complete. 2023-12-14T18:24:35.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 -- 172.21.15.69:0/2402977586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc100ce0 msgr2=0x7febdc1075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 --2- 172.21.15.69:0/2402977586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc100ce0 0x7febdc1075a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7febd400b0a0 tx=0x7febd400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 -- 172.21.15.69:0/2402977586 shutdown_connections 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 --2- 172.21.15.69:0/2402977586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc100ce0 0x7febdc1075a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 --2- 172.21.15.69:0/2402977586 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febdc0ff160 0x7febdc0ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 --2- 172.21.15.69:0/2402977586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febdc100350 0x7febdc1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 -- 172.21.15.69:0/2402977586 >> 172.21.15.69:0/2402977586 conn(0x7febdc0fa780 msgr2=0x7febdc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:35.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 -- 172.21.15.69:0/2402977586 shutdown_connections 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.128+0000 7febe1aed700 1 -- 172.21.15.69:0/2402977586 wait complete. 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 Processor -- start 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 -- start start 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 0x7febdc069b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febdc100350 0x7febdc19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febdc100ce0 0x7febdc19d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc19db40 con 0x7febdc0ff160 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc19dcb0 con 0x7febdc100ce0 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febe1aed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc19de70 con 0x7febdc100350 2023-12-14T18:24:35.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 0x7febdc069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 0x7febdc069b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49132/0 (socket says 172.21.15.69:49132) 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febdb7fe700 1 -- 172.21.15.69:0/3309100383 learned_addr learned my addr 172.21.15.69:0/3309100383 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.129+0000 7febdbfff700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febdc100ce0 0x7febdc19d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febdb7fe700 1 -- 172.21.15.69:0/3309100383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febdc100350 msgr2=0x7febdc19ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febdb7fe700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febdc100350 0x7febdc19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febdb7fe700 1 -- 172.21.15.69:0/3309100383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febdc100ce0 msgr2=0x7febdc19d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febdb7fe700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febdc100ce0 0x7febdc19d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febdb7fe700 1 -- 172.21.15.69:0/3309100383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009d00 con 0x7febdc0ff160 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febdb7fe700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 0x7febdc069b60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7febcc00c970 tx=0x7febcc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc004220 con 0x7febdc0ff160 2023-12-14T18:24:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febcc007d30 con 0x7febdc0ff160 2023-12-14T18:24:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc10a980 con 0x7febdc0ff160 2023-12-14T18:24:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc003bf0 con 0x7febdc0ff160 2023-12-14T18:24:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.130+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc10a7f0 con 0x7febdc0ff160 2023-12-14T18:24:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.131+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc19e610 con 0x7febdc0ff160 2023-12-14T18:24:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.133+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7febcc003d70 con 0x7febdc0ff160 2023-12-14T18:24:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.133+0000 7febd8ff9700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7febc40a1260 0x7febc40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.133+0000 7febdaffd700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7febc40a1260 0x7febc40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.133+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7febcc0cca70 con 0x7febdc0ff160 2023-12-14T18:24:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.133+0000 7febdaffd700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7febc40a1260 0x7febc40a3710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7febdc0698d0 tx=0x7febd0005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.136+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7febcc0960f0 con 0x7febdc0ff160 2023-12-14T18:24:35.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.369+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febdc106040 con 0x7febdc0ff160 2023-12-14T18:24:35.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.370+0000 7febd8ff9700 1 -- 172.21.15.69:0/3309100383 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7febcc01d020 con 0x7febdc0ff160 2023-12-14T18:24:35.372 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:35.372 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7febc40a1260 msgr2=0x7febc40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7febc40a1260 0x7febc40a3710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7febdc0698d0 tx=0x7febd0005c80 comp rx=0 tx=0).stop 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 msgr2=0x7febdc069b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 0x7febdc069b60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7febcc00c970 tx=0x7febcc00cd30 comp rx=0 tx=0).stop 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 shutdown_connections 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7febc40a1260 0x7febc40a3710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febdc100ce0 0x7febdc19d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febdc0ff160 0x7febdc069b60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 --2- 172.21.15.69:0/3309100383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febdc100350 0x7febdc19ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 >> 172.21.15.69:0/3309100383 conn(0x7febdc0fa780 msgr2=0x7febdc0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:35.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 shutdown_connections 2023-12-14T18:24:35.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.372+0000 7febe1aed700 1 -- 172.21.15.69:0/3309100383 wait complete. 2023-12-14T18:24:35.375 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:35.386 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 -- 172.21.15.69:0/2119855789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 msgr2=0x7f1050105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 --2- 172.21.15.69:0/2119855789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050105a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1038009990 tx=0x7f1038009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 -- 172.21.15.69:0/2119855789 shutdown_connections 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 --2- 172.21.15.69:0/2119855789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1050105f40 0x7f1050108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 --2- 172.21.15.69:0/2119855789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1050100d00 0x7f10501030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 --2- 172.21.15.69:0/2119855789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050105a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 -- 172.21.15.69:0/2119855789 >> 172.21.15.69:0/2119855789 conn(0x7f10500fa700 msgr2=0x7f10500fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 -- 172.21.15.69:0/2119855789 shutdown_connections 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 -- 172.21.15.69:0/2119855789 wait complete. 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 Processor -- start 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.507+0000 7f10566f2700 1 -- start start 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f10566f2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1050100d00 0x7f1050195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f10566f2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f10566f2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1050105f40 0x7f105019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f10566f2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105019da60 con 0x7f1050103620 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f10566f2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105019dba0 con 0x7f1050100d00 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f10566f2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105019dd30 con 0x7f1050105f40 2023-12-14T18:24:35.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40682/0 (socket says 172.21.15.69:40682) 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 -- 172.21.15.69:0/1880931251 learned_addr learned my addr 172.21.15.69:0/1880931251 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f1054c8f700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1050105f40 0x7f105019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104ffff700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1050100d00 0x7f1050195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 -- 172.21.15.69:0/1880931251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1050105f40 msgr2=0x7f105019d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1050105f40 0x7f105019d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 -- 172.21.15.69:0/1880931251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1050100d00 msgr2=0x7f1050195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1050100d00 0x7f1050195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 -- 172.21.15.69:0/1880931251 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380095f0 con 0x7f1050103620 2023-12-14T18:24:35.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104f7fe700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050196420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1038005910 tx=0x7f1038004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:35.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.508+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103801d070 con 0x7f1050103620 2023-12-14T18:24:35.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.509+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105010bae0 con 0x7f1050103620 2023-12-14T18:24:35.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.509+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10380054c0 con 0x7f1050103620 2023-12-14T18:24:35.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.509+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038003ab0 con 0x7f1050103620 2023-12-14T18:24:35.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.509+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105010b950 con 0x7f1050103620 2023-12-14T18:24:35.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.509+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10500fc270 con 0x7f1050103620 2023-12-14T18:24:35.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.511+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f10380047a0 con 0x7f1050103620 2023-12-14T18:24:35.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.512+0000 7f104d7fa700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f103c0a11e0 0x7f103c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.512+0000 7f104ffff700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f103c0a11e0 0x7f103c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.512+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f10380cde30 con 0x7f1050103620 2023-12-14T18:24:35.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.512+0000 7f104ffff700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f103c0a11e0 0x7f103c0a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1040005950 tx=0x7f10400058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:35.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.515+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f10380974c0 con 0x7f1050103620 2023-12-14T18:24:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:35 smithi069 ceph-mon[42047]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:35.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2987952651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2297893573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3309100383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:35.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.708+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f105002cfe0 con 0x7f1050103620 2023-12-14T18:24:35.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.709+0000 7f104d7fa700 1 -- 172.21.15.69:0/1880931251 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f103809aae0 con 0x7f1050103620 2023-12-14T18:24:35.711 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:35.711 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:35.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f103c0a11e0 msgr2=0x7f103c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f103c0a11e0 0x7f103c0a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1040005950 tx=0x7f10400058e0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 msgr2=0x7f1050196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050196420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1038005910 tx=0x7f1038004730 comp rx=0 tx=0).stop 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 shutdown_connections 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f103c0a11e0 0x7f103c0a3690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1050105f40 0x7f105019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1050100d00 0x7f1050195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 --2- 172.21.15.69:0/1880931251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1050103620 0x7f1050196420 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 >> 172.21.15.69:0/1880931251 conn(0x7f10500fa700 msgr2=0x7f1050101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.711+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 shutdown_connections 2023-12-14T18:24:35.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.712+0000 7f10566f2700 1 -- 172.21.15.69:0/1880931251 wait complete. 2023-12-14T18:24:35.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:35.725 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 -- 172.21.15.69:0/1320100355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c0ffd60 msgr2=0x7fa50c107610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 --2- 172.21.15.69:0/1320100355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c0ffd60 0x7fa50c107610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b0a0 tx=0x7fa50400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 -- 172.21.15.69:0/1320100355 shutdown_connections 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 --2- 172.21.15.69:0/1320100355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c0ffd60 0x7fa50c107610 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 --2- 172.21.15.69:0/1320100355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa50c100710 0x7fa50c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 --2- 172.21.15.69:0/1320100355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa50c0ff3b0 0x7fa50c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 -- 172.21.15.69:0/1320100355 >> 172.21.15.69:0/1320100355 conn(0x7fa50c0f9ed0 msgr2=0x7fa50c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 -- 172.21.15.69:0/1320100355 shutdown_connections 2023-12-14T18:24:35.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.850+0000 7fa51091b700 1 -- 172.21.15.69:0/1320100355 wait complete. 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 Processor -- start 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 -- start start 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa50c0ff3b0 0x7fa50c103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa50c0ffd60 0x7fa50c101b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 0x7fa50c102090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c102830 con 0x7fa50c100710 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1029a0 con 0x7fa50c0ff3b0 2023-12-14T18:24:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa51091b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1a00e0 con 0x7fa50c0ffd60 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 0x7fa50c102090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 0x7fa50c102090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40706/0 (socket says 172.21.15.69:40706) 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 -- 172.21.15.69:0/626047609 learned_addr learned my addr 172.21.15.69:0/626047609 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50a59c700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa50c0ff3b0 0x7fa50c103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa509d9b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa50c0ffd60 0x7fa50c101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 -- 172.21.15.69:0/626047609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa50c0ffd60 msgr2=0x7fa50c101b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa50c0ffd60 0x7fa50c101b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 -- 172.21.15.69:0/626047609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa50c0ff3b0 msgr2=0x7fa50c103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa50c0ff3b0 0x7fa50c103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 -- 172.21.15.69:0/626047609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009d00 con 0x7fa50c100710 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.851+0000 7fa50ad9d700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 0x7fa50c102090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b830 tx=0x7fa504004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.852+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400e040 con 0x7fa50c100710 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.852+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c10a9e0 con 0x7fa50c100710 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.852+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa504009440 con 0x7fa50c100710 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.852+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50401db60 con 0x7fa50c100710 2023-12-14T18:24:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.852+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c10a850 con 0x7fa50c100710 2023-12-14T18:24:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.853+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c10ab70 con 0x7fa50c100710 2023-12-14T18:24:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.854+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa504005450 con 0x7fa50c100710 2023-12-14T18:24:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.854+0000 7fa4fb7fe700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa4f40a11e0 0x7fa4f40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.854+0000 7fa50a59c700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa4f40a11e0 0x7fa4f40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.854+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa5040ce9c0 con 0x7fa50c100710 2023-12-14T18:24:35.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.855+0000 7fa50a59c700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa4f40a11e0 0x7fa4f40a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa50c067b70 tx=0x7fa50000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:35.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:35.858+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa504098050 con 0x7fa50c100710 2023-12-14T18:24:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:35 smithi119 ceph-mon[43973]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2987952651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2297893573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3309100383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:35 smithi091 ceph-mon[43601]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2023-12-14T18:24:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2987952651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2297893573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3309100383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.046+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa50c02cfe0 con 0x7fa50c100710 2023-12-14T18:24:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.047+0000 7fa4fb7fe700 1 -- 172.21.15.69:0/626047609 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa504005700 con 0x7fa50c100710 2023-12-14T18:24:36.048 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa4f40a11e0 msgr2=0x7fa4f40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa4f40a11e0 0x7fa4f40a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa50c067b70 tx=0x7fa50000b410 comp rx=0 tx=0).stop 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 msgr2=0x7fa50c102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 0x7fa50c102090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b830 tx=0x7fa504004ce0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 shutdown_connections 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa4f40a11e0 0x7fa4f40a3690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa50c100710 0x7fa50c102090 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa50c0ff3b0 0x7fa50c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 --2- 172.21.15.69:0/626047609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa50c0ffd60 0x7fa50c101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 >> 172.21.15.69:0/626047609 conn(0x7fa50c0f9ed0 msgr2=0x7fa50c0fc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 shutdown_connections 2023-12-14T18:24:36.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.049+0000 7fa51091b700 1 -- 172.21.15.69:0/626047609 wait complete. 2023-12-14T18:24:36.062 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.185+0000 7fd9e2305700 1 -- 172.21.15.69:0/716753498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100310 msgr2=0x7fd9dc100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 --2- 172.21.15.69:0/716753498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100310 0x7fd9dc100760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009990 tx=0x7fd9d0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 -- 172.21.15.69:0/716753498 shutdown_connections 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 --2- 172.21.15.69:0/716753498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 --2- 172.21.15.69:0/716753498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9dc0ff120 0x7fd9dc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 --2- 172.21.15.69:0/716753498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100310 0x7fd9dc100760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 -- 172.21.15.69:0/716753498 >> 172.21.15.69:0/716753498 conn(0x7fd9dc0fa740 msgr2=0x7fd9dc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 -- 172.21.15.69:0/716753498 shutdown_connections 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 -- 172.21.15.69:0/716753498 wait complete. 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 Processor -- start 2023-12-14T18:24:36.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 -- start start 2023-12-14T18:24:36.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9dc0ff120 0x7fd9dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.186+0000 7fd9e2305700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc100310 0x7fd9dc19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e2305700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc19d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e2305700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19da70 con 0x7fd9dc100ca0 2023-12-14T18:24:36.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e2305700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19dbe0 con 0x7fd9dc0ff120 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e2305700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19dda0 con 0x7fd9dc100310 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc19d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc19d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40732/0 (socket says 172.21.15.69:40732) 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 -- 172.21.15.69:0/980599598 learned_addr learned my addr 172.21.15.69:0/980599598 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9db7fe700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc100310 0x7fd9dc19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9dbfff700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9dc0ff120 0x7fd9dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 -- 172.21.15.69:0/980599598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc100310 msgr2=0x7fd9dc19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc100310 0x7fd9dc19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 -- 172.21.15.69:0/980599598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9dc0ff120 msgr2=0x7fd9dc068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9dc0ff120 0x7fd9dc068960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 -- 172.21.15.69:0/980599598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00095f0 con 0x7fd9dc100ca0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e08a2700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc19d2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400ada0 tx=0x7fd9d400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400f070 con 0x7fd9dc100ca0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9d4007b30 con 0x7fd9dc100ca0 2023-12-14T18:24:36.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc10a930 con 0x7fd9dc100ca0 2023-12-14T18:24:36.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4005280 con 0x7fd9dc100ca0 2023-12-14T18:24:36.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.187+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc10a7a0 con 0x7fd9dc100ca0 2023-12-14T18:24:36.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.188+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc19e410 con 0x7fd9dc100ca0 2023-12-14T18:24:36.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.189+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd9d400a090 con 0x7fd9dc100ca0 2023-12-14T18:24:36.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.190+0000 7fd9d97fa700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9c40a11e0 0x7fd9c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.190+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd9d40cc5d0 con 0x7fd9dc100ca0 2023-12-14T18:24:36.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.190+0000 7fd9dbfff700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9c40a11e0 0x7fd9c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.190+0000 7fd9dbfff700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9c40a11e0 0x7fd9c40a3690 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc100170 tx=0x7fd9cc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:36.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.193+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd9d4095c60 con 0x7fd9dc100ca0 2023-12-14T18:24:36.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.385+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9dc106130 con 0x7fd9dc100ca0 2023-12-14T18:24:36.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.386+0000 7fd9d97fa700 1 -- 172.21.15.69:0/980599598 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9d4084020 con 0x7fd9dc100ca0 2023-12-14T18:24:36.387 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9c40a11e0 msgr2=0x7fd9c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9c40a11e0 0x7fd9c40a3690 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc100170 tx=0x7fd9cc00b410 comp rx=0 tx=0).stop 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 msgr2=0x7fd9dc19d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc19d2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400ada0 tx=0x7fd9d400c330 comp rx=0 tx=0).stop 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 shutdown_connections 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd9c40a11e0 0x7fd9c40a3690 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9dc100ca0 0x7fd9dc19d2a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9dc0ff120 0x7fd9dc068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 --2- 172.21.15.69:0/980599598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc100310 0x7fd9dc19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 >> 172.21.15.69:0/980599598 conn(0x7fd9dc0fa740 msgr2=0x7fd9dc0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:36.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 shutdown_connections 2023-12-14T18:24:36.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.388+0000 7fd9e2305700 1 -- 172.21.15.69:0/980599598 wait complete. 2023-12-14T18:24:36.401 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 -- 172.21.15.69:0/1631397686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e10101e30 msgr2=0x7f6e101086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 --2- 172.21.15.69:0/1631397686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e10101e30 0x7f6e101086f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800b0a0 tx=0x7f6e0800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 -- 172.21.15.69:0/1631397686 shutdown_connections 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 --2- 172.21.15.69:0/1631397686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e10101e30 0x7f6e101086f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 --2- 172.21.15.69:0/1631397686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fe4d0 0x7f6e100fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 --2- 172.21.15.69:0/1631397686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e101014a0 0x7f6e101018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 -- 172.21.15.69:0/1631397686 >> 172.21.15.69:0/1631397686 conn(0x7f6e100f9ed0 msgr2=0x7f6e100fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 -- 172.21.15.69:0/1631397686 shutdown_connections 2023-12-14T18:24:36.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.525+0000 7f6e148d0700 1 -- 172.21.15.69:0/1631397686 wait complete. 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 Processor -- start 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 -- start start 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 0x7f6e10195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e101014a0 0x7f6e10196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e10101e30 0x7f6e1019d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019da40 con 0x7f6e100fe4d0 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019db80 con 0x7f6e10101e30 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e148d0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019dd10 con 0x7f6e101014a0 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 0x7f6e10195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 0x7f6e10195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40738/0 (socket says 172.21.15.69:40738) 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 -- 172.21.15.69:0/864697883 learned_addr learned my addr 172.21.15.69:0/864697883 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:36.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0dd9b700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e101014a0 0x7f6e10196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0ed9d700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e10101e30 0x7f6e1019d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 -- 172.21.15.69:0/864697883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e101014a0 msgr2=0x7f6e10196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e101014a0 0x7f6e10196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 -- 172.21.15.69:0/864697883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e10101e30 msgr2=0x7f6e1019d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e10101e30 0x7f6e1019d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 -- 172.21.15.69:0/864697883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08009d00 con 0x7f6e100fe4d0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0ed9d700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e10101e30 0x7f6e1019d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e0e59c700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 0x7f6e10195ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c970 tx=0x7f6df800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.526+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8004220 con 0x7f6e100fe4d0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.527+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1010ba30 con 0x7f6e100fe4d0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.527+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6df8007d30 con 0x7f6e100fe4d0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.527+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8003b80 con 0x7f6e100fe4d0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.527+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1010b8a0 con 0x7f6e100fe4d0 2023-12-14T18:24:36.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.528+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10107230 con 0x7f6e100fe4d0 2023-12-14T18:24:36.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.529+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6df80078a0 con 0x7f6e100fe4d0 2023-12-14T18:24:36.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.529+0000 7f6e077fe700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6dfc0a11e0 0x7f6dfc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.529+0000 7f6e0dd9b700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6dfc0a11e0 0x7f6dfc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.529+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6df80cc640 con 0x7f6e100fe4d0 2023-12-14T18:24:36.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.530+0000 7f6e0dd9b700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6dfc0a11e0 0x7f6dfc0a3690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000ac50 tx=0x7f6e0000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:36.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.533+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6df8095c40 con 0x7f6e100fe4d0 2023-12-14T18:24:36.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1880931251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:36.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/626047609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:36.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/980599598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:36.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.731+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e1002cfe0 con 0x7f6e100fe4d0 2023-12-14T18:24:36.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.731+0000 7f6e077fe700 1 -- 172.21.15.69:0/864697883 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6df8099260 con 0x7f6e100fe4d0 2023-12-14T18:24:36.732 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:36.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6dfc0a11e0 msgr2=0x7f6dfc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6dfc0a11e0 0x7f6dfc0a3690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000ac50 tx=0x7f6e0000a380 comp rx=0 tx=0).stop 2023-12-14T18:24:36.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 msgr2=0x7f6e10195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 0x7f6e10195ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c970 tx=0x7f6df800cc80 comp rx=0 tx=0).stop 2023-12-14T18:24:36.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 shutdown_connections 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6dfc0a11e0 0x7f6dfc0a3690 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e10101e30 0x7f6e1019d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e100fe4d0 0x7f6e10195ec0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 --2- 172.21.15.69:0/864697883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e101014a0 0x7f6e10196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 >> 172.21.15.69:0/864697883 conn(0x7f6e100f9ed0 msgr2=0x7f6e100fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 shutdown_connections 2023-12-14T18:24:36.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.733+0000 7f6e148d0700 1 -- 172.21.15.69:0/864697883 wait complete. 2023-12-14T18:24:36.746 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:36.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.867+0000 7fea7174e700 1 -- 172.21.15.69:0/3106609343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 msgr2=0x7fea6c108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.867+0000 7fea7174e700 1 --2- 172.21.15.69:0/3106609343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c108380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b0a0 tx=0x7fea6400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.867+0000 7fea7174e700 1 -- 172.21.15.69:0/3106609343 shutdown_connections 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.867+0000 7fea7174e700 1 --2- 172.21.15.69:0/3106609343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c108380 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.867+0000 7fea7174e700 1 --2- 172.21.15.69:0/3106609343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 0x7fea6c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.867+0000 7fea7174e700 1 --2- 172.21.15.69:0/3106609343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c103660 0x7fea6c105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- 172.21.15.69:0/3106609343 >> 172.21.15.69:0/3106609343 conn(0x7fea6c0fa780 msgr2=0x7fea6c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- 172.21.15.69:0/3106609343 shutdown_connections 2023-12-14T18:24:36.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- 172.21.15.69:0/3106609343 wait complete. 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 Processor -- start 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- start start 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 0x7fea6c1006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c103660 0x7fea6c0fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c0ff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0ff9d0 con 0x7fea6c105f80 2023-12-14T18:24:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0ffb40 con 0x7fea6c103660 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.868+0000 7fea7174e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1a0070 con 0x7fea6c100d40 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c0ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c0ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40754/0 (socket says 172.21.15.69:40754) 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 -- 172.21.15.69:0/3139471506 learned_addr learned my addr 172.21.15.69:0/3139471506 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6a7fc700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c103660 0x7fea6c0fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6affd700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 0x7fea6c1006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 -- 172.21.15.69:0/3139471506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 msgr2=0x7fea6c1006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 0x7fea6c1006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 -- 172.21.15.69:0/3139471506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c103660 msgr2=0x7fea6c0fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c103660 0x7fea6c0fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 -- 172.21.15.69:0/3139471506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009d00 con 0x7fea6c105f80 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6affd700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 0x7fea6c1006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea6b7fe700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c0ff230 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b070 tx=0x7fea64008e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400e040 con 0x7fea6c105f80 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c10ba80 con 0x7fea6c105f80 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea6401d470 con 0x7fea6c105f80 2023-12-14T18:24:36.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6401b680 con 0x7fea6c105f80 2023-12-14T18:24:36.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.869+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c10b8f0 con 0x7fea6c105f80 2023-12-14T18:24:36.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.870+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c1a06c0 con 0x7fea6c105f80 2023-12-14T18:24:36.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.871+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fea6401d5e0 con 0x7fea6c105f80 2023-12-14T18:24:36.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.872+0000 7fea53fff700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fea540a11e0 0x7fea540a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:36.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.872+0000 7fea6affd700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fea540a11e0 0x7fea540a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:36.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.872+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fea640ce3d0 con 0x7fea6c105f80 2023-12-14T18:24:36.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.872+0000 7fea6affd700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fea540a11e0 0x7fea540a3690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea60009be0 tx=0x7fea60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:36 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1880931251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:36 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/626047609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:36 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/980599598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:36.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:36.875+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fea64097a90 con 0x7fea6c105f80 2023-12-14T18:24:36.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:36 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1880931251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:36.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:36 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/626047609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:36.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:36 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/980599598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:37.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.106+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea6c1a0c70 con 0x7fea6c105f80 2023-12-14T18:24:37.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.107+0000 7fea53fff700 1 -- 172.21.15.69:0/3139471506 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7fea6409b0b0 con 0x7fea6c105f80 2023-12-14T18:24:37.108 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:37.108 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fea540a11e0 msgr2=0x7fea540a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fea540a11e0 0x7fea540a3690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea60009be0 tx=0x7fea60009260 comp rx=0 tx=0).stop 2023-12-14T18:24:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 msgr2=0x7fea6c0ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c0ff230 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b070 tx=0x7fea64008e30 comp rx=0 tx=0).stop 2023-12-14T18:24:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 shutdown_connections 2023-12-14T18:24:37.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fea540a11e0 0x7fea540a3690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c105f80 0x7fea6c0ff230 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c100d40 0x7fea6c1006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 --2- 172.21.15.69:0/3139471506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c103660 0x7fea6c0fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 >> 172.21.15.69:0/3139471506 conn(0x7fea6c0fa780 msgr2=0x7fea6c102180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 shutdown_connections 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.109+0000 7fea7174e700 1 -- 172.21.15.69:0/3139471506 wait complete. 2023-12-14T18:24:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:37.122 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/1419346566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100c90 msgr2=0x7f6bd0107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/1419346566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100c90 0x7f6bd0107550 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800b0a0 tx=0x7f6bc800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/1419346566 shutdown_connections 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/1419346566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100c90 0x7f6bd0107550 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/1419346566 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00ff110 0x7f6bd00ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/1419346566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bd0100300 0x7f6bd0100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/1419346566 >> 172.21.15.69:0/1419346566 conn(0x7f6bd00fa6f0 msgr2=0x7f6bd00fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/1419346566 shutdown_connections 2023-12-14T18:24:37.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.243+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/1419346566 wait complete. 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 Processor -- start 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 -- start start 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bd00ff110 0x7f6bd0194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 0x7f6bd0195400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd0100c90 0x7f6bd019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd019ca40 con 0x7f6bd0100300 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd019cb80 con 0x7f6bd0100c90 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bd4e8c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd019cd10 con 0x7f6bd00ff110 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bcdd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 0x7f6bd0195400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bcdd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 0x7f6bd0195400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40762/0 (socket says 172.21.15.69:40762) 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bcdd9b700 1 -- 172.21.15.69:0/3860388236 learned_addr learned my addr 172.21.15.69:0/3860388236 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.244+0000 7f6bce59c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bd00ff110 0x7f6bd0194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bcdd9b700 1 -- 172.21.15.69:0/3860388236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bd00ff110 msgr2=0x7f6bd0194ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bcdd9b700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bd00ff110 0x7f6bd0194ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bced9d700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd0100c90 0x7f6bd019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bcdd9b700 1 -- 172.21.15.69:0/3860388236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd0100c90 msgr2=0x7f6bd019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bcdd9b700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd0100c90 0x7f6bd019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bcdd9b700 1 -- 172.21.15.69:0/3860388236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8009d00 con 0x7f6bd0100300 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bced9d700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd0100c90 0x7f6bd019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bcdd9b700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 0x7f6bd0195400 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c920 tx=0x7f6bc000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0007b00 con 0x7f6bd0100300 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6bc0004cc0 con 0x7f6bd0100300 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd010a940 con 0x7f6bd0100300 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0005590 con 0x7f6bd0100300 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.245+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd010a7b0 con 0x7f6bd0100300 2023-12-14T18:24:37.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.246+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd019d3f0 con 0x7f6bd0100300 2023-12-14T18:24:37.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.247+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6bc0004750 con 0x7f6bd0100300 2023-12-14T18:24:37.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.247+0000 7f6bc77fe700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6bbc0a1260 0x7f6bbc0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.247+0000 7f6bce59c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6bbc0a1260 0x7f6bbc0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.248+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6bc00cc990 con 0x7f6bd0100300 2023-12-14T18:24:37.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.248+0000 7f6bce59c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6bbc0a1260 0x7f6bbc0a3710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8005950 tx=0x7f6bb80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.251+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6bc0096010 con 0x7f6bd0100300 2023-12-14T18:24:37.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.444+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bd0106010 con 0x7f6bd0100300 2023-12-14T18:24:37.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.446+0000 7f6bc77fe700 1 -- 172.21.15.69:0/3860388236 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f6bc001d070 con 0x7f6bd0100300 2023-12-14T18:24:37.447 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:37.447 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:37.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6bbc0a1260 msgr2=0x7f6bbc0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6bbc0a1260 0x7f6bbc0a3710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8005950 tx=0x7f6bb80058e0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 msgr2=0x7f6bd0195400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 0x7f6bd0195400 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c920 tx=0x7f6bc000cce0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 shutdown_connections 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6bbc0a1260 0x7f6bbc0a3710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd0100c90 0x7f6bd019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bd00ff110 0x7f6bd0194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 --2- 172.21.15.69:0/3860388236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bd0100300 0x7f6bd0195400 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.448+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 >> 172.21.15.69:0/3860388236 conn(0x7f6bd00fa6f0 msgr2=0x7f6bd00fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.449+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 shutdown_connections 2023-12-14T18:24:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.449+0000 7f6bd4e8c700 1 -- 172.21.15.69:0/3860388236 wait complete. 2023-12-14T18:24:37.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-14T18:23:29.291233+0000', 'modified': '2023-12-14T18:23:34.332024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24482, 'mds_2': 24458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/1476188818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 1476188818}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 1476188818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/3442609233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3442609233}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3442609233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6839/771447970', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 771447970}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 771447970}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.91:6835/426473742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6834', 'nonce': 426473742}, {'type': 'v1', 'addr': '172.21.15.91:6835', 'nonce': 426473742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.91:6837/3727199285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6836', 'nonce': 3727199285}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 3727199285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.91:6839/311589557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6838', 'nonce': 311589557}, {'type': 'v1', 'addr': '172.21.15.91:6839', 'nonce': 311589557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-14T18:24:37.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-14T18:24:37.462 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-12-14T18:24:37.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 -- 172.21.15.69:0/3760204944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6380ff160 msgr2=0x7fe6380ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 --2- 172.21.15.69:0/3760204944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6380ff160 0x7fe6380ff570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe634009990 tx=0x7fe634009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 -- 172.21.15.69:0/3760204944 shutdown_connections 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 --2- 172.21.15.69:0/3760204944 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe638100ce0 0x7fe6381075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 --2- 172.21.15.69:0/3760204944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6380ff160 0x7fe6380ff570 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 --2- 172.21.15.69:0/3760204944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe638100350 0x7fe6381007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 -- 172.21.15.69:0/3760204944 >> 172.21.15.69:0/3760204944 conn(0x7fe6380fa780 msgr2=0x7fe6380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 -- 172.21.15.69:0/3760204944 shutdown_connections 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 -- 172.21.15.69:0/3760204944 wait complete. 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 Processor -- start 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 -- start start 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.584+0000 7fe6404cd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6380ff160 0x7fe638195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe638100350 0x7fe6381963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 0x7fe63819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63819d9e0 con 0x7fe638100ce0 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63819db20 con 0x7fe6380ff160 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63819dcb0 con 0x7fe638100350 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 0x7fe63819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 0x7fe63819d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40772/0 (socket says 172.21.15.69:40772) 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 -- 172.21.15.69:0/2497980916 learned_addr learned my addr 172.21.15.69:0/2497980916 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63da68700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe638100350 0x7fe6381963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63e269700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6380ff160 0x7fe638195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 -- 172.21.15.69:0/2497980916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe638100350 msgr2=0x7fe6381963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe638100350 0x7fe6381963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 -- 172.21.15.69:0/2497980916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6380ff160 msgr2=0x7fe638195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6380ff160 0x7fe638195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 -- 172.21.15.69:0/2497980916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340095f0 con 0x7fe638100ce0 2023-12-14T18:24:37.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63e269700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6380ff160 0x7fe638195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 0x7fe63819d410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe63000ada0 tx=0x7fe63000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe62f7fe700 1 -- 172.21.15.69:0/2497980916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000f070 con 0x7fe638100ce0 2023-12-14T18:24:37.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe62f7fe700 1 -- 172.21.15.69:0/2497980916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe630007b30 con 0x7fe638100ce0 2023-12-14T18:24:37.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe62f7fe700 1 -- 172.21.15.69:0/2497980916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630005280 con 0x7fe638100ce0 2023-12-14T18:24:37.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63810a980 con 0x7fe638100ce0 2023-12-14T18:24:37.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.585+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63810a7f0 con 0x7fe638100ce0 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.587+0000 7fe62f7fe700 1 -- 172.21.15.69:0/2497980916 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe63000c980 con 0x7fe638100ce0 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.588+0000 7fe62f7fe700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6240a11e0 0x7fe6240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.588+0000 7fe63e269700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6240a11e0 0x7fe6240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.588+0000 7fe62f7fe700 1 -- 172.21.15.69:0/2497980916 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe6300cc130 con 0x7fe638100ce0 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.588+0000 7fe63e269700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6240a11e0 0x7fe6240a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe634006010 tx=0x7fe63400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 Processor -- start 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 -- start start 2023-12-14T18:24:37.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee84b0 0x55c383ee88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ee9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383eea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383dd1590 con 0x55c383ee9cb0 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383e40820 con 0x55c383ee8e00 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383e39cb0 con 0x55c383ee84b0 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe63ea6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383eea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe63ea6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383eea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40788/0 (socket says 172.21.15.69:40788) 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe63ea6a700 1 -- 172.21.15.69:0/3582618753 learned_addr learned my addr 172.21.15.69:0/3582618753 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe63e269700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee84b0 0x55c383ee88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.589+0000 7fe63da68700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ee9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63ea6a700 1 -- 172.21.15.69:0/3582618753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee84b0 msgr2=0x55c383ee88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee84b0 0x55c383ee88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63ea6a700 1 -- 172.21.15.69:0/3582618753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 msgr2=0x55c383ee9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ee9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63ea6a700 1 -- 172.21.15.69:0/3582618753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c383cbb360 con 0x55c383ee9cb0 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63da68700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ee9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63e269700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee84b0 0x55c383ee88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383eea120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe6300a12b0 tx=0x7fe630098fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b183f871dc0c0d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe62cff9700 1 -- 172.21.15.69:0/3582618753 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000a160 con 0x55c383ee9cb0 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe62cff9700 1 -- 172.21.15.69:0/3582618753 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6300192b0 con 0x55c383ee9cb0 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.590+0000 7fe62cff9700 1 -- 172.21.15.69:0/3582618753 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630097890 con 0x55c383ee9cb0 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3582618753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 msgr2=0x55c383eea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383eea120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe6300a12b0 tx=0x7fe630098fe0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3582618753 shutdown_connections 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383eea120 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee84b0 0x55c383ee88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3582618753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ee9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3582618753 >> 172.21.15.69:0/3582618753 conn(0x55c383eddc50 msgr2=0x55c383ee33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3582618753 shutdown_connections 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3582618753 wait complete. 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- start start 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 Processor -- start 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 0x55c383ef2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ef26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383ef96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383dd5f40 con 0x55c383ee84b0 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383dd5be0 con 0x55c383ee8e00 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383cbd650 con 0x55c383ee9cb0 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe64c65bb80 10 client.0 _ll_register_callbacks cb 0x55c383df98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe63e269700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 0x55c383ef2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe63e269700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 0x55c383ef2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40796/0 (socket says 172.21.15.69:40796) 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.591+0000 7fe63e269700 1 -- 172.21.15.69:0/3926573630 learned_addr learned my addr 172.21.15.69:0/3926573630 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63da68700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ef26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383ef96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63e269700 1 -- 172.21.15.69:0/3926573630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 msgr2=0x55c383ef96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63e269700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383ef96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63e269700 1 -- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 msgr2=0x55c383ef26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63e269700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ef26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63e269700 1 -- 172.21.15.69:0/3926573630 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63810a7f0 con 0x55c383ee84b0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383ef96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63da68700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ef26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe63e269700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 0x55c383ef2170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe63400bed0 tx=0x7fe634009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ed3707a7bc07dd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe621ffb700 1 -- 172.21.15.69:0/3926573630 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634005900 con 0x55c383ee84b0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe621ffb700 1 -- 172.21.15.69:0/3926573630 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe634004ba0 con 0x55c383ee84b0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c383edb260 con 0x55c383ee84b0 2023-12-14T18:24:37.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe621ffb700 1 -- 172.21.15.69:0/3926573630 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe634004d60 con 0x55c383ee84b0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 10 client.15207 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c383e00120 con 0x55c383ee84b0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe621ffb700 1 -- 172.21.15.69:0/3926573630 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c383edb260 con 0x55c383ee84b0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe621ffb700 1 -- 172.21.15.69:0/3926573630 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe63400f4f0 con 0x55c383ee84b0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 10 client.15207 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 10 client.15207 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 20 client.15207 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.592+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383efd3f0 0x55c383efc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.593+0000 7fe64c65bb80 4 client.15207 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.593+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c383e32c90 con 0x55c383efd3f0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.593+0000 7fe63da68700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383efd3f0 0x55c383efc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.593+0000 7fe621ffb700 10 client.15207 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.593+0000 7fe63da68700 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383efd3f0 0x55c383efc7f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c03e6076fd67db6f server_cookie=da4e0c840afa9a92 in_seq=0 out_seq=0 2023-12-14T18:24:37.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe621ffb700 1 -- 172.21.15.69:0/3926573630 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c383e32c90 con 0x55c383efd3f0 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe621ffb700 10 client.15207 handle_command_reply: tid=0 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 client.15207 shutdown 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 msgr2=0x55c383ef2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 0x55c383ef2170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe63400bed0 tx=0x7fe634009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 shutdown_connections 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383efd3f0 0x55c383efc7f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383ef96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe621ffb700 0 client.15207 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee84b0 0x55c383ef2170 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3926573630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee8e00 0x55c383ef26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 >> 172.21.15.69:0/3926573630 conn(0x55c383eddc50 msgr2=0x55c383ee1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 shutdown_connections 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3926573630 wait complete. 2023-12-14T18:24:37.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.594+0000 7fe64c65bb80 20 client.15207 trim_cache size 0 max 16384 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 Processor -- start 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 -- start start 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383ef0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee8e00 0x55c383ef96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383ef0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383ef3360 con 0x55c383ee9cb0 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383e35da0 con 0x55c383ee84b0 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.611+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383e08a50 con 0x55c383ee8e00 2023-12-14T18:24:37.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383ef0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383ef0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40802/0 (socket says 172.21.15.69:40802) 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 -- 172.21.15.69:0/586463147 learned_addr learned my addr 172.21.15.69:0/586463147 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 -- 172.21.15.69:0/586463147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee8e00 msgr2=0x55c383ef96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee8e00 0x55c383ef96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 -- 172.21.15.69:0/586463147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 msgr2=0x55c383ef0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383ef0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 -- 172.21.15.69:0/586463147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c383ee3560 con 0x55c383ee9cb0 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe63ea6a700 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383ef0090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe6300958d0 tx=0x7fe630007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5eebf37e2e0080f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe62d7fa700 1 -- 172.21.15.69:0/586463147 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300af070 con 0x55c383ee9cb0 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe62d7fa700 1 -- 172.21.15.69:0/586463147 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63000a160 con 0x55c383ee9cb0 2023-12-14T18:24:37.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe62d7fa700 1 -- 172.21.15.69:0/586463147 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63009d160 con 0x55c383ee9cb0 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.612+0000 7fe64c65bb80 1 -- 172.21.15.69:0/586463147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 msgr2=0x55c383ef0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383ef0090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe6300958d0 tx=0x7fe630007a00 comp rx=0 tx=0).stop 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- 172.21.15.69:0/586463147 shutdown_connections 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee9cb0 0x55c383ef0090 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383ef0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/586463147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee8e00 0x55c383ef96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- 172.21.15.69:0/586463147 >> 172.21.15.69:0/586463147 conn(0x55c383eddc50 msgr2=0x55c383ee2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- 172.21.15.69:0/586463147 shutdown_connections 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- 172.21.15.69:0/586463147 wait complete. 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- start start 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 Processor -- start 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383eeeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 0x55c383eef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383f51270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383f517b0 con 0x55c383ee8e00 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383f518f0 con 0x55c383ee84b0 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383f51a30 con 0x55c383ee9cb0 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe64c65bb80 10 client.0 _ll_register_callbacks cb 0x7fe634005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 0x55c383eef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 0x55c383eef0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40806/0 (socket says 172.21.15.69:40806) 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 -- 172.21.15.69:0/3459201456 learned_addr learned my addr 172.21.15.69:0/3459201456 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63e269700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383eeeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 -- 172.21.15.69:0/3459201456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 msgr2=0x55c383f51270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383f51270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 -- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 msgr2=0x55c383eeeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383eeeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63da68700 1 -- 172.21.15.69:0/3459201456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c383cbb360 con 0x55c383ee8e00 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.613+0000 7fe63e269700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383eeeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe63da68700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 0x55c383eef0b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55c383efe3d0 tx=0x7fe628011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde17c14c5af6d08 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe621ffb700 1 -- 172.21.15.69:0/3459201456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628017040 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe621ffb700 1 -- 172.21.15.69:0/3459201456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe62801cb50 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6300192b0 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe621ffb700 1 -- 172.21.15.69:0/3459201456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe62801cd10 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 10 client.15213 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c383c67b10 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe621ffb700 1 -- 172.21.15.69:0/3459201456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6300192b0 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe621ffb700 1 -- 172.21.15.69:0/3459201456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe628005230 con 0x55c383ee8e00 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 10 client.15213 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 10 client.15213 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 20 client.15213 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383f568a0 0x55c383f531f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 4 client.15213 mds_command: new command op to 24458 tid=0[{"prefix": "status"}] 2023-12-14T18:24:37.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c383e329b0 con 0x55c383f568a0 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.614+0000 7fe63e269700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383f568a0 0x55c383f531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe63e269700 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383f568a0 0x55c383f531f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e79d265c5e239d server_cookie=777777e62ae55eeb in_seq=0 out_seq=0 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe621ffb700 10 client.15213 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe621ffb700 1 -- 172.21.15.69:0/3459201456 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c383e329b0 con 0x55c383f568a0 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe621ffb700 10 client.15213 handle_command_reply: tid=0 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 client.15213 shutdown 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 msgr2=0x55c383eef0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 0x55c383eef0b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55c383efe3d0 tx=0x7fe628011a00 comp rx=0 tx=0).stop 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 shutdown_connections 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55c383f568a0 0x55c383f531f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c383ee9cb0 0x55c383f51270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c383ee84b0 0x55c383eeeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 --2- 172.21.15.69:0/3459201456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c383ee8e00 0x55c383eef0b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe621ffb700 0 client.15213 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 >> 172.21.15.69:0/3459201456 conn(0x55c383eddc50 msgr2=0x55c383efc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 shutdown_connections 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 1 -- 172.21.15.69:0/3459201456 wait complete. 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.615+0000 7fe64c65bb80 20 client.15213 trim_cache size 0 max 16384 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24458, 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T18:24:37.622 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 64.291611463999999, 2023-12-14T18:24:37.623 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T18:24:37.623 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 81, 2023-12-14T18:24:37.623 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 79, 2023-12-14T18:24:37.623 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 86.335500207999999 2023-12-14T18:24:37.623 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:37.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6240a11e0 msgr2=0x7fe6240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6240a11e0 0x7fe6240a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe634006010 tx=0x7fe63400b540 comp rx=0 tx=0).stop 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 msgr2=0x7fe63819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 0x7fe63819d410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe63000ada0 tx=0x7fe63000c330 comp rx=0 tx=0).stop 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 shutdown_connections 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6240a11e0 0x7fe6240a3690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe638100ce0 0x7fe63819d410 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6380ff160 0x7fe638195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 --2- 172.21.15.69:0/2497980916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe638100350 0x7fe6381963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 >> 172.21.15.69:0/2497980916 conn(0x7fe6380fa780 msgr2=0x7fe638068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 shutdown_connections 2023-12-14T18:24:37.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.616+0000 7fe6404cd700 1 -- 172.21.15.69:0/2497980916 wait complete. 2023-12-14T18:24:37.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 -- 172.21.15.69:0/2706327570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c0ff120 msgr2=0x7fb77c0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 --2- 172.21.15.69:0/2706327570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c0ff120 0x7fb77c0ff530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb778009990 tx=0x7fb778009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 -- 172.21.15.69:0/2706327570 shutdown_connections 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 --2- 172.21.15.69:0/2706327570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb77c100ca0 0x7fb77c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 --2- 172.21.15.69:0/2706327570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c0ff120 0x7fb77c0ff530 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 --2- 172.21.15.69:0/2706327570 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c100310 0x7fb77c100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 -- 172.21.15.69:0/2706327570 >> 172.21.15.69:0/2706327570 conn(0x7fb77c0fa740 msgr2=0x7fb77c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 -- 172.21.15.69:0/2706327570 shutdown_connections 2023-12-14T18:24:37.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 -- 172.21.15.69:0/2706327570 wait complete. 2023-12-14T18:24:37.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.750+0000 7fb783584700 1 Processor -- start 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 -- start start 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c0ff120 0x7fb77c195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb77c100310 0x7fb77c196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 0x7fb77c19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c19daa0 con 0x7fb77c100ca0 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c19dbe0 con 0x7fb77c0ff120 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c19dd70 con 0x7fb77c100310 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 0x7fb77c19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 0x7fb77c19d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40820/0 (socket says 172.21.15.69:40820) 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 -- 172.21.15.69:0/2589680787 learned_addr learned my addr 172.21.15.69:0/2589680787 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781320700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c0ff120 0x7fb77c195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb780b1f700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb77c100310 0x7fb77c196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 -- 172.21.15.69:0/2589680787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb77c100310 msgr2=0x7fb77c196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb77c100310 0x7fb77c196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 -- 172.21.15.69:0/2589680787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c0ff120 msgr2=0x7fb77c195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c0ff120 0x7fb77c195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 -- 172.21.15.69:0/2589680787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780095f0 con 0x7fb77c100ca0 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781320700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c0ff120 0x7fb77c195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb781b21700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 0x7fb77c19d4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb774007ee0 tx=0x7fb77400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb7727fc700 1 -- 172.21.15.69:0/2589680787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774017070 con 0x7fb77c100ca0 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb7727fc700 1 -- 172.21.15.69:0/2589680787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb77400f040 con 0x7fb77c100ca0 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c10a940 con 0x7fb77c100ca0 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb7727fc700 1 -- 172.21.15.69:0/2589680787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774005710 con 0x7fb77c100ca0 2023-12-14T18:24:37.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.751+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c10a7b0 con 0x7fb77c100ca0 2023-12-14T18:24:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.753+0000 7fb7727fc700 1 -- 172.21.15.69:0/2589680787 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb774005870 con 0x7fb77c100ca0 2023-12-14T18:24:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.754+0000 7fb7727fc700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb7680a11e0 0x7fb7680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.754+0000 7fb781320700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb7680a11e0 0x7fb7680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.754+0000 7fb7727fc700 1 -- 172.21.15.69:0/2589680787 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb7740cc2b0 con 0x7fb77c100ca0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.754+0000 7fb781320700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb7680a11e0 0x7fb7680a3690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb778000c00 tx=0x7fb778005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 Processor -- start 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 -- start start 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f81bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f81cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f81d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f700590 con 0x56531f81b8c0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f76f820 con 0x56531f81d0c0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb78f712b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f768cb0 con 0x56531f81c210 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb781320700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f81bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb781320700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f81bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40822/0 (socket says 172.21.15.69:40822) 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.755+0000 7fb781320700 1 -- 172.21.15.69:0/1697822334 learned_addr learned my addr 172.21.15.69:0/1697822334 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb780b1f700 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f81cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781b21700 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f81d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781320700 1 -- 172.21.15.69:0/1697822334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 msgr2=0x56531f81cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781320700 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f81cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781320700 1 -- 172.21.15.69:0/1697822334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 msgr2=0x56531f81d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781320700 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f81d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781320700 1 -- 172.21.15.69:0/1697822334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56531f5ea360 con 0x56531f81b8c0 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781b21700 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f81d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb781320700 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f81bcd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb778015000 tx=0x7fb77801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3309d49ac8a37d75 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb7677fe700 1 -- 172.21.15.69:0/1697822334 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77802a070 con 0x56531f81b8c0 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb7677fe700 1 -- 172.21.15.69:0/1697822334 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb77801d040 con 0x56531f81b8c0 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.756+0000 7fb7677fe700 1 -- 172.21.15.69:0/1697822334 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778004c50 con 0x56531f81b8c0 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 -- 172.21.15.69:0/1697822334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 msgr2=0x56531f81bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f81bcd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb778015000 tx=0x7fb77801e000 comp rx=0 tx=0).stop 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 -- 172.21.15.69:0/1697822334 shutdown_connections 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f81d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f81bcd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1697822334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f81cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 -- 172.21.15.69:0/1697822334 >> 172.21.15.69:0/1697822334 conn(0x56531f80cc50 msgr2=0x56531f8123e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 -- 172.21.15.69:0/1697822334 shutdown_connections 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 -- 172.21.15.69:0/1697822334 wait complete. 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 -- start start 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.757+0000 7fb78f712b80 1 Processor -- start 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f825510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f825a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f82ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f704f40 con 0x56531f81b8c0 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f704be0 con 0x56531f81d0c0 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f5ec650 con 0x56531f81c210 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 10 client.0 _ll_register_callbacks cb 0x56531f7288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f825510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f825510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40836/0 (socket says 172.21.15.69:40836) 2023-12-14T18:24:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 -- 172.21.15.69:0/907861744 learned_addr learned my addr 172.21.15.69:0/907861744 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb780b1f700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f825a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781b21700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f82ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 -- 172.21.15.69:0/907861744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 msgr2=0x56531f825a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f825a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 -- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 msgr2=0x56531f82ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f82ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 -- 172.21.15.69:0/907861744 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c107e90 con 0x56531f81b8c0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb781320700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f825510 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb778009350 tx=0x7fb7780045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58fd40dd519e199 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb764ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb764ff9700 1 -- 172.21.15.69:0/907861744 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77802a040 con 0x56531f81b8c0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb764ff9700 1 -- 172.21.15.69:0/907861744 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb778003820 con 0x56531f81b8c0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56531f80a260 con 0x56531f81b8c0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb764ff9700 1 -- 172.21.15.69:0/907861744 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb77803d030 con 0x56531f81b8c0 2023-12-14T18:24:37.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.758+0000 7fb78f712b80 10 client.15225 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56531f72f120 con 0x56531f81b8c0 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb764ff9700 1 -- 172.21.15.69:0/907861744 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56531f80a260 con 0x56531f81b8c0 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb764ff9700 1 -- 172.21.15.69:0/907861744 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb77802f620 con 0x56531f81b8c0 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 10 client.15225 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 10 client.15225 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 20 client.15225 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f830800 0x56531f82f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 4 client.15225 mds_command: new command op to 24482 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56531f761c90 con 0x56531f830800 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb780b1f700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f830800 0x56531f82f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb764ff9700 10 client.15225 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.759+0000 7fb780b1f700 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f830800 0x56531f82f930 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60c59ea5995037d9 server_cookie=f3c07a30742defaf in_seq=0 out_seq=0 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb764ff9700 1 -- 172.21.15.69:0/907861744 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56531f761c90 con 0x56531f830800 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb764ff9700 10 client.15225 handle_command_reply: tid=0 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 client.15225 shutdown 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 msgr2=0x56531f825510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f825510 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb778009350 tx=0x7fb7780045f0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 shutdown_connections 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f830800 0x56531f82f930 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81d0c0 0x56531f82ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81b8c0 0x56531f825510 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb764ff9700 0 client.15225 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 --2- 172.21.15.69:0/907861744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81c210 0x56531f825a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 >> 172.21.15.69:0/907861744 conn(0x56531f80cc50 msgr2=0x56531f810ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 shutdown_connections 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.760+0000 7fb78f712b80 1 -- 172.21.15.69:0/907861744 wait complete. 2023-12-14T18:24:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.761+0000 7fb78f712b80 20 client.15225 trim_cache size 0 max 16384 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 Processor -- start 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 -- start start 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81b8c0 0x56531f811980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 0x56531f82ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81d0c0 0x56531f824270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f8314f0 con 0x56531f81c210 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f761c90 con 0x56531f81b8c0 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb78f712b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f764da0 con 0x56531f81d0c0 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb780b1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 0x56531f82ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb780b1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 0x56531f82ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40840/0 (socket says 172.21.15.69:40840) 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.778+0000 7fb780b1f700 1 -- 172.21.15.69:0/535979590 learned_addr learned my addr 172.21.15.69:0/535979590 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb780b1f700 1 -- 172.21.15.69:0/535979590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81d0c0 msgr2=0x56531f824270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb781320700 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81b8c0 0x56531f811980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb780b1f700 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81d0c0 0x56531f824270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb780b1f700 1 -- 172.21.15.69:0/535979590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81b8c0 msgr2=0x56531f811980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb780b1f700 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81b8c0 0x56531f811980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb780b1f700 1 -- 172.21.15.69:0/535979590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56531f812560 con 0x56531f81c210 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb781320700 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81b8c0 0x56531f811980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb780b1f700 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 0x56531f82ca50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x56531f705000 tx=0x7fb76c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909f6c9b62ab5757 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb767fff700 1 -- 172.21.15.69:0/535979590 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c018040 con 0x56531f81c210 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb767fff700 1 -- 172.21.15.69:0/535979590 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb76c01a4b0 con 0x56531f81c210 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb767fff700 1 -- 172.21.15.69:0/535979590 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c022630 con 0x56531f81c210 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 -- 172.21.15.69:0/535979590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 msgr2=0x56531f82ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 0x56531f82ca50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x56531f705000 tx=0x7fb76c005bb0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 -- 172.21.15.69:0/535979590 shutdown_connections 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81d0c0 0x56531f824270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81b8c0 0x56531f811980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 --2- 172.21.15.69:0/535979590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81c210 0x56531f82ca50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.779+0000 7fb78f712b80 1 -- 172.21.15.69:0/535979590 >> 172.21.15.69:0/535979590 conn(0x56531f80cc50 msgr2=0x56531f82f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 -- 172.21.15.69:0/535979590 shutdown_connections 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 -- 172.21.15.69:0/535979590 wait complete. 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 -- start start 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 Processor -- start 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81b8c0 0x56531f82a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81c210 0x56531f82a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 0x56531f82b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f82bae0 con 0x56531f81d0c0 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f82bc50 con 0x56531f81c210 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531f82be10 con 0x56531f81b8c0 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb78f712b80 10 client.0 _ll_register_callbacks cb 0x7fb778005690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:37.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb781b21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 0x56531f82b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb781b21700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 0x56531f82b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40844/0 (socket says 172.21.15.69:40844) 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb781b21700 1 -- 172.21.15.69:0/1273150390 learned_addr learned my addr 172.21.15.69:0/1273150390 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.780+0000 7fb780b1f700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81c210 0x56531f82a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781320700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81b8c0 0x56531f82a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781b21700 1 -- 172.21.15.69:0/1273150390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81b8c0 msgr2=0x56531f82a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781b21700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81b8c0 0x56531f82a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781b21700 1 -- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81c210 msgr2=0x56531f82a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781b21700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81c210 0x56531f82a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781b21700 1 -- 172.21.15.69:0/1273150390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c009890 con 0x56531f81d0c0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb780b1f700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81c210 0x56531f82a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb781b21700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 0x56531f82b5a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb77400dfd0 tx=0x7fb774004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f30f010eeff6fbe server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb764ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb764ff9700 1 -- 172.21.15.69:0/1273150390 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740a19c0 con 0x56531f81d0c0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb764ff9700 1 -- 172.21.15.69:0/1273150390 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb7740997d0 con 0x56531f81d0c0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb77801d040 con 0x56531f81d0c0 2023-12-14T18:24:37.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb764ff9700 1 -- 172.21.15.69:0/1273150390 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb774099990 con 0x56531f81d0c0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 10 client.15231 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56531f596b10 con 0x56531f81d0c0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb764ff9700 1 -- 172.21.15.69:0/1273150390 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb77801d040 con 0x56531f81d0c0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb764ff9700 1 -- 172.21.15.69:0/1273150390 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb7740a1530 con 0x56531f81d0c0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 10 client.15231 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 10 client.15231 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 20 client.15231 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f889be0 0x56531f886550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 4 client.15231 mds_command: new command op to 24482 tid=0[{"prefix": "status"}] 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.781+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56531f7619b0 con 0x56531f889be0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb781320700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f889be0 0x56531f886550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb781320700 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f889be0 0x56531f886550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d90da285b81efbde server_cookie=5d4d977a2cf2df37 in_seq=0 out_seq=0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb764ff9700 10 client.15231 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb764ff9700 1 -- 172.21.15.69:0/1273150390 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56531f7619b0 con 0x56531f889be0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb764ff9700 10 client.15231 handle_command_reply: tid=0 2023-12-14T18:24:37.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 client.15231 shutdown 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 msgr2=0x56531f82b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 0x56531f82b5a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb77400dfd0 tx=0x7fb774004b80 comp rx=0 tx=0).stop 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 shutdown_connections 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x56531f889be0 0x56531f886550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56531f81d0c0 0x56531f82b5a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56531f81b8c0 0x56531f82a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb764ff9700 0 client.15231 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 --2- 172.21.15.69:0/1273150390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56531f81c210 0x56531f82a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 >> 172.21.15.69:0/1273150390 conn(0x56531f80cc50 msgr2=0x56531f823500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 shutdown_connections 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 1 -- 172.21.15.69:0/1273150390 wait complete. 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.782+0000 7fb78f712b80 20 client.15231 trim_cache size 0 max 16384 2023-12-14T18:24:37.789 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24482, 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 65.470973091000005, 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 81, 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 79, 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 81.079405981999997 2023-12-14T18:24:37.790 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb7680a11e0 msgr2=0x7fb7680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb7680a11e0 0x7fb7680a3690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb778000c00 tx=0x7fb778005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 msgr2=0x7fb77c19d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 0x7fb77c19d4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb774007ee0 tx=0x7fb77400d3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 shutdown_connections 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb7680a11e0 0x7fb7680a3690 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c100ca0 0x7fb77c19d4d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb77c0ff120 0x7fb77c195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 --2- 172.21.15.69:0/2589680787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb77c100310 0x7fb77c196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 >> 172.21.15.69:0/2589680787 conn(0x7fb77c0fa740 msgr2=0x7fb77c0fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 shutdown_connections 2023-12-14T18:24:37.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.783+0000 7fb783584700 1 -- 172.21.15.69:0/2589680787 wait complete. 2023-12-14T18:24:37.795 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:37 smithi069 ceph-mon[42047]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 11 B/s, 1 objects/s recovering 2023-12-14T18:24:37.795 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:37 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/864697883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:37.795 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:37 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3139471506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:37.795 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:37 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3860388236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:37.796 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-14T18:24:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:37 smithi119 ceph-mon[43973]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 11 B/s, 1 objects/s recovering 2023-12-14T18:24:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:37 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/864697883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:37 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3139471506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:37 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3860388236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:37.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:37 smithi091 ceph-mon[43601]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 11 B/s, 1 objects/s recovering 2023-12-14T18:24:37.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:37 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/864697883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:37.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:37 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3139471506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:37.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:37 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3860388236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 -- 172.21.15.69:0/2839457411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 msgr2=0x7f91fc101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 --2- 172.21.15.69:0/2839457411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc101910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009990 tx=0x7f91e4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 -- 172.21.15.69:0/2839457411 shutdown_connections 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 --2- 172.21.15.69:0/2839457411 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91fc101e50 0x7f91fc108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 --2- 172.21.15.69:0/2839457411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91fc0fe4f0 0x7f91fc0fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 --2- 172.21.15.69:0/2839457411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc101910 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 -- 172.21.15.69:0/2839457411 >> 172.21.15.69:0/2839457411 conn(0x7f91fc0f9eb0 msgr2=0x7f91fc0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 -- 172.21.15.69:0/2839457411 shutdown_connections 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 -- 172.21.15.69:0/2839457411 wait complete. 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 Processor -- start 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.917+0000 7f9201bf8700 1 -- start start 2023-12-14T18:24:37.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91fc0fe4f0 0x7f91fc195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc1964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91fc101e50 0x7f91fc19d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc19dae0 con 0x7f91fc1014c0 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc19dc20 con 0x7f91fc101e50 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc19ddb0 con 0x7f91fc0fe4f0 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc1964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc1964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40860/0 (socket says 172.21.15.69:40860) 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 -- 172.21.15.69:0/3930895847 learned_addr learned my addr 172.21.15.69:0/3930895847 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91fbfff700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91fc101e50 0x7f91fc19d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91fc0fe4f0 0x7f91fc195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 -- 172.21.15.69:0/3930895847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91fc0fe4f0 msgr2=0x7f91fc195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91fc0fe4f0 0x7f91fc195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 -- 172.21.15.69:0/3930895847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91fc101e50 msgr2=0x7f91fc19d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91fc101e50 0x7f91fc19d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 -- 172.21.15.69:0/3930895847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40095f0 con 0x7f91fc1014c0 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f3fff700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc1964a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005910 tx=0x7f91e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f97fa700 1 -- 172.21.15.69:0/3930895847 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e401d070 con 0x7f91fc1014c0 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f97fa700 1 -- 172.21.15.69:0/3930895847 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91e40054c0 con 0x7f91fc1014c0 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc10baa0 con 0x7f91fc1014c0 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f91f97fa700 1 -- 172.21.15.69:0/3930895847 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4003ab0 con 0x7f91fc1014c0 2023-12-14T18:24:37.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.918+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc10b910 con 0x7f91fc1014c0 2023-12-14T18:24:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.920+0000 7f91f97fa700 1 -- 172.21.15.69:0/3930895847 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f91e40047a0 con 0x7f91fc1014c0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.921+0000 7f91f97fa700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f91e80a1260 0x7f91e80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.921+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f91e80a1260 0x7f91e80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.921+0000 7f91f97fa700 1 -- 172.21.15.69:0/3930895847 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f91e40cda10 con 0x7f91fc1014c0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.921+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f91e80a1260 0x7f91e80a3710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91ec005950 tx=0x7f91ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 Processor -- start 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 -- start start 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48dfd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48dfe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48dff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48ce6590 con 0x55de48dfde00 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48d55820 con 0x55de48dfecb0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f920dd86b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48d4ecb0 con 0x55de48dfd4b0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48dfe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48dfe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40866/0 (socket says 172.21.15.69:40866) 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 -- 172.21.15.69:0/3138565422 learned_addr learned my addr 172.21.15.69:0/3138565422 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91fbfff700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48dff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48dfd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 -- 172.21.15.69:0/3138565422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 msgr2=0x55de48dfd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48dfd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 -- 172.21.15.69:0/3138565422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 msgr2=0x55de48dff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48dff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91f3fff700 1 -- 172.21.15.69:0/3138565422 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de48bd0360 con 0x55de48dfde00 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48dfd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.922+0000 7f91fbfff700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48dff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f91f3fff700 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48dfe720 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91e40a2bf0 tx=0x7f91e409a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f295ab08b5de051 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f91f1ffb700 1 -- 172.21.15.69:0/3138565422 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4098f60 con 0x55de48dfde00 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f91f1ffb700 1 -- 172.21.15.69:0/3138565422 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91e4005630 con 0x55de48dfde00 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f91f1ffb700 1 -- 172.21.15.69:0/3138565422 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40a2f20 con 0x55de48dfde00 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 -- 172.21.15.69:0/3138565422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 msgr2=0x55de48dfe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48dfe720 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91e40a2bf0 tx=0x7f91e409a7f0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 -- 172.21.15.69:0/3138565422 shutdown_connections 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48dff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48dfd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 --2- 172.21.15.69:0/3138565422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48dfe720 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 -- 172.21.15.69:0/3138565422 >> 172.21.15.69:0/3138565422 conn(0x55de48df2c50 msgr2=0x55de48df83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 -- 172.21.15.69:0/3138565422 shutdown_connections 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.923+0000 7f920dd86b80 1 -- 172.21.15.69:0/3138565422 wait complete. 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 -- start start 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 Processor -- start 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 0x55de48e06e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfde00 0x55de48e073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e0e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48ceaf40 con 0x55de48dfd4b0 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48ceabe0 con 0x55de48dfecb0 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48bd2650 con 0x55de48dfde00 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f920dd86b80 10 client.0 _ll_register_callbacks cb 0x55de48d0e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:37.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f91fb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 0x55de48e06e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f91fb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 0x55de48e06e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40878/0 (socket says 172.21.15.69:40878) 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.924+0000 7f91fb7fe700 1 -- 172.21.15.69:0/1307477998 learned_addr learned my addr 172.21.15.69:0/1307477998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fb7fe700 1 -- 172.21.15.69:0/1307477998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfde00 msgr2=0x55de48e073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fbfff700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e0e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91f3fff700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfde00 0x55de48e073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfde00 0x55de48e073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fb7fe700 1 -- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 msgr2=0x55de48e0e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e0e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fb7fe700 1 -- 172.21.15.69:0/1307477998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc10b910 con 0x55de48dfd4b0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fbfff700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e0e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91f3fff700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfde00 0x55de48e073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 0x55de48e06e90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00ff10 tx=0x7f91ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41be1856476854e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91daffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91daffd700 1 -- 172.21.15.69:0/1307477998 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec01e620 con 0x55de48dfd4b0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91daffd700 1 -- 172.21.15.69:0/1307477998 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f91ec01e780 con 0x55de48dfd4b0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de48df0260 con 0x55de48dfd4b0 2023-12-14T18:24:37.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91daffd700 1 -- 172.21.15.69:0/1307477998 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91ec02c030 con 0x55de48dfd4b0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 10 client.15243 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55de48d15120 con 0x55de48dfd4b0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91daffd700 1 -- 172.21.15.69:0/1307477998 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de48df0260 con 0x55de48dfd4b0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f91daffd700 1 -- 172.21.15.69:0/1307477998 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f91ec024020 con 0x55de48dfd4b0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 10 client.15243 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 10 client.15243 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 20 client.15243 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.925+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e120e0 0x55de48e114e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.926+0000 7f920dd86b80 4 client.15243 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.926+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de48d47c90 con 0x55de48e120e0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.926+0000 7f91f3fff700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e120e0 0x55de48e114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.926+0000 7f91daffd700 10 client.15243 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.926+0000 7f91f3fff700 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e120e0 0x55de48e114e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e467eb5333793b6a server_cookie=31ae530f90e5a73d in_seq=0 out_seq=0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f91daffd700 1 -- 172.21.15.69:0/1307477998 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55de48d47c90 con 0x55de48e120e0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f91daffd700 10 client.15243 handle_command_reply: tid=0 2023-12-14T18:24:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 client.15243 shutdown 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 msgr2=0x55de48e06e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 0x55de48e06e90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00ff10 tx=0x7f91ec004750 comp rx=0 tx=0).stop 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 shutdown_connections 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e120e0 0x55de48e114e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e0e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfd4b0 0x55de48e06e90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f91daffd700 0 client.15243 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1307477998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfde00 0x55de48e073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 >> 172.21.15.69:0/1307477998 conn(0x55de48df2c50 msgr2=0x55de48df6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 shutdown_connections 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 1 -- 172.21.15.69:0/1307477998 wait complete. 2023-12-14T18:24:37.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.927+0000 7f920dd86b80 20 client.15243 trim_cache size 0 max 16384 2023-12-14T18:24:37.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 Processor -- start 2023-12-14T18:24:37.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 -- start start 2023-12-14T18:24:37.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48df7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfde00 0x55de48e0e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 0x55de48df7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48d47c90 con 0x55de48dfecb0 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48dfe5b0 con 0x55de48dfde00 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f920dd86b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48d4ada0 con 0x55de48dfd4b0 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 0x55de48df7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 0x55de48df7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40888/0 (socket says 172.21.15.69:40888) 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 -- 172.21.15.69:0/1353018789 learned_addr learned my addr 172.21.15.69:0/1353018789 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 -- 172.21.15.69:0/1353018789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 msgr2=0x55de48df7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48df7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 -- 172.21.15.69:0/1353018789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfde00 msgr2=0x55de48e0e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfde00 0x55de48e0e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 -- 172.21.15.69:0/1353018789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de48d14e70 con 0x55de48dfecb0 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91fbfff700 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 0x55de48df7ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009910 tx=0x7f91f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edf7eba0a74d534 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91f27fc700 1 -- 172.21.15.69:0/1353018789 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f40048c0 con 0x55de48dfecb0 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91f27fc700 1 -- 172.21.15.69:0/1353018789 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91f400f040 con 0x55de48dfecb0 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.945+0000 7f91f27fc700 1 -- 172.21.15.69:0/1353018789 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f40166c0 con 0x55de48dfecb0 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 -- 172.21.15.69:0/1353018789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 msgr2=0x55de48df7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 0x55de48df7ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009910 tx=0x7f91f4009c20 comp rx=0 tx=0).stop 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 -- 172.21.15.69:0/1353018789 shutdown_connections 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfecb0 0x55de48df7ec0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48df7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 --2- 172.21.15.69:0/1353018789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfde00 0x55de48e0e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 -- 172.21.15.69:0/1353018789 >> 172.21.15.69:0/1353018789 conn(0x55de48df2c50 msgr2=0x55de48e01c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 -- 172.21.15.69:0/1353018789 shutdown_connections 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 -- 172.21.15.69:0/1353018789 wait complete. 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.946+0000 7f920dd86b80 1 -- start start 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 Processor -- start 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48e09160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48e096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e65fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48e09c80 con 0x55de48dfde00 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48e664e0 con 0x55de48dfecb0 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48e66620 con 0x55de48dfd4b0 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 10 client.0 _ll_register_callbacks cb 0x7f91ec00fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48e096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48e096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40898/0 (socket says 172.21.15.69:40898) 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 -- 172.21.15.69:0/376689026 learned_addr learned my addr 172.21.15.69:0/376689026 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 -- 172.21.15.69:0/376689026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 msgr2=0x55de48e09160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48e09160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91fbfff700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e65fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 -- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 msgr2=0x55de48e65fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e65fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 -- 172.21.15.69:0/376689026 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4003de0 con 0x55de48dfde00 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91fbfff700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e65fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:37.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91f3fff700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48e096a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f91e409aa60 tx=0x7f91e409ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53af30e1d6a923c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91daffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91daffd700 1 -- 172.21.15.69:0/376689026 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40970a0 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f91daffd700 1 -- 172.21.15.69:0/376689026 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f91e409a250 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.947+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91e4005630 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f91daffd700 1 -- 172.21.15.69:0/376689026 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91e409a410 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 10 client.15249 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55de48cfb950 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f91daffd700 1 -- 172.21.15.69:0/376689026 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91e4005630 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f91daffd700 1 -- 172.21.15.69:0/376689026 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f91e40a2db0 con 0x55de48dfde00 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 10 client.15249 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 20 client.15249 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e6aed0 0x55de48e67910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 4 client.15249 mds_command: new command op to 24509 tid=0[{"prefix": "status"}] 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55de48d479b0 con 0x55de48e6aed0 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e6aed0 0x55de48e67910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:37.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f91daffd700 10 client.15249 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.948+0000 7f91fb7fe700 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e6aed0 0x55de48e67910 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b12ab65c11bcf71 server_cookie=32e90798f64034bf in_seq=0 out_seq=0 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f91daffd700 1 -- 172.21.15.69:0/376689026 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55de48d479b0 con 0x55de48e6aed0 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f91daffd700 10 client.15249 handle_command_reply: tid=0 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 client.15249 shutdown 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 msgr2=0x55de48e096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48e096a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f91e409aa60 tx=0x7f91e409ac60 comp rx=0 tx=0).stop 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 shutdown_connections 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55de48e6aed0 0x55de48e67910 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55de48dfecb0 0x55de48e65fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f91daffd700 0 client.15249 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de48dfd4b0 0x55de48e09160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 --2- 172.21.15.69:0/376689026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de48dfde00 0x55de48e096a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 >> 172.21.15.69:0/376689026 conn(0x55de48df2c50 msgr2=0x55de48dfc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 shutdown_connections 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 1 -- 172.21.15.69:0/376689026 wait complete. 2023-12-14T18:24:37.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f920dd86b80 20 client.15249 trim_cache size 0 max 16384 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "f1527c12-9aac-11ee-95a5-87774f69a715", 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24509, 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 68.652458877000001, 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 22, 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 81, 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 79, 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 74.339447884999998 2023-12-14T18:24:37.956 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f91e80a1260 msgr2=0x7f91e80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f9201bf8700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f91e80a1260 0x7f91e80a3710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91ec005950 tx=0x7f91ec0058e0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 msgr2=0x7f91fc1964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.949+0000 7f9201bf8700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc1964a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005910 tx=0x7f91e4004730 comp rx=0 tx=0).stop 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 shutdown_connections 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f91e80a1260 0x7f91e80a3710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91fc101e50 0x7f91fc19d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91fc0fe4f0 0x7f91fc195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 --2- 172.21.15.69:0/3930895847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f91fc1014c0 0x7f91fc1964a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:37.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 >> 172.21.15.69:0/3930895847 conn(0x7f91fc0f9eb0 msgr2=0x7f91fc0fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:37.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 shutdown_connections 2023-12-14T18:24:37.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:37.950+0000 7f9201bf8700 1 -- 172.21.15.69:0/3930895847 wait complete. 2023-12-14T18:24:37.962 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-14T18:24:37.984 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-14T18:24:37.984 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-14T18:24:37.984 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2023-12-14T18:24:37.985 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-14T18:24:37.985 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:37.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:37.985 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-12-14T18:24:38.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:38.002 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-12-14T18:24:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2023-12-14T18:24:38.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:24:38.073 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-14T18:24:38.073 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-14T18:24:38.420 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:24:39.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 -- 172.21.15.69:0/3432016350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 msgr2=0x7fa5340feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:39.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 --2- 172.21.15.69:0/3432016350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa5340feca0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa528009990 tx=0x7fa528009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 -- 172.21.15.69:0/3432016350 shutdown_connections 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 --2- 172.21.15.69:0/3432016350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5340ff1e0 0x7fa53410d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 --2- 172.21.15.69:0/3432016350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa534105290 0x7fa534105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 --2- 172.21.15.69:0/3432016350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa5340feca0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 -- 172.21.15.69:0/3432016350 >> 172.21.15.69:0/3432016350 conn(0x7fa5340758a0 msgr2=0x7fa534075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 -- 172.21.15.69:0/3432016350 shutdown_connections 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.446+0000 7fa53a073700 1 -- 172.21.15.69:0/3432016350 wait complete. 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 Processor -- start 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 -- start start 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa534196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5340ff1e0 0x7fa534196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa534105290 0x7fa53419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53419b2f0 con 0x7fa5340fe830 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53419b460 con 0x7fa534105290 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa53a073700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53419b620 con 0x7fa5340ff1e0 2023-12-14T18:24:39.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa534196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa534196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40916/0 (socket says 172.21.15.69:40916) 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 -- 172.21.15.69:0/1783886260 learned_addr learned my addr 172.21.15.69:0/1783886260 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa532ffd700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5340ff1e0 0x7fa534196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 -- 172.21.15.69:0/1783886260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5340ff1e0 msgr2=0x7fa534196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5340ff1e0 0x7fa534196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa533fff700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa534105290 0x7fa53419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 -- 172.21.15.69:0/1783886260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa534105290 msgr2=0x7fa53419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa534105290 0x7fa53419ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.447+0000 7fa5337fe700 1 -- 172.21.15.69:0/1783886260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5280095f0 con 0x7fa5340fe830 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.448+0000 7fa5337fe700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa534196330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa52400d950 tx=0x7fa52400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.448+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524009b40 con 0x7fa5340fe830 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.448+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa524009ca0 con 0x7fa5340fe830 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.448+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5341102c0 con 0x7fa5340fe830 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.448+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52400f620 con 0x7fa5340fe830 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.448+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa534110130 con 0x7fa5340fe830 2023-12-14T18:24:39.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.449+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa534110450 con 0x7fa5340fe830 2023-12-14T18:24:39.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.450+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa524010460 con 0x7fa5340fe830 2023-12-14T18:24:39.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.450+0000 7fa530ff9700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa51c0a11e0 0x7fa51c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:39.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.450+0000 7fa532ffd700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa51c0a11e0 0x7fa51c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:39.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.450+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa5240ccdd0 con 0x7fa5340fe830 2023-12-14T18:24:39.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.451+0000 7fa532ffd700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa51c0a11e0 0x7fa51c0a3690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa528006010 tx=0x7fa528003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:39.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.454+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa5240963d0 con 0x7fa5340fe830 2023-12-14T18:24:39.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.686+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5341a3410 con 0x7fa5340fe830 2023-12-14T18:24:39.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.687+0000 7fa530ff9700 1 -- 172.21.15.69:0/1783886260 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa524016060 con 0x7fa5340fe830 2023-12-14T18:24:39.688 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa51c0a11e0 msgr2=0x7fa51c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa51c0a11e0 0x7fa51c0a3690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa528006010 tx=0x7fa528003680 comp rx=0 tx=0).stop 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 msgr2=0x7fa534196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa534196330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa52400d950 tx=0x7fa52400dd10 comp rx=0 tx=0).stop 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 shutdown_connections 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa51c0a11e0 0x7fa51c0a3690 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa534105290 0x7fa53419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5340fe830 0x7fa534196330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 --2- 172.21.15.69:0/1783886260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5340ff1e0 0x7fa534196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 >> 172.21.15.69:0/1783886260 conn(0x7fa5340758a0 msgr2=0x7fa5340fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 shutdown_connections 2023-12-14T18:24:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:39.689+0000 7fa53a073700 1 -- 172.21.15.69:0/1783886260 wait complete. 2023-12-14T18:24:39.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:39 smithi119 ceph-mon[43973]: pgmap v257: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 10 B/s, 1 objects/s recovering 2023-12-14T18:24:39.878 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:39 smithi069 ceph-mon[42047]: pgmap v257: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 10 B/s, 1 objects/s recovering 2023-12-14T18:24:39.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:39 smithi091 ceph-mon[43601]: pgmap v257: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 10 B/s, 1 objects/s recovering 2023-12-14T18:24:40.116 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-14T18:24:40.116 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-14T18:24:40.117 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-14T18:24:40.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.117 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-12-14T18:24:40.136 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42035sec preferred_lft 42035sec 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::13b6:b696:cf97:b326/64 scope link noprefixroute 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-12-14T18:24:40.137 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-14T18:24:40.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-14T18:24:40.138 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T18:24:40.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.316 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-14T18:24:40.344 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-12-14T18:24:40.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.345 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-12-14T18:24:40.414 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-12-14T18:24:40.414 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-14T18:24:40.414 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-14T18:24:40.415 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-14T18:24:40.415 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-14T18:24:40.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.415 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T18:24:40.415 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T18:24:40.415 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-14T18:24:40.415 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-14T18:24:40.415 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-14T18:24:40.415 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T18:24:40.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.701 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-12-14T18:24:40.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.718 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2023-12-14T18:24:40.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.774 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T18:24:40.775 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T18:24:40.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-14T18:24:40.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-14T18:24:40.775 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T18:24:40.853 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:40 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1783886260' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-14T18:24:40.870 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-14T18:24:40.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:40.870 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T18:24:40.870 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T18:24:40.870 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-14T18:24:40.870 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-14T18:24:40.871 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-14T18:24:40.871 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-14T18:24:40.871 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-14T18:24:40.871 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T18:24:40.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:40 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1783886260' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-14T18:24:40.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:40 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1783886260' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-14T18:24:41.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:41.129 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-12-14T18:24:41.130 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-12-14T18:24:41.130 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-12-14T18:24:41.130 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2023-12-14T18:24:41.130 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-12-14T18:24:41.227 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2023-12-14T18:24:41.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-14T18:24:41.228 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:41.244 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-14T18:24:41.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-14T18:24:41.244 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:41.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-12-14T18:24:41.369 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-14T18:24:41.370 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-14T18:24:41.436 INFO:teuthology.orchestra.run.smithi069.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-14T18:24:41.437 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-14T18:24:41.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:41.438 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-12-14T18:24:41.494 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-14T18:24:41.494 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/fc55b335-a749-455a-b64a-167648e863dc --client_fs=cephfs) 2023-12-14T18:24:41.537 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-12-14T18:24:41.563 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-14T18:24:41.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-14T18:24:41.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:2023-12-14T18:24:41.625+0000 7fb1f31935c0 -1 init, newargv = 0x562c6739d300 newargc=15 2023-12-14T18:24:41.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[89132]: starting ceph client 2023-12-14T18:24:41.630 INFO:teuthology.orchestra.run.smithi069.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-14T18:24:41.632 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-14T18:24:41.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:41.632 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-12-14T18:24:41.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[89132]: starting fuse 2023-12-14T18:24:41.660 INFO:teuthology.orchestra.run.smithi069.stdout:124 2023-12-14T18:24:41.660 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> import re 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2023-12-14T18:24:41.661 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> return f 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.0")) 2023-12-14T18:24:41.662 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-12-14T18:24:41.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:41 smithi069 ceph-mon[42047]: pgmap v258: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 9 B/s, 0 objects/s recovering 2023-12-14T18:24:41.783 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.0.89132.asok 2023-12-14T18:24:41.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:41 smithi119 ceph-mon[43973]: pgmap v258: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 9 B/s, 0 objects/s recovering 2023-12-14T18:24:41.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:41 smithi091 ceph-mon[43601]: pgmap v258: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 9 B/s, 0 objects/s recovering 2023-12-14T18:24:41.966 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89132.asok 2023-12-14T18:24:41.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:41.967 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89132.asok status 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "1faa353368ad4f5aeb56d7107b638336f58659ed", 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-3905-g1faa3533 (1faa353368ad4f5aeb56d7107b638336f58659ed) reef (dev)", 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "0", 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "89132", 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/volumes/_nogroup/sv_0/fc55b335-a749-455a-b64a-167648e863dc" 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2023-12-14T18:24:42.126 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 15261, 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 15261 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3971093492 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-12-14T18:24:42.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3971093492 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.15261 172.21.15.69:0/3971093492", 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "172.21.15.69:0/3971093492", 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 5, 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 22, 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 81, 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 79, 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2023-12-14T18:24:42.128 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:42.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:42.136 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2023-12-14T18:24:42.136 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:42.154 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2023-12-14T18:24:42.154 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:42.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:24:42.154 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:42.224 INFO:teuthology.run_tasks:Running task check-counter... 2023-12-14T18:24:42.234 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-12-14T18:24:42.354 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:42.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 -- 172.21.15.69:0/8966593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b41014b0 msgr2=0x7f96b4101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 --2- 172.21.15.69:0/8966593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b41014b0 0x7f96b4101900 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009990 tx=0x7f96a0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 -- 172.21.15.69:0/8966593 shutdown_connections 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 --2- 172.21.15.69:0/8966593 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96b4101e40 0x7f96b4108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 --2- 172.21.15.69:0/8966593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b40fe4e0 0x7f96b40fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 --2- 172.21.15.69:0/8966593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b41014b0 0x7f96b4101900 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 -- 172.21.15.69:0/8966593 >> 172.21.15.69:0/8966593 conn(0x7f96b40f9e80 msgr2=0x7f96b40fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 -- 172.21.15.69:0/8966593 shutdown_connections 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.476+0000 7f96baf04700 1 -- 172.21.15.69:0/8966593 wait complete. 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 Processor -- start 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 -- start start 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b40fe4e0 0x7f96b4195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96b41014b0 0x7f96b41963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 0x7f96b419d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b419da00 con 0x7f96b4101e40 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b419db40 con 0x7f96b41014b0 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b419dcd0 con 0x7f96b40fe4e0 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 0x7f96b419d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 0x7f96b419d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40940/0 (socket says 172.21.15.69:40940) 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 -- 172.21.15.69:0/1844956453 learned_addr learned my addr 172.21.15.69:0/1844956453 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b8ca0700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b40fe4e0 0x7f96b4195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b3fff700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96b41014b0 0x7f96b41963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 -- 172.21.15.69:0/1844956453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b40fe4e0 msgr2=0x7f96b4195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b40fe4e0 0x7f96b4195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 -- 172.21.15.69:0/1844956453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96b41014b0 msgr2=0x7f96b41963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96b41014b0 0x7f96b41963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 -- 172.21.15.69:0/1844956453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a00095f0 con 0x7f96b4101e40 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b94a1700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 0x7f96b419d430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f96ac007d70 tx=0x7f96ac00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac00ad40 con 0x7f96b4101e40 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96ac0128b0 con 0x7f96b4101e40 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b410ba30 con 0x7f96b4101e40 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.477+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0115a0 con 0x7f96b4101e40 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.478+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b410b8a0 con 0x7f96b4101e40 2023-12-14T18:24:42.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.478+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b4107240 con 0x7f96b4101e40 2023-12-14T18:24:42.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.480+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f96ac012a20 con 0x7f96b4101e40 2023-12-14T18:24:42.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.480+0000 7f96b1ffb700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96a40a11e0 0x7f96a40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.480+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f96ac0ccfb0 con 0x7f96b4101e40 2023-12-14T18:24:42.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.480+0000 7f96b8ca0700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96a40a11e0 0x7f96a40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.481+0000 7f96b8ca0700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96a40a11e0 0x7f96a40a3690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f96b4067bd0 tx=0x7f96a8010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:42.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.484+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f96ac0966c0 con 0x7f96b4101e40 2023-12-14T18:24:42.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.674+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96b402cfe0 con 0x7f96b4101e40 2023-12-14T18:24:42.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.676+0000 7f96b1ffb700 1 -- 172.21.15.69:0/1844956453 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f96ac099ce0 con 0x7f96b4101e40 2023-12-14T18:24:42.677 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:42.678 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:42.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96a40a11e0 msgr2=0x7f96a40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96a40a11e0 0x7f96a40a3690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f96b4067bd0 tx=0x7f96a8010040 comp rx=0 tx=0).stop 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 msgr2=0x7f96b419d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 0x7f96b419d430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f96ac007d70 tx=0x7f96ac00a340 comp rx=0 tx=0).stop 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 shutdown_connections 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96a40a11e0 0x7f96a40a3690 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96b4101e40 0x7f96b419d430 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b40fe4e0 0x7f96b4195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 --2- 172.21.15.69:0/1844956453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96b41014b0 0x7f96b41963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 >> 172.21.15.69:0/1844956453 conn(0x7f96b40f9e80 msgr2=0x7f96b40fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 shutdown_connections 2023-12-14T18:24:42.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.678+0000 7f96baf04700 1 -- 172.21.15.69:0/1844956453 wait complete. 2023-12-14T18:24:42.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:42.692 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 -- 172.21.15.69:0/470077343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac20100320 msgr2=0x7fac20100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 --2- 172.21.15.69:0/470077343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac20100320 0x7fac20100770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac10009990 tx=0x7fac10009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 -- 172.21.15.69:0/470077343 shutdown_connections 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 --2- 172.21.15.69:0/470077343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac20100cb0 0x7fac20107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 --2- 172.21.15.69:0/470077343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac200ff130 0x7fac200ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 --2- 172.21.15.69:0/470077343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac20100320 0x7fac20100770 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 -- 172.21.15.69:0/470077343 >> 172.21.15.69:0/470077343 conn(0x7fac200fa750 msgr2=0x7fac200fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:42.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 -- 172.21.15.69:0/470077343 shutdown_connections 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.817+0000 7fac25f4e700 1 -- 172.21.15.69:0/470077343 wait complete. 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 Processor -- start 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 -- start start 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 0x7fac201030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac20100320 0x7fac20101700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac20100cb0 0x7fac20101c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac201023e0 con 0x7fac200ff130 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20102550 con 0x7fac20100320 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac25f4e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2019fe50 con 0x7fac20100cb0 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 0x7fac201030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 0x7fac201030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40958/0 (socket says 172.21.15.69:40958) 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 -- 172.21.15.69:0/3608778017 learned_addr learned my addr 172.21.15.69:0/3608778017 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1effd700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac20100320 0x7fac20101700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1ffff700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac20100cb0 0x7fac20101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 -- 172.21.15.69:0/3608778017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac20100cb0 msgr2=0x7fac20101c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac20100cb0 0x7fac20101c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 -- 172.21.15.69:0/3608778017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac20100320 msgr2=0x7fac20101700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac20100320 0x7fac20101700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.818+0000 7fac1f7fe700 1 -- 172.21.15.69:0/3608778017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100095f0 con 0x7fac200ff130 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.819+0000 7fac1f7fe700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 0x7fac201030c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac0800c990 tx=0x7fac0800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.819+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08007b00 con 0x7fac200ff130 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.819+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac08007c60 con 0x7fac200ff130 2023-12-14T18:24:42.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.819+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2010a990 con 0x7fac200ff130 2023-12-14T18:24:42.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.819+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08018660 con 0x7fac200ff130 2023-12-14T18:24:42.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.819+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2010a800 con 0x7fac200ff130 2023-12-14T18:24:42.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.820+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac201a05f0 con 0x7fac200ff130 2023-12-14T18:24:42.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.821+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fac0800f450 con 0x7fac200ff130 2023-12-14T18:24:42.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.822+0000 7fac1cff9700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac0c0a1260 0x7fac0c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:42.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.822+0000 7fac1effd700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac0c0a1260 0x7fac0c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:42.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.822+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fac080cca40 con 0x7fac200ff130 2023-12-14T18:24:42.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.822+0000 7fac1effd700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac0c0a1260 0x7fac0c0a3710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c010 tx=0x7fac10005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:42.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:42.825+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fac08096150 con 0x7fac200ff130 2023-12-14T18:24:43.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.016+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac201a0ba0 con 0x7fac200ff130 2023-12-14T18:24:43.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.016+0000 7fac1cff9700 1 -- 172.21.15.69:0/3608778017 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac0800fe60 con 0x7fac200ff130 2023-12-14T18:24:43.017 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac0c0a1260 msgr2=0x7fac0c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac0c0a1260 0x7fac0c0a3710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c010 tx=0x7fac10005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 msgr2=0x7fac201030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 0x7fac201030c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac0800c990 tx=0x7fac0800cca0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 shutdown_connections 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fac0c0a1260 0x7fac0c0a3710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac20100cb0 0x7fac20101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac200ff130 0x7fac201030c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 --2- 172.21.15.69:0/3608778017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac20100320 0x7fac20101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.018+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 >> 172.21.15.69:0/3608778017 conn(0x7fac200fa750 msgr2=0x7fac20068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:43.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.019+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 shutdown_connections 2023-12-14T18:24:43.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.019+0000 7fac25f4e700 1 -- 172.21.15.69:0/3608778017 wait complete. 2023-12-14T18:24:43.032 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:43.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 -- 172.21.15.69:0/2888608744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100cf0 msgr2=0x7f0534107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 --2- 172.21.15.69:0/2888608744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100cf0 0x7f0534107590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f052c00b0a0 tx=0x7f052c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 -- 172.21.15.69:0/2888608744 shutdown_connections 2023-12-14T18:24:43.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 --2- 172.21.15.69:0/2888608744 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100cf0 0x7f0534107590 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 --2- 172.21.15.69:0/2888608744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05340ff630 0x7f05340ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 --2- 172.21.15.69:0/2888608744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0534100340 0x7f05341007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 -- 172.21.15.69:0/2888608744 >> 172.21.15.69:0/2888608744 conn(0x7f05340f9ed0 msgr2=0x7f05340fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 -- 172.21.15.69:0/2888608744 shutdown_connections 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.155+0000 7f053b951700 1 -- 172.21.15.69:0/2888608744 wait complete. 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 Processor -- start 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 -- start start 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05340ff630 0x7f0534195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 0x7f0534196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0534100cf0 0x7f053419d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053419dad0 con 0x7f0534100340 2023-12-14T18:24:43.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053419dc10 con 0x7f0534100cf0 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f053b951700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053419dda0 con 0x7f05340ff630 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f0538eec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 0x7f0534196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f0538eec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 0x7f0534196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40980/0 (socket says 172.21.15.69:40980) 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f0538eec700 1 -- 172.21.15.69:0/2945124413 learned_addr learned my addr 172.21.15.69:0/2945124413 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f0539eee700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0534100cf0 0x7f053419d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.156+0000 7f05396ed700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05340ff630 0x7f0534195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f0538eec700 1 -- 172.21.15.69:0/2945124413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05340ff630 msgr2=0x7f0534195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f0538eec700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05340ff630 0x7f0534195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f0538eec700 1 -- 172.21.15.69:0/2945124413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0534100cf0 msgr2=0x7f053419d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f0538eec700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0534100cf0 0x7f053419d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f0538eec700 1 -- 172.21.15.69:0/2945124413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009d00 con 0x7f0534100340 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f0538eec700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 0x7f0534196490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f053000c990 tx=0x7f053000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530007940 con 0x7f0534100340 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f053000f450 con 0x7f0534100340 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053410a930 con 0x7f0534100340 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530018660 con 0x7f0534100340 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.157+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053410a7a0 con 0x7f0534100340 2023-12-14T18:24:43.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.158+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053419e540 con 0x7f0534100340 2023-12-14T18:24:43.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.159+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f053000f5c0 con 0x7f0534100340 2023-12-14T18:24:43.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.160+0000 7f052a7fc700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f05200a1260 0x7f05200a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.160+0000 7f05396ed700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f05200a1260 0x7f05200a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.160+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f05300cc8f0 con 0x7f0534100340 2023-12-14T18:24:43.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.160+0000 7f05396ed700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f05200a1260 0x7f05200a3710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0534067940 tx=0x7f052400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:43.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.164+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0530095ef0 con 0x7f0534100340 2023-12-14T18:24:43.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.350+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f053419eaf0 con 0x7f0534100340 2023-12-14T18:24:43.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.351+0000 7f052a7fc700 1 -- 172.21.15.69:0/2945124413 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0530099510 con 0x7f0534100340 2023-12-14T18:24:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:43.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f05200a1260 msgr2=0x7f05200a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f05200a1260 0x7f05200a3710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0534067940 tx=0x7f052400b410 comp rx=0 tx=0).stop 2023-12-14T18:24:43.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 msgr2=0x7f0534196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 0x7f0534196490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f053000c990 tx=0x7f053000cca0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 shutdown_connections 2023-12-14T18:24:43.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f05200a1260 0x7f05200a3710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0534100cf0 0x7f053419d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05340ff630 0x7f0534195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 --2- 172.21.15.69:0/2945124413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0534100340 0x7f0534196490 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 >> 172.21.15.69:0/2945124413 conn(0x7f05340f9ed0 msgr2=0x7f05340fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:43.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 shutdown_connections 2023-12-14T18:24:43.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.353+0000 7f053b951700 1 -- 172.21.15.69:0/2945124413 wait complete. 2023-12-14T18:24:43.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 -- 172.21.15.69:0/1282463177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc0ff630 msgr2=0x7f20dc0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 --2- 172.21.15.69:0/1282463177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc0ff630 0x7f20dc0ffa40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009990 tx=0x7f20cc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 -- 172.21.15.69:0/1282463177 shutdown_connections 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 --2- 172.21.15.69:0/1282463177 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 0x7f20dc107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 --2- 172.21.15.69:0/1282463177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc0ff630 0x7f20dc0ffa40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 --2- 172.21.15.69:0/1282463177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc100340 0x7f20dc1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 -- 172.21.15.69:0/1282463177 >> 172.21.15.69:0/1282463177 conn(0x7f20dc0f9ed0 msgr2=0x7f20dc0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 -- 172.21.15.69:0/1282463177 shutdown_connections 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.489+0000 7f20e2708700 1 -- 172.21.15.69:0/1282463177 wait complete. 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 Processor -- start 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 -- start start 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc0ff630 0x7f20dc195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 0x7f20dc196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 0x7f20dc19d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc19dad0 con 0x7f20dc100340 2023-12-14T18:24:43.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc19dc10 con 0x7f20dc100cf0 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20e2708700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc19dda0 con 0x7f20dc0ff630 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 0x7f20dc196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 0x7f20dc196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41008/0 (socket says 172.21.15.69:41008) 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.490+0000 7f20db7fe700 1 -- 172.21.15.69:0/3230454723 learned_addr learned my addr 172.21.15.69:0/3230454723 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20dbfff700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc0ff630 0x7f20dc195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20e0ca5700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 0x7f20dc19d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20db7fe700 1 -- 172.21.15.69:0/3230454723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc0ff630 msgr2=0x7f20dc195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20db7fe700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc0ff630 0x7f20dc195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20db7fe700 1 -- 172.21.15.69:0/3230454723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 msgr2=0x7f20dc19d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20db7fe700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 0x7f20dc19d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20db7fe700 1 -- 172.21.15.69:0/3230454723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0095f0 con 0x7f20dc100340 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20e0ca5700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 0x7f20dc19d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20db7fe700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 0x7f20dc196490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e970 tx=0x7f20d000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:43.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0009790 con 0x7f20dc100340 2023-12-14T18:24:43.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc10a980 con 0x7f20dc100340 2023-12-14T18:24:43.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20d00044b0 con 0x7f20dc100340 2023-12-14T18:24:43.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0003dd0 con 0x7f20dc100340 2023-12-14T18:24:43.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.491+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc10a7f0 con 0x7f20dc100340 2023-12-14T18:24:43.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.492+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc19e4f0 con 0x7f20dc100340 2023-12-14T18:24:43.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.493+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f20d0003f30 con 0x7f20dc100340 2023-12-14T18:24:43.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.494+0000 7f20d97fa700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20c40a11e0 0x7f20c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.494+0000 7f20dbfff700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20c40a11e0 0x7f20c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.494+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f20d0014070 con 0x7f20dc100340 2023-12-14T18:24:43.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.494+0000 7f20dbfff700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20c40a11e0 0x7f20c40a3690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098e0 tx=0x7f20cc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:43.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.497+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f20d0096490 con 0x7f20dc100340 2023-12-14T18:24:43.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.690+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20dc19eaa0 con 0x7f20dc100340 2023-12-14T18:24:43.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.690+0000 7f20d97fa700 1 -- 172.21.15.69:0/3230454723 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20d0099ab0 con 0x7f20dc100340 2023-12-14T18:24:43.691 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:43.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20c40a11e0 msgr2=0x7f20c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20c40a11e0 0x7f20c40a3690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098e0 tx=0x7f20cc00b260 comp rx=0 tx=0).stop 2023-12-14T18:24:43.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 msgr2=0x7f20dc196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 0x7f20dc196490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e970 tx=0x7f20d000ed30 comp rx=0 tx=0).stop 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 shutdown_connections 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f20c40a11e0 0x7f20c40a3690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f20dc100cf0 0x7f20dc19d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc0ff630 0x7f20dc195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 --2- 172.21.15.69:0/3230454723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20dc100340 0x7f20dc196490 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 >> 172.21.15.69:0/3230454723 conn(0x7f20dc0f9ed0 msgr2=0x7f20dc0fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 shutdown_connections 2023-12-14T18:24:43.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.692+0000 7f20e2708700 1 -- 172.21.15.69:0/3230454723 wait complete. 2023-12-14T18:24:43.704 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:43 smithi069 ceph-mon[42047]: pgmap v259: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2023-12-14T18:24:43.704 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:43 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1844956453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:43.704 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:43 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3608778017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:43.704 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:43 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2945124413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:43.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:43.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/1654177162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 msgr2=0x7f4d78100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/1654177162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d78100750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009990 tx=0x7f4d64009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/1654177162 shutdown_connections 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/1654177162 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d78100c90 0x7f4d78107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/1654177162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d780ff110 0x7f4d780ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/1654177162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d78100750 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/1654177162 >> 172.21.15.69:0/1654177162 conn(0x7f4d780fa6f0 msgr2=0x7f4d780fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.826+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/1654177162 shutdown_connections 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/1654177162 wait complete. 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 Processor -- start 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 -- start start 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d780ff110 0x7f4d78068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d7819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d78100c90 0x7f4d7819d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7819da70 con 0x7f4d78100300 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7819dbe0 con 0x7f4d78100c90 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7f1e5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7819dda0 con 0x7f4d780ff110 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d77fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d7819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d77fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d7819ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41032/0 (socket says 172.21.15.69:41032) 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d77fff700 1 -- 172.21.15.69:0/416310555 learned_addr learned my addr 172.21.15.69:0/416310555 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.827+0000 7f4d7d782700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d78100c90 0x7f4d7819d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d7cf81700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d780ff110 0x7f4d78068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d77fff700 1 -- 172.21.15.69:0/416310555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d780ff110 msgr2=0x7f4d78068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d77fff700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d780ff110 0x7f4d78068940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d77fff700 1 -- 172.21.15.69:0/416310555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d78100c90 msgr2=0x7f4d7819d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d77fff700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d78100c90 0x7f4d7819d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d77fff700 1 -- 172.21.15.69:0/416310555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640095f0 con 0x7f4d78100300 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d77fff700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d7819ac90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005f50 tx=0x7f4d640047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6401d070 con 0x7f4d78100300 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7810a950 con 0x7f4d78100300 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d64004810 con 0x7f4d78100300 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64005340 con 0x7f4d78100300 2023-12-14T18:24:43.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.828+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7810a7c0 con 0x7f4d78100300 2023-12-14T18:24:43.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.829+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7819e3a0 con 0x7f4d78100300 2023-12-14T18:24:43.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.830+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4d64004980 con 0x7f4d78100300 2023-12-14T18:24:43.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.831+0000 7f4d75ffb700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d680a11e0 0x7f4d680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:43.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.831+0000 7f4d7cf81700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d680a11e0 0x7f4d680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:43.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.831+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4d640ce060 con 0x7f4d78100300 2023-12-14T18:24:43.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.831+0000 7f4d7cf81700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d680a11e0 0x7f4d680a3690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005950 tx=0x7f4d6c005d10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:43.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:43.834+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4d640976f0 con 0x7f4d78100300 2023-12-14T18:24:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:43 smithi119 ceph-mon[43973]: pgmap v259: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2023-12-14T18:24:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:43 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1844956453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:43 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3608778017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:43 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2945124413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:43 smithi091 ceph-mon[43601]: pgmap v259: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2023-12-14T18:24:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:43 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1844956453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:43 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3608778017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:43 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2945124413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:44.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.027+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d7819ea40 con 0x7f4d78100300 2023-12-14T18:24:44.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.028+0000 7f4d75ffb700 1 -- 172.21.15.69:0/416310555 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f4d6409ad10 con 0x7f4d78100300 2023-12-14T18:24:44.029 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:44.030 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:44.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d680a11e0 msgr2=0x7f4d680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d680a11e0 0x7f4d680a3690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005950 tx=0x7f4d6c005d10 comp rx=0 tx=0).stop 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 msgr2=0x7f4d7819ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d7819ac90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005f50 tx=0x7f4d640047a0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 shutdown_connections 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4d680a11e0 0x7f4d680a3690 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d78100c90 0x7f4d7819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d780ff110 0x7f4d78068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 --2- 172.21.15.69:0/416310555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d78100300 0x7f4d7819ac90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 >> 172.21.15.69:0/416310555 conn(0x7f4d780fa6f0 msgr2=0x7f4d780fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.030+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 shutdown_connections 2023-12-14T18:24:44.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.031+0000 7f4d7f1e5700 1 -- 172.21.15.69:0/416310555 wait complete. 2023-12-14T18:24:44.044 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:44.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:44.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.167+0000 7f6a84996700 1 -- 172.21.15.69:0/170787350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 msgr2=0x7f6a80100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.167+0000 7f6a84996700 1 --2- 172.21.15.69:0/170787350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a80100640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009990 tx=0x7f6a70009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.167+0000 7f6a84996700 1 -- 172.21.15.69:0/170787350 shutdown_connections 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.167+0000 7f6a84996700 1 --2- 172.21.15.69:0/170787350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 0x7f6a80108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.167+0000 7f6a84996700 1 --2- 172.21.15.69:0/170787350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a80100640 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.167+0000 7f6a84996700 1 --2- 172.21.15.69:0/170787350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 0x7f6a80101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- 172.21.15.69:0/170787350 >> 172.21.15.69:0/170787350 conn(0x7f6a800fb850 msgr2=0x7f6a800fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- 172.21.15.69:0/170787350 shutdown_connections 2023-12-14T18:24:44.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- 172.21.15.69:0/170787350 wait complete. 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 Processor -- start 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- start start 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a800748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 0x7f6a80072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 0x7f6a80073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80073bc0 con 0x7f6a80100230 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80073d30 con 0x7f6a80101db0 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.168+0000 7f6a84996700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a801a0010 con 0x7f6a80101420 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a800748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a800748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41062/0 (socket says 172.21.15.69:41062) 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 -- 172.21.15.69:0/2244359646 learned_addr learned my addr 172.21.15.69:0/2244359646 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7dd9b700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 0x7f6a80072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 -- 172.21.15.69:0/2244359646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 msgr2=0x7f6a80072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 0x7f6a80072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 -- 172.21.15.69:0/2244359646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 msgr2=0x7f6a80073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7ed9d700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 0x7f6a80073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 0x7f6a80073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 -- 172.21.15.69:0/2244359646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700095f0 con 0x7f6a80100230 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7dd9b700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 0x7f6a80072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7ed9d700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 0x7f6a80073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a7e59c700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a800748a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a70000c00 tx=0x7f6a70009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7001d070 con 0x7f6a80100230 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a700040b0 con 0x7f6a80100230 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8010bac0 con 0x7f6a80100230 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a70022cb0 con 0x7f6a80100230 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.169+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8010b930 con 0x7f6a80100230 2023-12-14T18:24:44.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.170+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a801a06c0 con 0x7f6a80100230 2023-12-14T18:24:44.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.172+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6a70022470 con 0x7f6a80100230 2023-12-14T18:24:44.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.172+0000 7f6a6f7fe700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a11e0 0x7f6a680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.173+0000 7f6a7dd9b700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a11e0 0x7f6a680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.173+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6a700ce6c0 con 0x7f6a80100230 2023-12-14T18:24:44.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.173+0000 7f6a7dd9b700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a11e0 0x7f6a680a3690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6a74007900 tx=0x7f6a74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:44.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.176+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6a70097cf0 con 0x7f6a80100230 2023-12-14T18:24:44.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.366+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a80107210 con 0x7f6a80100230 2023-12-14T18:24:44.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.366+0000 7f6a6f7fe700 1 -- 172.21.15.69:0/2244359646 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a7009b310 con 0x7f6a80100230 2023-12-14T18:24:44.367 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:44.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a11e0 msgr2=0x7f6a680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a11e0 0x7f6a680a3690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6a74007900 tx=0x7f6a74008040 comp rx=0 tx=0).stop 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 msgr2=0x7f6a800748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a800748a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a70000c00 tx=0x7f6a70009f90 comp rx=0 tx=0).stop 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 shutdown_connections 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6a680a11e0 0x7f6a680a3690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a80101db0 0x7f6a80073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a80100230 0x7f6a800748a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 --2- 172.21.15.69:0/2244359646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a80101420 0x7f6a80072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 >> 172.21.15.69:0/2244359646 conn(0x7f6a800fb850 msgr2=0x7f6a800fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 shutdown_connections 2023-12-14T18:24:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.368+0000 7f6a84996700 1 -- 172.21.15.69:0/2244359646 wait complete. 2023-12-14T18:24:44.381 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 -- 172.21.15.69:0/2023658256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a240fe4d0 msgr2=0x7f8a240fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 --2- 172.21.15.69:0/2023658256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a240fe4d0 0x7f8a240fe8e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009990 tx=0x7f8a14009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 -- 172.21.15.69:0/2023658256 shutdown_connections 2023-12-14T18:24:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 --2- 172.21.15.69:0/2023658256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a24101e30 0x7f8a241086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 --2- 172.21.15.69:0/2023658256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a240fe4d0 0x7f8a240fe8e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 --2- 172.21.15.69:0/2023658256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a241014a0 0x7f8a241018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 -- 172.21.15.69:0/2023658256 >> 172.21.15.69:0/2023658256 conn(0x7f8a240f9ed0 msgr2=0x7f8a240fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 -- 172.21.15.69:0/2023658256 shutdown_connections 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.506+0000 7f8a29b98700 1 -- 172.21.15.69:0/2023658256 wait complete. 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 Processor -- start 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 -- start start 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a240fe4d0 0x7f8a24100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 0x7f8a240ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a24101e30 0x7f8a240ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24100130 con 0x7f8a241014a0 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241002a0 con 0x7f8a240fe4d0 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a29b98700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2419ff60 con 0x7f8a24101e30 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.507+0000 7f8a22ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 0x7f8a240ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 0x7f8a240ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41072/0 (socket says 172.21.15.69:41072) 2023-12-14T18:24:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 -- 172.21.15.69:0/8347488 learned_addr learned my addr 172.21.15.69:0/8347488 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a237fe700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a240fe4d0 0x7f8a24100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a23fff700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a24101e30 0x7f8a240ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 -- 172.21.15.69:0/8347488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a24101e30 msgr2=0x7f8a240ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a24101e30 0x7f8a240ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 -- 172.21.15.69:0/8347488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a240fe4d0 msgr2=0x7f8a24100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a240fe4d0 0x7f8a24100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 -- 172.21.15.69:0/8347488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140095f0 con 0x7f8a241014a0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a22ffd700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 0x7f8a240ff450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800c920 tx=0x7f8a1800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18007b00 con 0x7f8a241014a0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1800ce70 con 0x7f8a241014a0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2410ba30 con 0x7f8a241014a0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18005440 con 0x7f8a241014a0 2023-12-14T18:24:44.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.508+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2410b8a0 con 0x7f8a241014a0 2023-12-14T18:24:44.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.509+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a241a0700 con 0x7f8a241014a0 2023-12-14T18:24:44.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.510+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8a180055a0 con 0x7f8a241014a0 2023-12-14T18:24:44.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.511+0000 7f8a20ff9700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.511+0000 7f8a237fe700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.511+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8a180cc5e0 con 0x7f8a241014a0 2023-12-14T18:24:44.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.511+0000 7f8a237fe700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400b5c0 tx=0x7f8a14005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.515+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8a18095be0 con 0x7f8a241014a0 2023-12-14T18:24:44.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.704+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a241072b0 con 0x7f8a241014a0 2023-12-14T18:24:44.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.705+0000 7f8a20ff9700 1 -- 172.21.15.69:0/8347488 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a18099200 con 0x7f8a241014a0 2023-12-14T18:24:44.705 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:44.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8a0c0a1260 msgr2=0x7f8a0c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400b5c0 tx=0x7f8a14005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 msgr2=0x7f8a240ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 0x7f8a240ff450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800c920 tx=0x7f8a1800cc30 comp rx=0 tx=0).stop 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 shutdown_connections 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8a0c0a1260 0x7f8a0c0a3710 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a24101e30 0x7f8a240ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a240fe4d0 0x7f8a24100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 --2- 172.21.15.69:0/8347488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a241014a0 0x7f8a240ff450 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 >> 172.21.15.69:0/8347488 conn(0x7f8a240f9ed0 msgr2=0x7f8a240fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 shutdown_connections 2023-12-14T18:24:44.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.707+0000 7f8a29b98700 1 -- 172.21.15.69:0/8347488 wait complete. 2023-12-14T18:24:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:44 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3230454723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:44 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/416310555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:44.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:44 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2244359646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:44.720 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 -- 172.21.15.69:0/4075754911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a81035d0 msgr2=0x7f86a81059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 --2- 172.21.15.69:0/4075754911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a81035d0 0x7f86a81059b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8698009990 tx=0x7f8698009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 -- 172.21.15.69:0/4075754911 shutdown_connections 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 --2- 172.21.15.69:0/4075754911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a8105ef0 0x7f86a8108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 --2- 172.21.15.69:0/4075754911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86a8100cb0 0x7f86a8103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 --2- 172.21.15.69:0/4075754911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a81035d0 0x7f86a81059b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 -- 172.21.15.69:0/4075754911 >> 172.21.15.69:0/4075754911 conn(0x7f86a80fa750 msgr2=0x7f86a80fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 -- 172.21.15.69:0/4075754911 shutdown_connections 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 -- 172.21.15.69:0/4075754911 wait complete. 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 Processor -- start 2023-12-14T18:24:44.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.843+0000 7f86b0588700 1 -- start start 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 0x7f86a8195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a81035d0 0x7f86a8196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86a8105ef0 0x7f86a819d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a819d990 con 0x7f86a8100cb0 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a819dad0 con 0x7f86a8105ef0 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a819dc60 con 0x7f86a81035d0 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 0x7f86a8195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 0x7f86a8195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41094/0 (socket says 172.21.15.69:41094) 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 -- 172.21.15.69:0/3108113247 learned_addr learned my addr 172.21.15.69:0/3108113247 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 -- 172.21.15.69:0/3108113247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a81035d0 msgr2=0x7f86a8196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86adb23700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a81035d0 0x7f86a8196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86aeb25700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86a8105ef0 0x7f86a819d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a81035d0 0x7f86a8196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 -- 172.21.15.69:0/3108113247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86a8105ef0 msgr2=0x7f86a819d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86a8105ef0 0x7f86a819d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 -- 172.21.15.69:0/3108113247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86980095f0 con 0x7f86a8100cb0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86adb23700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a81035d0 0x7f86a8196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86ae324700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 0x7f86a8195e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c9b0 tx=0x7f86a400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4007b00 con 0x7f86a8100cb0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a810ba60 con 0x7f86a8100cb0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86a4007c60 con 0x7f86a8100cb0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4018660 con 0x7f86a8100cb0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.844+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a810b8d0 con 0x7f86a8100cb0 2023-12-14T18:24:44.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.845+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a80fc2c0 con 0x7f86a8100cb0 2023-12-14T18:24:44.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.846+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f86a400f450 con 0x7f86a8100cb0 2023-12-14T18:24:44.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.847+0000 7f869f7fe700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f86940a1260 0x7f86940a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:44.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.847+0000 7f86adb23700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f86940a1260 0x7f86940a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:44.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.847+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f86a40ccb80 con 0x7f86a8100cb0 2023-12-14T18:24:44.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.847+0000 7f86adb23700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f86940a1260 0x7f86940a3710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86980095c0 tx=0x7f8698009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:44.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:44.851+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f86a4096120 con 0x7f86a8100cb0 2023-12-14T18:24:44.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:44 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3230454723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:44.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:44 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/416310555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:44.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:44 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2244359646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:44.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:44 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3230454723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:44.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:44 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/416310555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:44.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:44 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2244359646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.042+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86a8061700 con 0x7f86a8100cb0 2023-12-14T18:24:45.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.042+0000 7f869f7fe700 1 -- 172.21.15.69:0/3108113247 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86a4099740 con 0x7f86a8100cb0 2023-12-14T18:24:45.044 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:45.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f86940a1260 msgr2=0x7f86940a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f86940a1260 0x7f86940a3710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86980095c0 tx=0x7f8698009510 comp rx=0 tx=0).stop 2023-12-14T18:24:45.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 msgr2=0x7f86a8195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 0x7f86a8195e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c9b0 tx=0x7f86a400cd70 comp rx=0 tx=0).stop 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 shutdown_connections 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f86940a1260 0x7f86940a3710 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86a8105ef0 0x7f86a819d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86a8100cb0 0x7f86a8195e10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 --2- 172.21.15.69:0/3108113247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a81035d0 0x7f86a8196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 >> 172.21.15.69:0/3108113247 conn(0x7f86a80fa750 msgr2=0x7f86a81019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 shutdown_connections 2023-12-14T18:24:45.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.045+0000 7f86b0588700 1 -- 172.21.15.69:0/3108113247 wait complete. 2023-12-14T18:24:45.058 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-12-14T18:24:45.058 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 -- 172.21.15.69:0/736269687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc0ff110 msgr2=0x7fd1bc0ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 --2- 172.21.15.69:0/736269687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc0ff110 0x7fd1bc0ff520 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009990 tx=0x7fd1b0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 -- 172.21.15.69:0/736269687 shutdown_connections 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 --2- 172.21.15.69:0/736269687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1bc100c90 0x7fd1bc107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 --2- 172.21.15.69:0/736269687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc0ff110 0x7fd1bc0ff520 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 --2- 172.21.15.69:0/736269687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1bc100300 0x7fd1bc100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 -- 172.21.15.69:0/736269687 >> 172.21.15.69:0/736269687 conn(0x7fd1bc0fa6f0 msgr2=0x7fd1bc0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 -- 172.21.15.69:0/736269687 shutdown_connections 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 -- 172.21.15.69:0/736269687 wait complete. 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 Processor -- start 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.179+0000 7fd1c1639700 1 -- start start 2023-12-14T18:24:45.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1bc0ff110 0x7fd1bc1030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1bc100300 0x7fd1bc1016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 0x7fd1bc101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1023c0 con 0x7fd1bc100c90 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc102530 con 0x7fd1bc100300 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc19ff10 con 0x7fd1bc0ff110 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 0x7fd1bc101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 0x7fd1bc101c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41112/0 (socket says 172.21.15.69:41112) 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 -- 172.21.15.69:0/2818499156 learned_addr learned my addr 172.21.15.69:0/2818499156 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1ba7fc700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1bc100300 0x7fd1bc1016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1baffd700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1bc0ff110 0x7fd1bc1030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 -- 172.21.15.69:0/2818499156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1bc0ff110 msgr2=0x7fd1bc1030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1bc0ff110 0x7fd1bc1030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 -- 172.21.15.69:0/2818499156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1bc100300 msgr2=0x7fd1bc1016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1bc100300 0x7fd1bc1016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 -- 172.21.15.69:0/2818499156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b00095f0 con 0x7fd1bc100c90 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1bb7fe700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 0x7fd1bc101c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4007d70 tx=0x7fd1b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400ad40 con 0x7fd1bc100c90 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1b40128b0 con 0x7fd1bc100c90 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40115a0 con 0x7fd1bc100c90 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc10a920 con 0x7fd1bc100c90 2023-12-14T18:24:45.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.180+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc10a790 con 0x7fd1bc100c90 2023-12-14T18:24:45.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.181+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc1a0610 con 0x7fd1bc100c90 2023-12-14T18:24:45.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.182+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd1b4012a20 con 0x7fd1bc100c90 2023-12-14T18:24:45.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.183+0000 7fd1a3fff700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1a40a11e0 0x7fd1a40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.183+0000 7fd1baffd700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1a40a11e0 0x7fd1a40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.183+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd1b40ccfb0 con 0x7fd1bc100c90 2023-12-14T18:24:45.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.183+0000 7fd1baffd700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1a40a11e0 0x7fd1a40a3690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000c010 tx=0x7fd1b000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:45.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.186+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd1b40966c0 con 0x7fd1bc100c90 2023-12-14T18:24:45.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.418+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1bc1a0bc0 con 0x7fd1bc100c90 2023-12-14T18:24:45.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.419+0000 7fd1a3fff700 1 -- 172.21.15.69:0/2818499156 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7fd1b4099ce0 con 0x7fd1bc100c90 2023-12-14T18:24:45.420 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:45.420 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:45.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1a40a11e0 msgr2=0x7fd1a40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1a40a11e0 0x7fd1a40a3690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000c010 tx=0x7fd1b000b540 comp rx=0 tx=0).stop 2023-12-14T18:24:45.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 msgr2=0x7fd1bc101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 0x7fd1bc101c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4007d70 tx=0x7fd1b400a340 comp rx=0 tx=0).stop 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 shutdown_connections 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd1a40a11e0 0x7fd1a40a3690 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc100c90 0x7fd1bc101c20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1bc0ff110 0x7fd1bc1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 --2- 172.21.15.69:0/2818499156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1bc100300 0x7fd1bc1016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 >> 172.21.15.69:0/2818499156 conn(0x7fd1bc0fa6f0 msgr2=0x7fd1bc067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 shutdown_connections 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.421+0000 7fd1c1639700 1 -- 172.21.15.69:0/2818499156 wait complete. 2023-12-14T18:24:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:45.434 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-12-14T18:24:45.434 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-12-14T18:24:45.434 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T18:24:45.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 -- 172.21.15.69:0/998550704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ffd30 msgr2=0x7f5c20107600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 --2- 172.21.15.69:0/998550704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ffd30 0x7f5c20107600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800b0a0 tx=0x7f5c1800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 -- 172.21.15.69:0/998550704 shutdown_connections 2023-12-14T18:24:45.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 --2- 172.21.15.69:0/998550704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ffd30 0x7f5c20107600 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 --2- 172.21.15.69:0/998550704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20100670 0x7f5c20100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 --2- 172.21.15.69:0/998550704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ff3a0 0x7f5c200ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 -- 172.21.15.69:0/998550704 >> 172.21.15.69:0/998550704 conn(0x7f5c200f9e60 msgr2=0x7f5c200fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 -- 172.21.15.69:0/998550704 shutdown_connections 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.556+0000 7f5c278f1700 1 -- 172.21.15.69:0/998550704 wait complete. 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 Processor -- start 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 -- start start 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 0x7f5c20194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ffd30 0x7f5c201953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20100670 0x7f5c2019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2019ca10 con 0x7f5c200ff3a0 2023-12-14T18:24:45.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2019cb50 con 0x7f5c20100670 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c278f1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2019cce0 con 0x7f5c200ffd30 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 0x7f5c20194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 0x7f5c20194e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60780/0 (socket says 172.21.15.69:60780) 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 -- 172.21.15.69:0/1387211403 learned_addr learned my addr 172.21.15.69:0/1387211403 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c25e8e700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20100670 0x7f5c2019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c24e8c700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ffd30 0x7f5c201953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 -- 172.21.15.69:0/1387211403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ffd30 msgr2=0x7f5c201953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ffd30 0x7f5c201953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 -- 172.21.15.69:0/1387211403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20100670 msgr2=0x7f5c2019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.557+0000 7f5c2568d700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20100670 0x7f5c2019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c2568d700 1 -- 172.21.15.69:0/1387211403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c18009d00 con 0x7f5c200ff3a0 2023-12-14T18:24:45.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c24e8c700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ffd30 0x7f5c201953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c2568d700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 0x7f5c20194e90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00d980 tx=0x7f5c1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c004020 con 0x7f5c200ff3a0 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c1c009730 con 0x7f5c200ff3a0 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2010a940 con 0x7f5c200ff3a0 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c003a00 con 0x7f5c200ff3a0 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.558+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2010a7b0 con 0x7f5c200ff3a0 2023-12-14T18:24:45.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.559+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2019d310 con 0x7f5c200ff3a0 2023-12-14T18:24:45.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.561+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5c1c0098a0 con 0x7f5c200ff3a0 2023-12-14T18:24:45.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.561+0000 7f5c127fc700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5c0c0a11e0 0x7f5c0c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.561+0000 7f5c24e8c700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5c0c0a11e0 0x7f5c0c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.561+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c1c0ccab0 con 0x7f5c200ff3a0 2023-12-14T18:24:45.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.562+0000 7f5c24e8c700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5c0c0a11e0 0x7f5c0c0a3690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5c14005fd0 tx=0x7f5c14005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:45.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.565+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5c1c0960b0 con 0x7f5c200ff3a0 2023-12-14T18:24:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:45 smithi069 ceph-mon[42047]: pgmap v260: 97 pgs: 97 active+clean; 637 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-14T18:24:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:45 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/8347488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:45 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3108113247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:45 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2818499156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:45.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.752+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c2019d8c0 con 0x7f5c0c0a11e0 2023-12-14T18:24:45.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.762+0000 7f5c127fc700 1 -- 172.21.15.69:0/1387211403 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344547 (secure 0 0 0) 0x7f5c2019d8c0 con 0x7f5c0c0a11e0 2023-12-14T18:24:45.767 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5c0c0a11e0 msgr2=0x7f5c0c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5c0c0a11e0 0x7f5c0c0a3690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5c14005fd0 tx=0x7f5c14005dc0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 msgr2=0x7f5c20194e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 0x7f5c20194e90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00d980 tx=0x7f5c1c00dc90 comp rx=0 tx=0).stop 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 shutdown_connections 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f5c0c0a11e0 0x7f5c0c0a3690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20100670 0x7f5c2019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c200ff3a0 0x7f5c20194e90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 --2- 172.21.15.69:0/1387211403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c200ffd30 0x7f5c201953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.765+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 >> 172.21.15.69:0/1387211403 conn(0x7f5c200f9e60 msgr2=0x7f5c200fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:45.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.766+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 shutdown_connections 2023-12-14T18:24:45.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.766+0000 7f5c278f1700 1 -- 172.21.15.69:0/1387211403 wait complete. 2023-12-14T18:24:45.772 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:24:45.779 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-12-14T18:24:44.252298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652145,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":562,"num_read_kb":391,"num_write":338,"num_write_kb":3046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80312,"kb_used_data":12376,"kb_used_omap":0,"kb_used_meta":67840,"kb_avail":1124861512,"statfs":{"total":1151940427776,"available":1151858188288,"internally_reserved":0,"allocated":12673024,"data_stored":7069547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69468160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":996,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002976"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529112+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:24:27.529112+0000","last_peered":"2023-12-14T18:24:27.529112+0000","last_clean":"2023-12-14T18:24:27.529112+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:24:27.529112+0000","last_undegraded":"2023-12-14T18:24:27.529112+0000","last_fullsized":"2023-12-14T18:24:27.529112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:35:22.535471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535348+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:24:27.535348+0000","last_peered":"2023-12-14T18:24:27.535348+0000","last_clean":"2023-12-14T18:24:27.535348+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:24:27.535348+0000","last_undegraded":"2023-12-14T18:24:27.535348+0000","last_fullsized":"2023-12-14T18:24:27.535348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:01:48.543705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535187+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:24:27.535187+0000","last_peered":"2023-12-14T18:24:27.535187+0000","last_clean":"2023-12-14T18:24:27.535187+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:24:27.535187+0000","last_undegraded":"2023-12-14T18:24:27.535187+0000","last_fullsized":"2023-12-14T18:24:27.535187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:17:21.027078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555746+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:24:27.555746+0000","last_peered":"2023-12-14T18:24:27.555746+0000","last_clean":"2023-12-14T18:24:27.555746+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:24:27.555746+0000","last_undegraded":"2023-12-14T18:24:27.555746+0000","last_fullsized":"2023-12-14T18:24:27.555746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:42:34.133523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533189+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:24:27.533189+0000","last_peered":"2023-12-14T18:24:27.533189+0000","last_clean":"2023-12-14T18:24:27.533189+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:24:27.533189+0000","last_undegraded":"2023-12-14T18:24:27.533189+0000","last_fullsized":"2023-12-14T18:24:27.533189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:40:27.239993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536376+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:24:27.536376+0000","last_peered":"2023-12-14T18:24:27.536376+0000","last_clean":"2023-12-14T18:24:27.536376+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:24:27.536376+0000","last_undegraded":"2023-12-14T18:24:27.536376+0000","last_fullsized":"2023-12-14T18:24:27.536376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:31:58.835118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532050+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:24:27.532050+0000","last_peered":"2023-12-14T18:24:27.532050+0000","last_clean":"2023-12-14T18:24:27.532050+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:24:27.532050+0000","last_undegraded":"2023-12-14T18:24:27.532050+0000","last_fullsized":"2023-12-14T18:24:27.532050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:06:12.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.559946+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:24:27.559946+0000","last_peered":"2023-12-14T18:24:27.559946+0000","last_clean":"2023-12-14T18:24:27.559946+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:24:27.559946+0000","last_undegraded":"2023-12-14T18:24:27.559946+0000","last_fullsized":"2023-12-14T18:24:27.559946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:23:36.985043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535935+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:24:27.535935+0000","last_peered":"2023-12-14T18:24:27.535935+0000","last_clean":"2023-12-14T18:24:27.535935+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:24:27.535935+0000","last_undegraded":"2023-12-14T18:24:27.535935+0000","last_fullsized":"2023-12-14T18:24:27.535935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:10.966257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536957+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:24:27.536957+0000","last_peered":"2023-12-14T18:24:27.536957+0000","last_clean":"2023-12-14T18:24:27.536957+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:24:27.536957+0000","last_undegraded":"2023-12-14T18:24:27.536957+0000","last_fullsized":"2023-12-14T18:24:27.536957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:41:27.591209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532533+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:24:27.532533+0000","last_peered":"2023-12-14T18:24:27.532533+0000","last_clean":"2023-12-14T18:24:27.532533+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:24:27.532533+0000","last_undegraded":"2023-12-14T18:24:27.532533+0000","last_fullsized":"2023-12-14T18:24:27.532533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:26:31.532135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555678+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:24:27.555678+0000","last_peered":"2023-12-14T18:24:27.555678+0000","last_clean":"2023-12-14T18:24:27.555678+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:24:27.555678+0000","last_undegraded":"2023-12-14T18:24:27.555678+0000","last_fullsized":"2023-12-14T18:24:27.555678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:33:08.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528916+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:24:27.528916+0000","last_peered":"2023-12-14T18:24:27.528916+0000","last_clean":"2023-12-14T18:24:27.528916+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:24:27.528916+0000","last_undegraded":"2023-12-14T18:24:27.528916+0000","last_fullsized":"2023-12-14T18:24:27.528916+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:08:40.131918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534759+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:24:27.534759+0000","last_peered":"2023-12-14T18:24:27.534759+0000","last_clean":"2023-12-14T18:24:27.534759+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:24:27.534759+0000","last_undegraded":"2023-12-14T18:24:27.534759+0000","last_fullsized":"2023-12-14T18:24:27.534759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:40:39.187953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534875+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:24:27.534875+0000","last_peered":"2023-12-14T18:24:27.534875+0000","last_clean":"2023-12-14T18:24:27.534875+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:24:27.534875+0000","last_undegraded":"2023-12-14T18:24:27.534875+0000","last_fullsized":"2023-12-14T18:24:27.534875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:27.841273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536144+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:24:27.536144+0000","last_peered":"2023-12-14T18:24:27.536144+0000","last_clean":"2023-12-14T18:24:27.536144+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:24:27.536144+0000","last_undegraded":"2023-12-14T18:24:27.536144+0000","last_fullsized":"2023-12-14T18:24:27.536144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:28.177172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529520+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:24:27.529520+0000","last_peered":"2023-12-14T18:24:27.529520+0000","last_clean":"2023-12-14T18:24:27.529520+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:24:27.529520+0000","last_undegraded":"2023-12-14T18:24:27.529520+0000","last_fullsized":"2023-12-14T18:24:27.529520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:22:30.580736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561675+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:24:27.561675+0000","last_peered":"2023-12-14T18:24:27.561675+0000","last_clean":"2023-12-14T18:24:27.561675+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:24:27.561675+0000","last_undegraded":"2023-12-14T18:24:27.561675+0000","last_fullsized":"2023-12-14T18:24:27.561675+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:04:12.332074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.563560+0000","last_change":"2023-12-14T18:24:27.563560+0000","last_active":"2023-12-14T18:24:27.563560+0000","last_peered":"2023-12-14T18:24:27.563560+0000","last_clean":"2023-12-14T18:24:27.563560+0000","last_became_active":"2023-12-14T18:24:27.563118+0000","last_became_peered":"2023-12-14T18:24:27.563118+0000","last_unstale":"2023-12-14T18:24:27.563560+0000","last_undegraded":"2023-12-14T18:24:27.563560+0000","last_fullsized":"2023-12-14T18:24:27.563560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:20:45.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561467+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:24:27.561467+0000","last_peered":"2023-12-14T18:24:27.561467+0000","last_clean":"2023-12-14T18:24:27.561467+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:24:27.561467+0000","last_undegraded":"2023-12-14T18:24:27.561467+0000","last_fullsized":"2023-12-14T18:24:27.561467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:50:02.283701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560240+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:24:27.560240+0000","last_peered":"2023-12-14T18:24:27.560240+0000","last_clean":"2023-12-14T18:24:27.560240+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:24:27.560240+0000","last_undegraded":"2023-12-14T18:24:27.560240+0000","last_fullsized":"2023-12-14T18:24:27.560240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:14:39.907047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560505+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:24:27.560505+0000","last_peered":"2023-12-14T18:24:27.560505+0000","last_clean":"2023-12-14T18:24:27.560505+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:24:27.560505+0000","last_undegraded":"2023-12-14T18:24:27.560505+0000","last_fullsized":"2023-12-14T18:24:27.560505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:00:00.837375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535637+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:24:27.535637+0000","last_peered":"2023-12-14T18:24:27.535637+0000","last_clean":"2023-12-14T18:24:27.535637+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:24:27.535637+0000","last_undegraded":"2023-12-14T18:24:27.535637+0000","last_fullsized":"2023-12-14T18:24:27.535637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:10:53.681088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532807+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:24:27.532807+0000","last_peered":"2023-12-14T18:24:27.532807+0000","last_clean":"2023-12-14T18:24:27.532807+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:24:27.532807+0000","last_undegraded":"2023-12-14T18:24:27.532807+0000","last_fullsized":"2023-12-14T18:24:27.532807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:03.464928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535948+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:24:27.535948+0000","last_peered":"2023-12-14T18:24:27.535948+0000","last_clean":"2023-12-14T18:24:27.535948+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:24:27.535948+0000","last_undegraded":"2023-12-14T18:24:27.535948+0000","last_fullsized":"2023-12-14T18:24:27.535948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:10:23.147937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533324+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:24:27.533324+0000","last_peered":"2023-12-14T18:24:27.533324+0000","last_clean":"2023-12-14T18:24:27.533324+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:24:27.533324+0000","last_undegraded":"2023-12-14T18:24:27.533324+0000","last_fullsized":"2023-12-14T18:24:27.533324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:25:58.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534020+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:24:27.534020+0000","last_peered":"2023-12-14T18:24:27.534020+0000","last_clean":"2023-12-14T18:24:27.534020+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:24:27.534020+0000","last_undegraded":"2023-12-14T18:24:27.534020+0000","last_fullsized":"2023-12-14T18:24:27.534020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:56.771730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:38.442825+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:24:38.442825+0000","last_peered":"2023-12-14T18:24:38.442825+0000","last_clean":"2023-12-14T18:24:38.442825+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:24:38.442825+0000","last_undegraded":"2023-12-14T18:24:38.442825+0000","last_fullsized":"2023-12-14T18:24:38.442825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:52.453205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532409+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:24:27.532409+0000","last_peered":"2023-12-14T18:24:27.532409+0000","last_clean":"2023-12-14T18:24:27.532409+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:24:27.532409+0000","last_undegraded":"2023-12-14T18:24:27.532409+0000","last_fullsized":"2023-12-14T18:24:27.532409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:55:03.964494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536287+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:24:27.536287+0000","last_peered":"2023-12-14T18:24:27.536287+0000","last_clean":"2023-12-14T18:24:27.536287+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:24:27.536287+0000","last_undegraded":"2023-12-14T18:24:27.536287+0000","last_fullsized":"2023-12-14T18:24:27.536287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:03:08.981315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562217+0000","last_change":"2023-12-14T18:24:27.562217+0000","last_active":"2023-12-14T18:24:27.562217+0000","last_peered":"2023-12-14T18:24:27.562217+0000","last_clean":"2023-12-14T18:24:27.562217+0000","last_became_active":"2023-12-14T18:24:27.561910+0000","last_became_peered":"2023-12-14T18:24:27.561910+0000","last_unstale":"2023-12-14T18:24:27.562217+0000","last_undegraded":"2023-12-14T18:24:27.562217+0000","last_fullsized":"2023-12-14T18:24:27.562217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:15.952432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528487+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:24:27.528487+0000","last_peered":"2023-12-14T18:24:27.528487+0000","last_clean":"2023-12-14T18:24:27.528487+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:24:27.528487+0000","last_undegraded":"2023-12-14T18:24:27.528487+0000","last_fullsized":"2023-12-14T18:24:27.528487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:36:08.840200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.559905+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:24:27.559905+0000","last_peered":"2023-12-14T18:24:27.559905+0000","last_clean":"2023-12-14T18:24:27.559905+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:24:27.559905+0000","last_undegraded":"2023-12-14T18:24:27.559905+0000","last_fullsized":"2023-12-14T18:24:27.559905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:45:55.543091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533853+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:24:27.533853+0000","last_peered":"2023-12-14T18:24:27.533853+0000","last_clean":"2023-12-14T18:24:27.533853+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:24:27.533853+0000","last_undegraded":"2023-12-14T18:24:27.533853+0000","last_fullsized":"2023-12-14T18:24:27.533853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:11.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561061+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:24:27.561061+0000","last_peered":"2023-12-14T18:24:27.561061+0000","last_clean":"2023-12-14T18:24:27.561061+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:24:27.561061+0000","last_undegraded":"2023-12-14T18:24:27.561061+0000","last_fullsized":"2023-12-14T18:24:27.561061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:26.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.631472+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:24:41.631472+0000","last_peered":"2023-12-14T18:24:41.631472+0000","last_clean":"2023-12-14T18:24:41.631472+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:24:41.631472+0000","last_undegraded":"2023-12-14T18:24:41.631472+0000","last_fullsized":"2023-12-14T18:24:41.631472+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:16:02.732524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536065+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:24:27.536065+0000","last_peered":"2023-12-14T18:24:27.536065+0000","last_clean":"2023-12-14T18:24:27.536065+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:24:27.536065+0000","last_undegraded":"2023-12-14T18:24:27.536065+0000","last_fullsized":"2023-12-14T18:24:27.536065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:00.967006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532412+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:24:27.532412+0000","last_peered":"2023-12-14T18:24:27.532412+0000","last_clean":"2023-12-14T18:24:27.532412+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:24:27.532412+0000","last_undegraded":"2023-12-14T18:24:27.532412+0000","last_fullsized":"2023-12-14T18:24:27.532412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:42:11.413770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535557+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:24:27.535557+0000","last_peered":"2023-12-14T18:24:27.535557+0000","last_clean":"2023-12-14T18:24:27.535557+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:24:27.535557+0000","last_undegraded":"2023-12-14T18:24:27.535557+0000","last_fullsized":"2023-12-14T18:24:27.535557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:39.663568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534139+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:24:27.534139+0000","last_peered":"2023-12-14T18:24:27.534139+0000","last_clean":"2023-12-14T18:24:27.534139+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:24:27.534139+0000","last_undegraded":"2023-12-14T18:24:27.534139+0000","last_fullsized":"2023-12-14T18:24:27.534139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:45:31.922598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.539577+0000","last_change":"2023-12-14T18:24:27.539577+0000","last_active":"2023-12-14T18:24:27.539577+0000","last_peered":"2023-12-14T18:24:27.539577+0000","last_clean":"2023-12-14T18:24:27.539577+0000","last_became_active":"2023-12-14T18:24:27.539242+0000","last_became_peered":"2023-12-14T18:24:27.539242+0000","last_unstale":"2023-12-14T18:24:27.539577+0000","last_undegraded":"2023-12-14T18:24:27.539577+0000","last_fullsized":"2023-12-14T18:24:27.539577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:34:30.632737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":194,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:42.448268+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:24:42.448268+0000","last_peered":"2023-12-14T18:24:42.448268+0000","last_clean":"2023-12-14T18:24:42.448268+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:24:42.448268+0000","last_undegraded":"2023-12-14T18:24:42.448268+0000","last_fullsized":"2023-12-14T18:24:42.448268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:22:43.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56739,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":127,"num_write":30,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532535+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:24:27.532535+0000","last_peered":"2023-12-14T18:24:27.532535+0000","last_clean":"2023-12-14T18:24:27.532535+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:24:27.532535+0000","last_undegraded":"2023-12-14T18:24:27.532535+0000","last_fullsized":"2023-12-14T18:24:27.532535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:50:34.809496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531111+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:24:27.531111+0000","last_peered":"2023-12-14T18:24:27.531111+0000","last_clean":"2023-12-14T18:24:27.531111+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:24:27.531111+0000","last_undegraded":"2023-12-14T18:24:27.531111+0000","last_fullsized":"2023-12-14T18:24:27.531111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:13.079718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528595+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:24:27.528595+0000","last_peered":"2023-12-14T18:24:27.528595+0000","last_clean":"2023-12-14T18:24:27.528595+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:24:27.528595+0000","last_undegraded":"2023-12-14T18:24:27.528595+0000","last_fullsized":"2023-12-14T18:24:27.528595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:29:03.280859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534235+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:24:27.534235+0000","last_peered":"2023-12-14T18:24:27.534235+0000","last_clean":"2023-12-14T18:24:27.534235+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:24:27.534235+0000","last_undegraded":"2023-12-14T18:24:27.534235+0000","last_fullsized":"2023-12-14T18:24:27.534235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:19:31.264438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532288+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:24:27.532288+0000","last_peered":"2023-12-14T18:24:27.532288+0000","last_clean":"2023-12-14T18:24:27.532288+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:24:27.532288+0000","last_undegraded":"2023-12-14T18:24:27.532288+0000","last_fullsized":"2023-12-14T18:24:27.532288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:38:34.519741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.447138+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:24:41.447138+0000","last_peered":"2023-12-14T18:24:41.447138+0000","last_clean":"2023-12-14T18:24:41.447138+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:24:41.447138+0000","last_undegraded":"2023-12-14T18:24:41.447138+0000","last_fullsized":"2023-12-14T18:24:41.447138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:11:49.660705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532257+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:24:27.532257+0000","last_peered":"2023-12-14T18:24:27.532257+0000","last_clean":"2023-12-14T18:24:27.532257+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:24:27.532257+0000","last_undegraded":"2023-12-14T18:24:27.532257+0000","last_fullsized":"2023-12-14T18:24:27.532257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:19:36.503753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:28.746333+0000","last_change":"2023-12-14T18:24:28.746333+0000","last_active":"2023-12-14T18:24:28.746333+0000","last_peered":"2023-12-14T18:24:28.746333+0000","last_clean":"2023-12-14T18:24:28.746333+0000","last_became_active":"2023-12-14T18:24:27.556325+0000","last_became_peered":"2023-12-14T18:24:27.556325+0000","last_unstale":"2023-12-14T18:24:28.746333+0000","last_undegraded":"2023-12-14T18:24:28.746333+0000","last_fullsized":"2023-12-14T18:24:28.746333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:56.847744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534120+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:24:27.534120+0000","last_peered":"2023-12-14T18:24:27.534120+0000","last_clean":"2023-12-14T18:24:27.534120+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:24:27.534120+0000","last_undegraded":"2023-12-14T18:24:27.534120+0000","last_fullsized":"2023-12-14T18:24:27.534120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:25:22.539914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532250+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:24:27.532250+0000","last_peered":"2023-12-14T18:24:27.532250+0000","last_clean":"2023-12-14T18:24:27.532250+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:24:27.532250+0000","last_undegraded":"2023-12-14T18:24:27.532250+0000","last_fullsized":"2023-12-14T18:24:27.532250+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:02.582193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529390+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:24:27.529390+0000","last_peered":"2023-12-14T18:24:27.529390+0000","last_clean":"2023-12-14T18:24:27.529390+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:24:27.529390+0000","last_undegraded":"2023-12-14T18:24:27.529390+0000","last_fullsized":"2023-12-14T18:24:27.529390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.966158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561638+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:24:27.561638+0000","last_peered":"2023-12-14T18:24:27.561638+0000","last_clean":"2023-12-14T18:24:27.561638+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:24:27.561638+0000","last_undegraded":"2023-12-14T18:24:27.561638+0000","last_fullsized":"2023-12-14T18:24:27.561638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:42:22.636519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536801+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:24:27.536801+0000","last_peered":"2023-12-14T18:24:27.536801+0000","last_clean":"2023-12-14T18:24:27.536801+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:24:27.536801+0000","last_undegraded":"2023-12-14T18:24:27.536801+0000","last_fullsized":"2023-12-14T18:24:27.536801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:49:55.072660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532205+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:24:27.532205+0000","last_peered":"2023-12-14T18:24:27.532205+0000","last_clean":"2023-12-14T18:24:27.532205+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:24:27.532205+0000","last_undegraded":"2023-12-14T18:24:27.532205+0000","last_fullsized":"2023-12-14T18:24:27.532205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:55:48.946039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536575+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:24:27.536575+0000","last_peered":"2023-12-14T18:24:27.536575+0000","last_clean":"2023-12-14T18:24:27.536575+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:24:27.536575+0000","last_undegraded":"2023-12-14T18:24:27.536575+0000","last_fullsized":"2023-12-14T18:24:27.536575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:14:52.816044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534000+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:24:27.534000+0000","last_peered":"2023-12-14T18:24:27.534000+0000","last_clean":"2023-12-14T18:24:27.534000+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:24:27.534000+0000","last_undegraded":"2023-12-14T18:24:27.534000+0000","last_fullsized":"2023-12-14T18:24:27.534000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:40.832565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.446322+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:24:41.446322+0000","last_peered":"2023-12-14T18:24:41.446322+0000","last_clean":"2023-12-14T18:24:41.446322+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:24:41.446322+0000","last_undegraded":"2023-12-14T18:24:41.446322+0000","last_fullsized":"2023-12-14T18:24:41.446322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:47.779283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560400+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:24:27.560400+0000","last_peered":"2023-12-14T18:24:27.560400+0000","last_clean":"2023-12-14T18:24:27.560400+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:24:27.560400+0000","last_undegraded":"2023-12-14T18:24:27.560400+0000","last_fullsized":"2023-12-14T18:24:27.560400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:23:08.619045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555375+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:24:27.555375+0000","last_peered":"2023-12-14T18:24:27.555375+0000","last_clean":"2023-12-14T18:24:27.555375+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:24:27.555375+0000","last_undegraded":"2023-12-14T18:24:27.555375+0000","last_fullsized":"2023-12-14T18:24:27.555375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:27:02.067811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532339+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:24:27.532339+0000","last_peered":"2023-12-14T18:24:27.532339+0000","last_clean":"2023-12-14T18:24:27.532339+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:24:27.532339+0000","last_undegraded":"2023-12-14T18:24:27.532339+0000","last_fullsized":"2023-12-14T18:24:27.532339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:45:40.168142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528334+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:24:27.528334+0000","last_peered":"2023-12-14T18:24:27.528334+0000","last_clean":"2023-12-14T18:24:27.528334+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:24:27.528334+0000","last_undegraded":"2023-12-14T18:24:27.528334+0000","last_fullsized":"2023-12-14T18:24:27.528334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:39.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532437+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:24:27.532437+0000","last_peered":"2023-12-14T18:24:27.532437+0000","last_clean":"2023-12-14T18:24:27.532437+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:24:27.532437+0000","last_undegraded":"2023-12-14T18:24:27.532437+0000","last_fullsized":"2023-12-14T18:24:27.532437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:01:50.837514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532619+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:24:27.532619+0000","last_peered":"2023-12-14T18:24:27.532619+0000","last_clean":"2023-12-14T18:24:27.532619+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:24:27.532619+0000","last_undegraded":"2023-12-14T18:24:27.532619+0000","last_fullsized":"2023-12-14T18:24:27.532619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:30:57.298364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528633+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:24:27.528633+0000","last_peered":"2023-12-14T18:24:27.528633+0000","last_clean":"2023-12-14T18:24:27.528633+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:24:27.528633+0000","last_undegraded":"2023-12-14T18:24:27.528633+0000","last_fullsized":"2023-12-14T18:24:27.528633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:45:38.005408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561525+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:24:27.561525+0000","last_peered":"2023-12-14T18:24:27.561525+0000","last_clean":"2023-12-14T18:24:27.561525+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:24:27.561525+0000","last_undegraded":"2023-12-14T18:24:27.561525+0000","last_fullsized":"2023-12-14T18:24:27.561525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:26:30.989444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560724+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:24:27.560724+0000","last_peered":"2023-12-14T18:24:27.560724+0000","last_clean":"2023-12-14T18:24:27.560724+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:24:27.560724+0000","last_undegraded":"2023-12-14T18:24:27.560724+0000","last_fullsized":"2023-12-14T18:24:27.560724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:50:35.528934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555511+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:24:27.555511+0000","last_peered":"2023-12-14T18:24:27.555511+0000","last_clean":"2023-12-14T18:24:27.555511+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:24:27.555511+0000","last_undegraded":"2023-12-14T18:24:27.555511+0000","last_fullsized":"2023-12-14T18:24:27.555511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:46.296842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535414+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:24:27.535414+0000","last_peered":"2023-12-14T18:24:27.535414+0000","last_clean":"2023-12-14T18:24:27.535414+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:24:27.535414+0000","last_undegraded":"2023-12-14T18:24:27.535414+0000","last_fullsized":"2023-12-14T18:24:27.535414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:44:49.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.542103+0000","last_change":"2023-12-14T18:24:27.542103+0000","last_active":"2023-12-14T18:24:27.542103+0000","last_peered":"2023-12-14T18:24:27.542103+0000","last_clean":"2023-12-14T18:24:27.542103+0000","last_became_active":"2023-12-14T18:24:27.539409+0000","last_became_peered":"2023-12-14T18:24:27.539409+0000","last_unstale":"2023-12-14T18:24:27.542103+0000","last_undegraded":"2023-12-14T18:24:27.542103+0000","last_fullsized":"2023-12-14T18:24:27.542103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:01:43.400341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532153+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:24:27.532153+0000","last_peered":"2023-12-14T18:24:27.532153+0000","last_clean":"2023-12-14T18:24:27.532153+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:24:27.532153+0000","last_undegraded":"2023-12-14T18:24:27.532153+0000","last_fullsized":"2023-12-14T18:24:27.532153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:59:43.609677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560282+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:24:27.560282+0000","last_peered":"2023-12-14T18:24:27.560282+0000","last_clean":"2023-12-14T18:24:27.560282+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:24:27.560282+0000","last_undegraded":"2023-12-14T18:24:27.560282+0000","last_fullsized":"2023-12-14T18:24:27.560282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:47:08.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528956+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:24:27.528956+0000","last_peered":"2023-12-14T18:24:27.528956+0000","last_clean":"2023-12-14T18:24:27.528956+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:24:27.528956+0000","last_undegraded":"2023-12-14T18:24:27.528956+0000","last_fullsized":"2023-12-14T18:24:27.528956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:39.402213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530959+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:24:27.530959+0000","last_peered":"2023-12-14T18:24:27.530959+0000","last_clean":"2023-12-14T18:24:27.530959+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:24:27.530959+0000","last_undegraded":"2023-12-14T18:24:27.530959+0000","last_fullsized":"2023-12-14T18:24:27.530959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:42:38.930855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561164+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:24:27.561164+0000","last_peered":"2023-12-14T18:24:27.561164+0000","last_clean":"2023-12-14T18:24:27.561164+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:24:27.561164+0000","last_undegraded":"2023-12-14T18:24:27.561164+0000","last_fullsized":"2023-12-14T18:24:27.561164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:53:59.350009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.547378+0000","last_change":"2023-12-14T18:24:27.547378+0000","last_active":"2023-12-14T18:24:27.547378+0000","last_peered":"2023-12-14T18:24:27.547378+0000","last_clean":"2023-12-14T18:24:27.547378+0000","last_became_active":"2023-12-14T18:24:27.535734+0000","last_became_peered":"2023-12-14T18:24:27.535734+0000","last_unstale":"2023-12-14T18:24:27.547378+0000","last_undegraded":"2023-12-14T18:24:27.547378+0000","last_fullsized":"2023-12-14T18:24:27.547378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:17:22.214140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532552+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:24:27.532552+0000","last_peered":"2023-12-14T18:24:27.532552+0000","last_clean":"2023-12-14T18:24:27.532552+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:24:27.532552+0000","last_undegraded":"2023-12-14T18:24:27.532552+0000","last_fullsized":"2023-12-14T18:24:27.532552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:51:12.692007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531307+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:24:27.531307+0000","last_peered":"2023-12-14T18:24:27.531307+0000","last_clean":"2023-12-14T18:24:27.531307+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:24:27.531307+0000","last_undegraded":"2023-12-14T18:24:27.531307+0000","last_fullsized":"2023-12-14T18:24:27.531307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:32:01.037894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532576+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:24:27.532576+0000","last_peered":"2023-12-14T18:24:27.532576+0000","last_clean":"2023-12-14T18:24:27.532576+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:24:27.532576+0000","last_undegraded":"2023-12-14T18:24:27.532576+0000","last_fullsized":"2023-12-14T18:24:27.532576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:45:15.897361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533886+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:24:27.533886+0000","last_peered":"2023-12-14T18:24:27.533886+0000","last_clean":"2023-12-14T18:24:27.533886+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:24:27.533886+0000","last_undegraded":"2023-12-14T18:24:27.533886+0000","last_fullsized":"2023-12-14T18:24:27.533886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:11:10.311368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532158+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:24:27.532158+0000","last_peered":"2023-12-14T18:24:27.532158+0000","last_clean":"2023-12-14T18:24:27.532158+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:24:27.532158+0000","last_undegraded":"2023-12-14T18:24:27.532158+0000","last_fullsized":"2023-12-14T18:24:27.532158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:21:43.570678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528716+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:24:27.528716+0000","last_peered":"2023-12-14T18:24:27.528716+0000","last_clean":"2023-12-14T18:24:27.528716+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:24:27.528716+0000","last_undegraded":"2023-12-14T18:24:27.528716+0000","last_fullsized":"2023-12-14T18:24:27.528716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:26:45.633939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532451+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:24:27.532451+0000","last_peered":"2023-12-14T18:24:27.532451+0000","last_clean":"2023-12-14T18:24:27.532451+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:24:27.532451+0000","last_undegraded":"2023-12-14T18:24:27.532451+0000","last_fullsized":"2023-12-14T18:24:27.532451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:20:05.461484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562369+0000","last_change":"2023-12-14T18:24:27.562369+0000","last_active":"2023-12-14T18:24:27.562369+0000","last_peered":"2023-12-14T18:24:27.562369+0000","last_clean":"2023-12-14T18:24:27.562369+0000","last_became_active":"2023-12-14T18:24:27.561659+0000","last_became_peered":"2023-12-14T18:24:27.561659+0000","last_unstale":"2023-12-14T18:24:27.562369+0000","last_undegraded":"2023-12-14T18:24:27.562369+0000","last_fullsized":"2023-12-14T18:24:27.562369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:50.423823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530858+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:24:27.530858+0000","last_peered":"2023-12-14T18:24:27.530858+0000","last_clean":"2023-12-14T18:24:27.530858+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:24:27.530858+0000","last_undegraded":"2023-12-14T18:24:27.530858+0000","last_fullsized":"2023-12-14T18:24:27.530858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:16:07.611838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530870+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:24:27.530870+0000","last_peered":"2023-12-14T18:24:27.530870+0000","last_clean":"2023-12-14T18:24:27.530870+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:24:27.530870+0000","last_undegraded":"2023-12-14T18:24:27.530870+0000","last_fullsized":"2023-12-14T18:24:27.530870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:28:50.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534826+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:24:27.534826+0000","last_peered":"2023-12-14T18:24:27.534826+0000","last_clean":"2023-12-14T18:24:27.534826+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:24:27.534826+0000","last_undegraded":"2023-12-14T18:24:27.534826+0000","last_fullsized":"2023-12-14T18:24:27.534826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:37.707737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528746+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:24:27.528746+0000","last_peered":"2023-12-14T18:24:27.528746+0000","last_clean":"2023-12-14T18:24:27.528746+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:24:27.528746+0000","last_undegraded":"2023-12-14T18:24:27.528746+0000","last_fullsized":"2023-12-14T18:24:27.528746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:12.147192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529374+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:24:27.529374+0000","last_peered":"2023-12-14T18:24:27.529374+0000","last_clean":"2023-12-14T18:24:27.529374+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:24:27.529374+0000","last_undegraded":"2023-12-14T18:24:27.529374+0000","last_fullsized":"2023-12-14T18:24:27.529374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:10.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531482+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:24:27.531482+0000","last_peered":"2023-12-14T18:24:27.531482+0000","last_clean":"2023-12-14T18:24:27.531482+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:24:27.531482+0000","last_undegraded":"2023-12-14T18:24:27.531482+0000","last_fullsized":"2023-12-14T18:24:27.531482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:57:46.031281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560613+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:24:27.560613+0000","last_peered":"2023-12-14T18:24:27.560613+0000","last_clean":"2023-12-14T18:24:27.560613+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:24:27.560613+0000","last_undegraded":"2023-12-14T18:24:27.560613+0000","last_fullsized":"2023-12-14T18:24:27.560613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:52.934323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533876+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:24:27.533876+0000","last_peered":"2023-12-14T18:24:27.533876+0000","last_clean":"2023-12-14T18:24:27.533876+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:24:27.533876+0000","last_undegraded":"2023-12-14T18:24:27.533876+0000","last_fullsized":"2023-12-14T18:24:27.533876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:53:45.243792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560150+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:24:27.560150+0000","last_peered":"2023-12-14T18:24:27.560150+0000","last_clean":"2023-12-14T18:24:27.560150+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:24:27.560150+0000","last_undegraded":"2023-12-14T18:24:27.560150+0000","last_fullsized":"2023-12-14T18:24:27.560150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:40.898333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535736+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:24:27.535736+0000","last_peered":"2023-12-14T18:24:27.535736+0000","last_clean":"2023-12-14T18:24:27.535736+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:24:27.535736+0000","last_undegraded":"2023-12-14T18:24:27.535736+0000","last_fullsized":"2023-12-14T18:24:27.535736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:43:41.122487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528954+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:24:27.528954+0000","last_peered":"2023-12-14T18:24:27.528954+0000","last_clean":"2023-12-14T18:24:27.528954+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:24:27.528954+0000","last_undegraded":"2023-12-14T18:24:27.528954+0000","last_fullsized":"2023-12-14T18:24:27.528954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:42.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562048+0000","last_change":"2023-12-14T18:24:27.562048+0000","last_active":"2023-12-14T18:24:27.562048+0000","last_peered":"2023-12-14T18:24:27.562048+0000","last_clean":"2023-12-14T18:24:27.562048+0000","last_became_active":"2023-12-14T18:24:27.561655+0000","last_became_peered":"2023-12-14T18:24:27.561655+0000","last_unstale":"2023-12-14T18:24:27.562048+0000","last_undegraded":"2023-12-14T18:24:27.562048+0000","last_fullsized":"2023-12-14T18:24:27.562048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:42:53.330004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61531,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":436,"num_read_kb":282,"num_write":155,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":187917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5984,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739168,"statfs":{"total":95995035648,"available":95988908032,"internally_reserved":0,"allocated":876544,"data_stored":426808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.88400000000000001}]},{"osd":8,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89400000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":0.872},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":9.1150000000000002,"5min":9.1150000000000002,"15min":9.1150000000000002},"last":0.94199999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.90700000000000003}]}]},{"osd":10,"up_from":67,"seq":287762808860,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6912,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738240,"statfs":{"total":95995035648,"available":95987957760,"internally_reserved":0,"allocated":1564672,"data_stored":1075543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.44},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61199999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.45200000000000001},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.505},{"interface":"front","average":{"1min":0.63,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.51200000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.54200000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97099999999999997,"5min":1.014,"15min":1.014},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.052},"last":0.62},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.72399999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.022,"5min":1.073,"15min":1.073},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.69799999999999995,"15min":0.68799999999999994},"min":{"1min":0.60299999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98999999999999999,"5min":1.034,"15min":1.034},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85299999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.81499999999999995}]}]},{"osd":9,"up_from":62,"seq":266287972384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6128,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93739024,"statfs":{"total":95995035648,"available":95988760576,"internally_reserved":0,"allocated":892928,"data_stored":427044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71499999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.499}]},{"osd":2,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58699999999999997,"15min":0.60099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79900000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":1.163,"15min":1.163},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.49399999999999999,"15min":0.51500000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61699999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65600000000000003,"15min":0.67400000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":0.877,"15min":0.877},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84199999999999997,"5min":1.236,"15min":1.236},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.024,"15min":1.024},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73399999999999999,"5min":1.331,"15min":1.331},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91500000000000004,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.56699999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.59199999999999997}]}]},{"osd":8,"up_from":55,"seq":236223201316,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6320,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738832,"statfs":{"total":95995035648,"available":95988563968,"internally_reserved":0,"allocated":892928,"data_stored":426964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.623}]},{"osd":1,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.877,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88400000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95699999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.753}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.76000000000000001,"15min":0.74399999999999999},"min":{"1min":0.75,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.73899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81899999999999995}]}]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6900,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738252,"statfs":{"total":95995035648,"available":95987970048,"internally_reserved":0,"allocated":1486848,"data_stored":1019193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.434},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82199999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.622,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41299999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93400000000000005,"5min":1.986,"15min":1.986},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85399999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78800000000000003}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76800000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6244,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738908,"statfs":{"total":95995035648,"available":95988641792,"internally_reserved":0,"allocated":880640,"data_stored":426439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41399999999999998,"15min":0.41699999999999998},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.70699999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80600000000000005,"5min":0.872,"15min":0.872},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:24:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Dec 14 18:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.77600000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7324,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737828,"statfs":{"total":95995035648,"available":95987535872,"internally_reserved":0,"allocated":937984,"data_stored":482965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.52900000000000003,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.19,"15min":0.19},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.46000000000000002},"min":{"1min":0.38900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.70399999999999996,"5min":0.87,"15min":0.87},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.50800000000000001},"min":{"1min":0.42399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80900000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.745},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54000000000000004,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78600000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.60799999999999998,"15min":0.56200000000000006},"min":{"1min":0.39000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.57399999999999995,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4809999999999999,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.44}]},{"osd":4,"last update":"Thu Dec 14 18:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80100000000000005,"5min":0.878,"15min":0.878},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.77200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83899999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.65400000000000003,"15min":0.60799999999999998},"min":{"1min":0.501,"5min":0.373,"15min":0.373},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.70399999999999996,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":0.995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95399999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.753,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.3099999999999996,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.625},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.75900000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.3380000000000001,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:24:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76700000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7160,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737992,"statfs":{"total":95995035648,"available":95987703808,"internally_reserved":0,"allocated":901120,"data_stored":427704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.46400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.51300000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.39500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.627,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.496,"15min":0.52000000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.54700000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36399999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71299999999999997,"5min":0.876,"15min":0.876},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50600000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.61599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67100000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.44600000000000001}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74199999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.754,"5min":0.876,"15min":0.876},"last":0.622}]},{"osd":11,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53600000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411384,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7400,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737752,"statfs":{"total":95995035648,"available":95987458048,"internally_reserved":0,"allocated":950272,"data_stored":483774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70399999999999996,"5min":0.747,"15min":0.747},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48799999999999999,"15min":0.47799999999999998},"min":{"1min":0.40000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.52400000000000002,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65600000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.501}]},{"osd":4,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.45600000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.62},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77900000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64600000000000002}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81699999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Dec 14 18:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63300000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":426756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.33600000000000002},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.495,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60099999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.496}]},{"osd":6,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59799999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.437},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.621,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":10,"last update":"Thu Dec 14 18:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.80800000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]},{"osd":11,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.624},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56499999999999995}]}]},{"osd":4,"up_from":31,"seq":133143986226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6384,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738768,"statfs":{"total":95995035648,"available":95988498432,"internally_reserved":0,"allocated":892928,"data_stored":427822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.376,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38,"15min":0.37},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.373,"15min":0.373},"max":{"1min":0.875,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55100000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.755}]},{"osd":9,"last update":"Thu Dec 14 18:24:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.53900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.56799999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":1.008,"15min":1.008},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.62,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77700000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.80100000000000005}]}]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7040,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738112,"statfs":{"total":95995035648,"available":95987826688,"internally_reserved":0,"allocated":1499136,"data_stored":1018535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.746,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.35099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.37},"min":{"1min":0.29599999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66500000000000004,"5min":0.875,"15min":0.875},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78800000000000003,"5min":1.02,"15min":1.02},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.76900000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.75},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76800000000000002}]},{"osd":8,"last update":"Thu Dec 14 18:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.872,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85799999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":57821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:24:45.784 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T18:24:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:45 smithi119 ceph-mon[43973]: pgmap v260: 97 pgs: 97 active+clean; 637 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-14T18:24:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:45 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/8347488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:45 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3108113247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:45 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2818499156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:45 smithi091 ceph-mon[43601]: pgmap v260: 97 pgs: 97 active+clean; 637 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-14T18:24:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:45 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/8347488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:45 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3108113247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:45 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2818499156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 -- 172.21.15.69:0/1336635669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218100ce0 msgr2=0x7ff2181030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/1336635669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218100ce0 0x7ff2181030c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009990 tx=0x7ff20c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 -- 172.21.15.69:0/1336635669 shutdown_connections 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/1336635669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218105f20 0x7ff218108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/1336635669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218100ce0 0x7ff2181030c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/1336635669 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff218103600 0x7ff2181059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 -- 172.21.15.69:0/1336635669 >> 172.21.15.69:0/1336635669 conn(0x7ff2180fa780 msgr2=0x7ff2180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 -- 172.21.15.69:0/1336635669 shutdown_connections 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 -- 172.21.15.69:0/1336635669 wait complete. 2023-12-14T18:24:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 Processor -- start 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 -- start start 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.940+0000 7ff21d9b3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218100ce0 0x7ff218195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 0x7ff218196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff218105f20 0x7ff21819d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21819da70 con 0x7ff218103600 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21819dbb0 con 0x7ff218105f20 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21819dd40 con 0x7ff218100ce0 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 0x7ff218196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 0x7ff218196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60792/0 (socket says 172.21.15.69:60792) 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 -- 172.21.15.69:0/3337387539 learned_addr learned my addr 172.21.15.69:0/3337387539 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff216ffd700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218100ce0 0x7ff218195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 -- 172.21.15.69:0/3337387539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218100ce0 msgr2=0x7ff218195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218100ce0 0x7ff218195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 -- 172.21.15.69:0/3337387539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff218105f20 msgr2=0x7ff21819d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2177fe700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff218105f20 0x7ff21819d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff218105f20 0x7ff21819d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 -- 172.21.15.69:0/3337387539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0095f0 con 0x7ff218103600 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff2167fc700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 0x7ff218196430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c920 tx=0x7ff20800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007b00 con 0x7ff218103600 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff208004cc0 con 0x7ff218103600 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21810bae0 con 0x7ff218103600 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208005490 con 0x7ff218103600 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.941+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21810b950 con 0x7ff218103600 2023-12-14T18:24:45.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.942+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180fc2f0 con 0x7ff218103600 2023-12-14T18:24:45.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.943+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff208004750 con 0x7ff218103600 2023-12-14T18:24:45.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.944+0000 7ff21c9b1700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2000a11e0 0x7ff2000a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:45.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.944+0000 7ff216ffd700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2000a11e0 0x7ff2000a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:45.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.944+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff2080cca60 con 0x7ff218103600 2023-12-14T18:24:45.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.944+0000 7ff216ffd700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2000a11e0 0x7ff2000a3690 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0095c0 tx=0x7ff20c009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:45.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:45.947+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff208096060 con 0x7ff218103600 2023-12-14T18:24:46.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.131+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff218061c80 con 0x7ff2000a11e0 2023-12-14T18:24:46.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.141+0000 7ff21c9b1700 1 -- 172.21.15.69:0/3337387539 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344547 (secure 0 0 0) 0x7ff218061c80 con 0x7ff2000a11e0 2023-12-14T18:24:46.145 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:46.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2000a11e0 msgr2=0x7ff2000a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2000a11e0 0x7ff2000a3690 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0095c0 tx=0x7ff20c009550 comp rx=0 tx=0).stop 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 msgr2=0x7ff218196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 0x7ff218196430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c920 tx=0x7ff20800cce0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 shutdown_connections 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff2000a11e0 0x7ff2000a3690 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff218105f20 0x7ff21819d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218100ce0 0x7ff218195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 --2- 172.21.15.69:0/3337387539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff218103600 0x7ff218196430 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 >> 172.21.15.69:0/3337387539 conn(0x7ff2180fa780 msgr2=0x7ff218101940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 shutdown_connections 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.144+0000 7ff21d9b3700 1 -- 172.21.15.69:0/3337387539 wait complete. 2023-12-14T18:24:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:24:46.157 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-12-14T18:24:44.252298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652145,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":562,"num_read_kb":391,"num_write":338,"num_write_kb":3046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80312,"kb_used_data":12376,"kb_used_omap":0,"kb_used_meta":67840,"kb_avail":1124861512,"statfs":{"total":1151940427776,"available":1151858188288,"internally_reserved":0,"allocated":12673024,"data_stored":7069547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69468160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":996,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002976"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529112+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:24:27.529112+0000","last_peered":"2023-12-14T18:24:27.529112+0000","last_clean":"2023-12-14T18:24:27.529112+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:24:27.529112+0000","last_undegraded":"2023-12-14T18:24:27.529112+0000","last_fullsized":"2023-12-14T18:24:27.529112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:35:22.535471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535348+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:24:27.535348+0000","last_peered":"2023-12-14T18:24:27.535348+0000","last_clean":"2023-12-14T18:24:27.535348+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:24:27.535348+0000","last_undegraded":"2023-12-14T18:24:27.535348+0000","last_fullsized":"2023-12-14T18:24:27.535348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:01:48.543705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535187+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:24:27.535187+0000","last_peered":"2023-12-14T18:24:27.535187+0000","last_clean":"2023-12-14T18:24:27.535187+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:24:27.535187+0000","last_undegraded":"2023-12-14T18:24:27.535187+0000","last_fullsized":"2023-12-14T18:24:27.535187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:17:21.027078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555746+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:24:27.555746+0000","last_peered":"2023-12-14T18:24:27.555746+0000","last_clean":"2023-12-14T18:24:27.555746+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:24:27.555746+0000","last_undegraded":"2023-12-14T18:24:27.555746+0000","last_fullsized":"2023-12-14T18:24:27.555746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:42:34.133523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533189+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:24:27.533189+0000","last_peered":"2023-12-14T18:24:27.533189+0000","last_clean":"2023-12-14T18:24:27.533189+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:24:27.533189+0000","last_undegraded":"2023-12-14T18:24:27.533189+0000","last_fullsized":"2023-12-14T18:24:27.533189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:40:27.239993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536376+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:24:27.536376+0000","last_peered":"2023-12-14T18:24:27.536376+0000","last_clean":"2023-12-14T18:24:27.536376+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:24:27.536376+0000","last_undegraded":"2023-12-14T18:24:27.536376+0000","last_fullsized":"2023-12-14T18:24:27.536376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:31:58.835118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532050+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:24:27.532050+0000","last_peered":"2023-12-14T18:24:27.532050+0000","last_clean":"2023-12-14T18:24:27.532050+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:24:27.532050+0000","last_undegraded":"2023-12-14T18:24:27.532050+0000","last_fullsized":"2023-12-14T18:24:27.532050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:06:12.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.559946+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:24:27.559946+0000","last_peered":"2023-12-14T18:24:27.559946+0000","last_clean":"2023-12-14T18:24:27.559946+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:24:27.559946+0000","last_undegraded":"2023-12-14T18:24:27.559946+0000","last_fullsized":"2023-12-14T18:24:27.559946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:23:36.985043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535935+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:24:27.535935+0000","last_peered":"2023-12-14T18:24:27.535935+0000","last_clean":"2023-12-14T18:24:27.535935+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:24:27.535935+0000","last_undegraded":"2023-12-14T18:24:27.535935+0000","last_fullsized":"2023-12-14T18:24:27.535935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:10.966257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536957+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:24:27.536957+0000","last_peered":"2023-12-14T18:24:27.536957+0000","last_clean":"2023-12-14T18:24:27.536957+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:24:27.536957+0000","last_undegraded":"2023-12-14T18:24:27.536957+0000","last_fullsized":"2023-12-14T18:24:27.536957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:41:27.591209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532533+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:24:27.532533+0000","last_peered":"2023-12-14T18:24:27.532533+0000","last_clean":"2023-12-14T18:24:27.532533+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:24:27.532533+0000","last_undegraded":"2023-12-14T18:24:27.532533+0000","last_fullsized":"2023-12-14T18:24:27.532533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:26:31.532135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555678+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:24:27.555678+0000","last_peered":"2023-12-14T18:24:27.555678+0000","last_clean":"2023-12-14T18:24:27.555678+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:24:27.555678+0000","last_undegraded":"2023-12-14T18:24:27.555678+0000","last_fullsized":"2023-12-14T18:24:27.555678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:33:08.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528916+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:24:27.528916+0000","last_peered":"2023-12-14T18:24:27.528916+0000","last_clean":"2023-12-14T18:24:27.528916+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:24:27.528916+0000","last_undegraded":"2023-12-14T18:24:27.528916+0000","last_fullsized":"2023-12-14T18:24:27.528916+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:08:40.131918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534759+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:24:27.534759+0000","last_peered":"2023-12-14T18:24:27.534759+0000","last_clean":"2023-12-14T18:24:27.534759+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:24:27.534759+0000","last_undegraded":"2023-12-14T18:24:27.534759+0000","last_fullsized":"2023-12-14T18:24:27.534759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:40:39.187953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534875+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:24:27.534875+0000","last_peered":"2023-12-14T18:24:27.534875+0000","last_clean":"2023-12-14T18:24:27.534875+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:24:27.534875+0000","last_undegraded":"2023-12-14T18:24:27.534875+0000","last_fullsized":"2023-12-14T18:24:27.534875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:27.841273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536144+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:24:27.536144+0000","last_peered":"2023-12-14T18:24:27.536144+0000","last_clean":"2023-12-14T18:24:27.536144+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:24:27.536144+0000","last_undegraded":"2023-12-14T18:24:27.536144+0000","last_fullsized":"2023-12-14T18:24:27.536144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:28.177172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529520+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:24:27.529520+0000","last_peered":"2023-12-14T18:24:27.529520+0000","last_clean":"2023-12-14T18:24:27.529520+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:24:27.529520+0000","last_undegraded":"2023-12-14T18:24:27.529520+0000","last_fullsized":"2023-12-14T18:24:27.529520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:22:30.580736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561675+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:24:27.561675+0000","last_peered":"2023-12-14T18:24:27.561675+0000","last_clean":"2023-12-14T18:24:27.561675+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:24:27.561675+0000","last_undegraded":"2023-12-14T18:24:27.561675+0000","last_fullsized":"2023-12-14T18:24:27.561675+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:04:12.332074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.563560+0000","last_change":"2023-12-14T18:24:27.563560+0000","last_active":"2023-12-14T18:24:27.563560+0000","last_peered":"2023-12-14T18:24:27.563560+0000","last_clean":"2023-12-14T18:24:27.563560+0000","last_became_active":"2023-12-14T18:24:27.563118+0000","last_became_peered":"2023-12-14T18:24:27.563118+0000","last_unstale":"2023-12-14T18:24:27.563560+0000","last_undegraded":"2023-12-14T18:24:27.563560+0000","last_fullsized":"2023-12-14T18:24:27.563560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:20:45.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561467+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:24:27.561467+0000","last_peered":"2023-12-14T18:24:27.561467+0000","last_clean":"2023-12-14T18:24:27.561467+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:24:27.561467+0000","last_undegraded":"2023-12-14T18:24:27.561467+0000","last_fullsized":"2023-12-14T18:24:27.561467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:50:02.283701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560240+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:24:27.560240+0000","last_peered":"2023-12-14T18:24:27.560240+0000","last_clean":"2023-12-14T18:24:27.560240+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:24:27.560240+0000","last_undegraded":"2023-12-14T18:24:27.560240+0000","last_fullsized":"2023-12-14T18:24:27.560240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:14:39.907047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560505+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:24:27.560505+0000","last_peered":"2023-12-14T18:24:27.560505+0000","last_clean":"2023-12-14T18:24:27.560505+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:24:27.560505+0000","last_undegraded":"2023-12-14T18:24:27.560505+0000","last_fullsized":"2023-12-14T18:24:27.560505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:00:00.837375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535637+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:24:27.535637+0000","last_peered":"2023-12-14T18:24:27.535637+0000","last_clean":"2023-12-14T18:24:27.535637+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:24:27.535637+0000","last_undegraded":"2023-12-14T18:24:27.535637+0000","last_fullsized":"2023-12-14T18:24:27.535637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:10:53.681088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532807+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:24:27.532807+0000","last_peered":"2023-12-14T18:24:27.532807+0000","last_clean":"2023-12-14T18:24:27.532807+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:24:27.532807+0000","last_undegraded":"2023-12-14T18:24:27.532807+0000","last_fullsized":"2023-12-14T18:24:27.532807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:03.464928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535948+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:24:27.535948+0000","last_peered":"2023-12-14T18:24:27.535948+0000","last_clean":"2023-12-14T18:24:27.535948+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:24:27.535948+0000","last_undegraded":"2023-12-14T18:24:27.535948+0000","last_fullsized":"2023-12-14T18:24:27.535948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:10:23.147937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533324+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:24:27.533324+0000","last_peered":"2023-12-14T18:24:27.533324+0000","last_clean":"2023-12-14T18:24:27.533324+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:24:27.533324+0000","last_undegraded":"2023-12-14T18:24:27.533324+0000","last_fullsized":"2023-12-14T18:24:27.533324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:25:58.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534020+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:24:27.534020+0000","last_peered":"2023-12-14T18:24:27.534020+0000","last_clean":"2023-12-14T18:24:27.534020+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:24:27.534020+0000","last_undegraded":"2023-12-14T18:24:27.534020+0000","last_fullsized":"2023-12-14T18:24:27.534020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:56.771730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:38.442825+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:24:38.442825+0000","last_peered":"2023-12-14T18:24:38.442825+0000","last_clean":"2023-12-14T18:24:38.442825+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:24:38.442825+0000","last_undegraded":"2023-12-14T18:24:38.442825+0000","last_fullsized":"2023-12-14T18:24:38.442825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:52.453205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532409+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:24:27.532409+0000","last_peered":"2023-12-14T18:24:27.532409+0000","last_clean":"2023-12-14T18:24:27.532409+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:24:27.532409+0000","last_undegraded":"2023-12-14T18:24:27.532409+0000","last_fullsized":"2023-12-14T18:24:27.532409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:55:03.964494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536287+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:24:27.536287+0000","last_peered":"2023-12-14T18:24:27.536287+0000","last_clean":"2023-12-14T18:24:27.536287+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:24:27.536287+0000","last_undegraded":"2023-12-14T18:24:27.536287+0000","last_fullsized":"2023-12-14T18:24:27.536287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:03:08.981315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562217+0000","last_change":"2023-12-14T18:24:27.562217+0000","last_active":"2023-12-14T18:24:27.562217+0000","last_peered":"2023-12-14T18:24:27.562217+0000","last_clean":"2023-12-14T18:24:27.562217+0000","last_became_active":"2023-12-14T18:24:27.561910+0000","last_became_peered":"2023-12-14T18:24:27.561910+0000","last_unstale":"2023-12-14T18:24:27.562217+0000","last_undegraded":"2023-12-14T18:24:27.562217+0000","last_fullsized":"2023-12-14T18:24:27.562217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:15.952432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528487+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:24:27.528487+0000","last_peered":"2023-12-14T18:24:27.528487+0000","last_clean":"2023-12-14T18:24:27.528487+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:24:27.528487+0000","last_undegraded":"2023-12-14T18:24:27.528487+0000","last_fullsized":"2023-12-14T18:24:27.528487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:36:08.840200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.559905+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:24:27.559905+0000","last_peered":"2023-12-14T18:24:27.559905+0000","last_clean":"2023-12-14T18:24:27.559905+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:24:27.559905+0000","last_undegraded":"2023-12-14T18:24:27.559905+0000","last_fullsized":"2023-12-14T18:24:27.559905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:45:55.543091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533853+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:24:27.533853+0000","last_peered":"2023-12-14T18:24:27.533853+0000","last_clean":"2023-12-14T18:24:27.533853+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:24:27.533853+0000","last_undegraded":"2023-12-14T18:24:27.533853+0000","last_fullsized":"2023-12-14T18:24:27.533853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:11.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561061+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:24:27.561061+0000","last_peered":"2023-12-14T18:24:27.561061+0000","last_clean":"2023-12-14T18:24:27.561061+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:24:27.561061+0000","last_undegraded":"2023-12-14T18:24:27.561061+0000","last_fullsized":"2023-12-14T18:24:27.561061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:26.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.631472+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:24:41.631472+0000","last_peered":"2023-12-14T18:24:41.631472+0000","last_clean":"2023-12-14T18:24:41.631472+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:24:41.631472+0000","last_undegraded":"2023-12-14T18:24:41.631472+0000","last_fullsized":"2023-12-14T18:24:41.631472+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:16:02.732524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536065+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:24:27.536065+0000","last_peered":"2023-12-14T18:24:27.536065+0000","last_clean":"2023-12-14T18:24:27.536065+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:24:27.536065+0000","last_undegraded":"2023-12-14T18:24:27.536065+0000","last_fullsized":"2023-12-14T18:24:27.536065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:00.967006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532412+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:24:27.532412+0000","last_peered":"2023-12-14T18:24:27.532412+0000","last_clean":"2023-12-14T18:24:27.532412+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:24:27.532412+0000","last_undegraded":"2023-12-14T18:24:27.532412+0000","last_fullsized":"2023-12-14T18:24:27.532412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:42:11.413770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535557+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:24:27.535557+0000","last_peered":"2023-12-14T18:24:27.535557+0000","last_clean":"2023-12-14T18:24:27.535557+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:24:27.535557+0000","last_undegraded":"2023-12-14T18:24:27.535557+0000","last_fullsized":"2023-12-14T18:24:27.535557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:39.663568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534139+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:24:27.534139+0000","last_peered":"2023-12-14T18:24:27.534139+0000","last_clean":"2023-12-14T18:24:27.534139+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:24:27.534139+0000","last_undegraded":"2023-12-14T18:24:27.534139+0000","last_fullsized":"2023-12-14T18:24:27.534139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:45:31.922598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.539577+0000","last_change":"2023-12-14T18:24:27.539577+0000","last_active":"2023-12-14T18:24:27.539577+0000","last_peered":"2023-12-14T18:24:27.539577+0000","last_clean":"2023-12-14T18:24:27.539577+0000","last_became_active":"2023-12-14T18:24:27.539242+0000","last_became_peered":"2023-12-14T18:24:27.539242+0000","last_unstale":"2023-12-14T18:24:27.539577+0000","last_undegraded":"2023-12-14T18:24:27.539577+0000","last_fullsized":"2023-12-14T18:24:27.539577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:34:30.632737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":194,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:42.448268+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:24:42.448268+0000","last_peered":"2023-12-14T18:24:42.448268+0000","last_clean":"2023-12-14T18:24:42.448268+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:24:42.448268+0000","last_undegraded":"2023-12-14T18:24:42.448268+0000","last_fullsized":"2023-12-14T18:24:42.448268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:22:43.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56739,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":127,"num_write":30,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532535+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:24:27.532535+0000","last_peered":"2023-12-14T18:24:27.532535+0000","last_clean":"2023-12-14T18:24:27.532535+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:24:27.532535+0000","last_undegraded":"2023-12-14T18:24:27.532535+0000","last_fullsized":"2023-12-14T18:24:27.532535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:50:34.809496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531111+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:24:27.531111+0000","last_peered":"2023-12-14T18:24:27.531111+0000","last_clean":"2023-12-14T18:24:27.531111+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:24:27.531111+0000","last_undegraded":"2023-12-14T18:24:27.531111+0000","last_fullsized":"2023-12-14T18:24:27.531111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:13.079718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528595+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:24:27.528595+0000","last_peered":"2023-12-14T18:24:27.528595+0000","last_clean":"2023-12-14T18:24:27.528595+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:24:27.528595+0000","last_undegraded":"2023-12-14T18:24:27.528595+0000","last_fullsized":"2023-12-14T18:24:27.528595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:29:03.280859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534235+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:24:27.534235+0000","last_peered":"2023-12-14T18:24:27.534235+0000","last_clean":"2023-12-14T18:24:27.534235+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:24:27.534235+0000","last_undegraded":"2023-12-14T18:24:27.534235+0000","last_fullsized":"2023-12-14T18:24:27.534235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:19:31.264438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532288+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:24:27.532288+0000","last_peered":"2023-12-14T18:24:27.532288+0000","last_clean":"2023-12-14T18:24:27.532288+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:24:27.532288+0000","last_undegraded":"2023-12-14T18:24:27.532288+0000","last_fullsized":"2023-12-14T18:24:27.532288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:38:34.519741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.447138+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:24:41.447138+0000","last_peered":"2023-12-14T18:24:41.447138+0000","last_clean":"2023-12-14T18:24:41.447138+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:24:41.447138+0000","last_undegraded":"2023-12-14T18:24:41.447138+0000","last_fullsized":"2023-12-14T18:24:41.447138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:11:49.660705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532257+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:24:27.532257+0000","last_peered":"2023-12-14T18:24:27.532257+0000","last_clean":"2023-12-14T18:24:27.532257+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:24:27.532257+0000","last_undegraded":"2023-12-14T18:24:27.532257+0000","last_fullsized":"2023-12-14T18:24:27.532257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:19:36.503753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:28.746333+0000","last_change":"2023-12-14T18:24:28.746333+0000","last_active":"2023-12-14T18:24:28.746333+0000","last_peered":"2023-12-14T18:24:28.746333+0000","last_clean":"2023-12-14T18:24:28.746333+0000","last_became_active":"2023-12-14T18:24:27.556325+0000","last_became_peered":"2023-12-14T18:24:27.556325+0000","last_unstale":"2023-12-14T18:24:28.746333+0000","last_undegraded":"2023-12-14T18:24:28.746333+0000","last_fullsized":"2023-12-14T18:24:28.746333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:56.847744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534120+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:24:27.534120+0000","last_peered":"2023-12-14T18:24:27.534120+0000","last_clean":"2023-12-14T18:24:27.534120+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:24:27.534120+0000","last_undegraded":"2023-12-14T18:24:27.534120+0000","last_fullsized":"2023-12-14T18:24:27.534120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:25:22.539914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532250+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:24:27.532250+0000","last_peered":"2023-12-14T18:24:27.532250+0000","last_clean":"2023-12-14T18:24:27.532250+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:24:27.532250+0000","last_undegraded":"2023-12-14T18:24:27.532250+0000","last_fullsized":"2023-12-14T18:24:27.532250+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:02.582193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529390+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:24:27.529390+0000","last_peered":"2023-12-14T18:24:27.529390+0000","last_clean":"2023-12-14T18:24:27.529390+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:24:27.529390+0000","last_undegraded":"2023-12-14T18:24:27.529390+0000","last_fullsized":"2023-12-14T18:24:27.529390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.966158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561638+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:24:27.561638+0000","last_peered":"2023-12-14T18:24:27.561638+0000","last_clean":"2023-12-14T18:24:27.561638+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:24:27.561638+0000","last_undegraded":"2023-12-14T18:24:27.561638+0000","last_fullsized":"2023-12-14T18:24:27.561638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:42:22.636519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536801+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:24:27.536801+0000","last_peered":"2023-12-14T18:24:27.536801+0000","last_clean":"2023-12-14T18:24:27.536801+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:24:27.536801+0000","last_undegraded":"2023-12-14T18:24:27.536801+0000","last_fullsized":"2023-12-14T18:24:27.536801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:49:55.072660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532205+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:24:27.532205+0000","last_peered":"2023-12-14T18:24:27.532205+0000","last_clean":"2023-12-14T18:24:27.532205+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:24:27.532205+0000","last_undegraded":"2023-12-14T18:24:27.532205+0000","last_fullsized":"2023-12-14T18:24:27.532205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:55:48.946039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536575+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:24:27.536575+0000","last_peered":"2023-12-14T18:24:27.536575+0000","last_clean":"2023-12-14T18:24:27.536575+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:24:27.536575+0000","last_undegraded":"2023-12-14T18:24:27.536575+0000","last_fullsized":"2023-12-14T18:24:27.536575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:14:52.816044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534000+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:24:27.534000+0000","last_peered":"2023-12-14T18:24:27.534000+0000","last_clean":"2023-12-14T18:24:27.534000+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:24:27.534000+0000","last_undegraded":"2023-12-14T18:24:27.534000+0000","last_fullsized":"2023-12-14T18:24:27.534000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:40.832565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.446322+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:24:41.446322+0000","last_peered":"2023-12-14T18:24:41.446322+0000","last_clean":"2023-12-14T18:24:41.446322+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:24:41.446322+0000","last_undegraded":"2023-12-14T18:24:41.446322+0000","last_fullsized":"2023-12-14T18:24:41.446322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:47.779283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560400+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:24:27.560400+0000","last_peered":"2023-12-14T18:24:27.560400+0000","last_clean":"2023-12-14T18:24:27.560400+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:24:27.560400+0000","last_undegraded":"2023-12-14T18:24:27.560400+0000","last_fullsized":"2023-12-14T18:24:27.560400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:23:08.619045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555375+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:24:27.555375+0000","last_peered":"2023-12-14T18:24:27.555375+0000","last_clean":"2023-12-14T18:24:27.555375+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:24:27.555375+0000","last_undegraded":"2023-12-14T18:24:27.555375+0000","last_fullsized":"2023-12-14T18:24:27.555375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:27:02.067811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532339+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:24:27.532339+0000","last_peered":"2023-12-14T18:24:27.532339+0000","last_clean":"2023-12-14T18:24:27.532339+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:24:27.532339+0000","last_undegraded":"2023-12-14T18:24:27.532339+0000","last_fullsized":"2023-12-14T18:24:27.532339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:45:40.168142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528334+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:24:27.528334+0000","last_peered":"2023-12-14T18:24:27.528334+0000","last_clean":"2023-12-14T18:24:27.528334+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:24:27.528334+0000","last_undegraded":"2023-12-14T18:24:27.528334+0000","last_fullsized":"2023-12-14T18:24:27.528334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:39.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532437+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:24:27.532437+0000","last_peered":"2023-12-14T18:24:27.532437+0000","last_clean":"2023-12-14T18:24:27.532437+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:24:27.532437+0000","last_undegraded":"2023-12-14T18:24:27.532437+0000","last_fullsized":"2023-12-14T18:24:27.532437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:01:50.837514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532619+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:24:27.532619+0000","last_peered":"2023-12-14T18:24:27.532619+0000","last_clean":"2023-12-14T18:24:27.532619+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:24:27.532619+0000","last_undegraded":"2023-12-14T18:24:27.532619+0000","last_fullsized":"2023-12-14T18:24:27.532619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:30:57.298364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528633+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:24:27.528633+0000","last_peered":"2023-12-14T18:24:27.528633+0000","last_clean":"2023-12-14T18:24:27.528633+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:24:27.528633+0000","last_undegraded":"2023-12-14T18:24:27.528633+0000","last_fullsized":"2023-12-14T18:24:27.528633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:45:38.005408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561525+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:24:27.561525+0000","last_peered":"2023-12-14T18:24:27.561525+0000","last_clean":"2023-12-14T18:24:27.561525+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:24:27.561525+0000","last_undegraded":"2023-12-14T18:24:27.561525+0000","last_fullsized":"2023-12-14T18:24:27.561525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:26:30.989444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560724+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:24:27.560724+0000","last_peered":"2023-12-14T18:24:27.560724+0000","last_clean":"2023-12-14T18:24:27.560724+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:24:27.560724+0000","last_undegraded":"2023-12-14T18:24:27.560724+0000","last_fullsized":"2023-12-14T18:24:27.560724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:50:35.528934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555511+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:24:27.555511+0000","last_peered":"2023-12-14T18:24:27.555511+0000","last_clean":"2023-12-14T18:24:27.555511+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:24:27.555511+0000","last_undegraded":"2023-12-14T18:24:27.555511+0000","last_fullsized":"2023-12-14T18:24:27.555511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:46.296842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535414+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:24:27.535414+0000","last_peered":"2023-12-14T18:24:27.535414+0000","last_clean":"2023-12-14T18:24:27.535414+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:24:27.535414+0000","last_undegraded":"2023-12-14T18:24:27.535414+0000","last_fullsized":"2023-12-14T18:24:27.535414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:44:49.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.542103+0000","last_change":"2023-12-14T18:24:27.542103+0000","last_active":"2023-12-14T18:24:27.542103+0000","last_peered":"2023-12-14T18:24:27.542103+0000","last_clean":"2023-12-14T18:24:27.542103+0000","last_became_active":"2023-12-14T18:24:27.539409+0000","last_became_peered":"2023-12-14T18:24:27.539409+0000","last_unstale":"2023-12-14T18:24:27.542103+0000","last_undegraded":"2023-12-14T18:24:27.542103+0000","last_fullsized":"2023-12-14T18:24:27.542103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:01:43.400341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532153+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:24:27.532153+0000","last_peered":"2023-12-14T18:24:27.532153+0000","last_clean":"2023-12-14T18:24:27.532153+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:24:27.532153+0000","last_undegraded":"2023-12-14T18:24:27.532153+0000","last_fullsized":"2023-12-14T18:24:27.532153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:59:43.609677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560282+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:24:27.560282+0000","last_peered":"2023-12-14T18:24:27.560282+0000","last_clean":"2023-12-14T18:24:27.560282+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:24:27.560282+0000","last_undegraded":"2023-12-14T18:24:27.560282+0000","last_fullsized":"2023-12-14T18:24:27.560282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:47:08.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528956+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:24:27.528956+0000","last_peered":"2023-12-14T18:24:27.528956+0000","last_clean":"2023-12-14T18:24:27.528956+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:24:27.528956+0000","last_undegraded":"2023-12-14T18:24:27.528956+0000","last_fullsized":"2023-12-14T18:24:27.528956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:39.402213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530959+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:24:27.530959+0000","last_peered":"2023-12-14T18:24:27.530959+0000","last_clean":"2023-12-14T18:24:27.530959+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:24:27.530959+0000","last_undegraded":"2023-12-14T18:24:27.530959+0000","last_fullsized":"2023-12-14T18:24:27.530959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:42:38.930855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561164+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:24:27.561164+0000","last_peered":"2023-12-14T18:24:27.561164+0000","last_clean":"2023-12-14T18:24:27.561164+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:24:27.561164+0000","last_undegraded":"2023-12-14T18:24:27.561164+0000","last_fullsized":"2023-12-14T18:24:27.561164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:53:59.350009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.547378+0000","last_change":"2023-12-14T18:24:27.547378+0000","last_active":"2023-12-14T18:24:27.547378+0000","last_peered":"2023-12-14T18:24:27.547378+0000","last_clean":"2023-12-14T18:24:27.547378+0000","last_became_active":"2023-12-14T18:24:27.535734+0000","last_became_peered":"2023-12-14T18:24:27.535734+0000","last_unstale":"2023-12-14T18:24:27.547378+0000","last_undegraded":"2023-12-14T18:24:27.547378+0000","last_fullsized":"2023-12-14T18:24:27.547378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:17:22.214140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532552+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:24:27.532552+0000","last_peered":"2023-12-14T18:24:27.532552+0000","last_clean":"2023-12-14T18:24:27.532552+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:24:27.532552+0000","last_undegraded":"2023-12-14T18:24:27.532552+0000","last_fullsized":"2023-12-14T18:24:27.532552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:51:12.692007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531307+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:24:27.531307+0000","last_peered":"2023-12-14T18:24:27.531307+0000","last_clean":"2023-12-14T18:24:27.531307+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:24:27.531307+0000","last_undegraded":"2023-12-14T18:24:27.531307+0000","last_fullsized":"2023-12-14T18:24:27.531307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:32:01.037894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532576+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:24:27.532576+0000","last_peered":"2023-12-14T18:24:27.532576+0000","last_clean":"2023-12-14T18:24:27.532576+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:24:27.532576+0000","last_undegraded":"2023-12-14T18:24:27.532576+0000","last_fullsized":"2023-12-14T18:24:27.532576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:45:15.897361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533886+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:24:27.533886+0000","last_peered":"2023-12-14T18:24:27.533886+0000","last_clean":"2023-12-14T18:24:27.533886+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:24:27.533886+0000","last_undegraded":"2023-12-14T18:24:27.533886+0000","last_fullsized":"2023-12-14T18:24:27.533886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:11:10.311368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532158+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:24:27.532158+0000","last_peered":"2023-12-14T18:24:27.532158+0000","last_clean":"2023-12-14T18:24:27.532158+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:24:27.532158+0000","last_undegraded":"2023-12-14T18:24:27.532158+0000","last_fullsized":"2023-12-14T18:24:27.532158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:21:43.570678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528716+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:24:27.528716+0000","last_peered":"2023-12-14T18:24:27.528716+0000","last_clean":"2023-12-14T18:24:27.528716+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:24:27.528716+0000","last_undegraded":"2023-12-14T18:24:27.528716+0000","last_fullsized":"2023-12-14T18:24:27.528716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:26:45.633939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532451+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:24:27.532451+0000","last_peered":"2023-12-14T18:24:27.532451+0000","last_clean":"2023-12-14T18:24:27.532451+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:24:27.532451+0000","last_undegraded":"2023-12-14T18:24:27.532451+0000","last_fullsized":"2023-12-14T18:24:27.532451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:20:05.461484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562369+0000","last_change":"2023-12-14T18:24:27.562369+0000","last_active":"2023-12-14T18:24:27.562369+0000","last_peered":"2023-12-14T18:24:27.562369+0000","last_clean":"2023-12-14T18:24:27.562369+0000","last_became_active":"2023-12-14T18:24:27.561659+0000","last_became_peered":"2023-12-14T18:24:27.561659+0000","last_unstale":"2023-12-14T18:24:27.562369+0000","last_undegraded":"2023-12-14T18:24:27.562369+0000","last_fullsized":"2023-12-14T18:24:27.562369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:50.423823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530858+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:24:27.530858+0000","last_peered":"2023-12-14T18:24:27.530858+0000","last_clean":"2023-12-14T18:24:27.530858+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:24:27.530858+0000","last_undegraded":"2023-12-14T18:24:27.530858+0000","last_fullsized":"2023-12-14T18:24:27.530858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:16:07.611838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530870+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:24:27.530870+0000","last_peered":"2023-12-14T18:24:27.530870+0000","last_clean":"2023-12-14T18:24:27.530870+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:24:27.530870+0000","last_undegraded":"2023-12-14T18:24:27.530870+0000","last_fullsized":"2023-12-14T18:24:27.530870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:28:50.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534826+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:24:27.534826+0000","last_peered":"2023-12-14T18:24:27.534826+0000","last_clean":"2023-12-14T18:24:27.534826+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:24:27.534826+0000","last_undegraded":"2023-12-14T18:24:27.534826+0000","last_fullsized":"2023-12-14T18:24:27.534826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:37.707737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528746+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:24:27.528746+0000","last_peered":"2023-12-14T18:24:27.528746+0000","last_clean":"2023-12-14T18:24:27.528746+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:24:27.528746+0000","last_undegraded":"2023-12-14T18:24:27.528746+0000","last_fullsized":"2023-12-14T18:24:27.528746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:12.147192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529374+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:24:27.529374+0000","last_peered":"2023-12-14T18:24:27.529374+0000","last_clean":"2023-12-14T18:24:27.529374+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:24:27.529374+0000","last_undegraded":"2023-12-14T18:24:27.529374+0000","last_fullsized":"2023-12-14T18:24:27.529374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:10.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531482+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:24:27.531482+0000","last_peered":"2023-12-14T18:24:27.531482+0000","last_clean":"2023-12-14T18:24:27.531482+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:24:27.531482+0000","last_undegraded":"2023-12-14T18:24:27.531482+0000","last_fullsized":"2023-12-14T18:24:27.531482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:57:46.031281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560613+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:24:27.560613+0000","last_peered":"2023-12-14T18:24:27.560613+0000","last_clean":"2023-12-14T18:24:27.560613+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:24:27.560613+0000","last_undegraded":"2023-12-14T18:24:27.560613+0000","last_fullsized":"2023-12-14T18:24:27.560613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:52.934323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533876+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:24:27.533876+0000","last_peered":"2023-12-14T18:24:27.533876+0000","last_clean":"2023-12-14T18:24:27.533876+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:24:27.533876+0000","last_undegraded":"2023-12-14T18:24:27.533876+0000","last_fullsized":"2023-12-14T18:24:27.533876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:53:45.243792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560150+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:24:27.560150+0000","last_peered":"2023-12-14T18:24:27.560150+0000","last_clean":"2023-12-14T18:24:27.560150+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:24:27.560150+0000","last_undegraded":"2023-12-14T18:24:27.560150+0000","last_fullsized":"2023-12-14T18:24:27.560150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:40.898333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535736+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:24:27.535736+0000","last_peered":"2023-12-14T18:24:27.535736+0000","last_clean":"2023-12-14T18:24:27.535736+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:24:27.535736+0000","last_undegraded":"2023-12-14T18:24:27.535736+0000","last_fullsized":"2023-12-14T18:24:27.535736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:43:41.122487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528954+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:24:27.528954+0000","last_peered":"2023-12-14T18:24:27.528954+0000","last_clean":"2023-12-14T18:24:27.528954+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:24:27.528954+0000","last_undegraded":"2023-12-14T18:24:27.528954+0000","last_fullsized":"2023-12-14T18:24:27.528954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:42.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562048+0000","last_change":"2023-12-14T18:24:27.562048+0000","last_active":"2023-12-14T18:24:27.562048+0000","last_peered":"2023-12-14T18:24:27.562048+0000","last_clean":"2023-12-14T18:24:27.562048+0000","last_became_active":"2023-12-14T18:24:27.561655+0000","last_became_peered":"2023-12-14T18:24:27.561655+0000","last_unstale":"2023-12-14T18:24:27.562048+0000","last_undegraded":"2023-12-14T18:24:27.562048+0000","last_fullsized":"2023-12-14T18:24:27.562048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:42:53.330004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61531,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":436,"num_read_kb":282,"num_write":155,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":187917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5984,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739168,"statfs":{"total":95995035648,"available":95988908032,"internally_reserved":0,"allocated":876544,"data_stored":426808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.88400000000000001}]},{"osd":8,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89400000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":0.872},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":9.1150000000000002,"5min":9.1150000000000002,"15min":9.1150000000000002},"last":0.94199999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.90700000000000003}]}]},{"osd":10,"up_from":67,"seq":287762808860,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6912,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738240,"statfs":{"total":95995035648,"available":95987957760,"internally_reserved":0,"allocated":1564672,"data_stored":1075543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.44},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61199999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.45200000000000001},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.505},{"interface":"front","average":{"1min":0.63,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.51200000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.54200000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97099999999999997,"5min":1.014,"15min":1.014},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.052},"last":0.62},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.72399999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.022,"5min":1.073,"15min":1.073},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.69799999999999995,"15min":0.68799999999999994},"min":{"1min":0.60299999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98999999999999999,"5min":1.034,"15min":1.034},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85299999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.81499999999999995}]}]},{"osd":9,"up_from":62,"seq":266287972384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6128,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93739024,"statfs":{"total":95995035648,"available":95988760576,"internally_reserved":0,"allocated":892928,"data_stored":427044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71499999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.499}]},{"osd":2,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58699999999999997,"15min":0.60099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79900000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":1.163,"15min":1.163},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.49399999999999999,"15min":0.51500000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61699999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65600000000000003,"15min":0.67400000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":0.877,"15min":0.877},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84199999999999997,"5min":1.236,"15min":1.236},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.024,"15min":1.024},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73399999999999999,"5min":1.331,"15min":1.331},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91500000000000004,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.56699999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.59199999999999997}]}]},{"osd":8,"up_from":55,"seq":236223201316,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6320,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738832,"statfs":{"total":95995035648,"available":95988563968,"internally_reserved":0,"allocated":892928,"data_stored":426964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.623}]},{"osd":1,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.877,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88400000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95699999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.753}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.76000000000000001,"15min":0.74399999999999999},"min":{"1min":0.75,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.73899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81899999999999995}]}]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6900,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738252,"statfs":{"total":95995035648,"available":95987970048,"internally_reserved":0,"allocated":1486848,"data_stored":1019193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.434},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82199999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.622,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41299999999999998}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93400000000000005,"5min":1.986,"15min":1.986},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85399999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78800000000000003}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76800000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69799999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6244,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738908,"statfs":{"total":95995035648,"available":95988641792,"internally_reserved":0,"allocated":880640,"data_stored":426439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41399999999999998,"15min":0.41699999999999998},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.70699999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80600000000000005,"5min":0.872,"15min":0.872},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:24:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Dec 14 18:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.77600000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7324,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737828,"statfs":{"total":95995035648,"available":95987535872,"internally_reserved":0,"allocated":937984,"data_stored":482965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.52900000000000003,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.19,"15min":0.19},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.46000000000000002},"min":{"1min":0.38900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.70399999999999996,"5min":0.87,"15min":0.87},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.50800000000000001},"min":{"1min":0.42399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80900000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.745},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54000000000000004,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78600000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.60799999999999998,"15min":0.56200000000000006},"min":{"1min":0.39000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.57399999999999995,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4809999999999999,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.44}]},{"osd":4,"last update":"Thu Dec 14 18:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80100000000000005,"5min":0.878,"15min":0.878},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.77200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83899999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.65400000000000003,"15min":0.60799999999999998},"min":{"1min":0.501,"5min":0.373,"15min":0.373},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.70399999999999996,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":0.995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95399999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.753,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.3099999999999996,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.625},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.75900000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.3380000000000001,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:24:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76700000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7160,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737992,"statfs":{"total":95995035648,"available":95987703808,"internally_reserved":0,"allocated":901120,"data_stored":427704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.46400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.51300000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.39500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.627,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.496,"15min":0.52000000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.54700000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36399999999999999}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71299999999999997,"5min":0.876,"15min":0.876},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50600000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.61599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67100000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.44600000000000001}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74199999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.754,"5min":0.876,"15min":0.876},"last":0.622}]},{"osd":11,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53600000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411384,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7400,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737752,"statfs":{"total":95995035648,"available":95987458048,"internally_reserved":0,"allocated":950272,"data_stored":483774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70399999999999996,"5min":0.747,"15min":0.747},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48799999999999999,"15min":0.47799999999999998},"min":{"1min":0.40000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.52400000000000002,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65600000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.501}]},{"osd":4,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.45600000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.62},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77900000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64600000000000002}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81699999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Dec 14 18:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63300000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":426756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.33600000000000002},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.495,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60099999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.496}]},{"osd":6,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59799999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.437},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.621,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":10,"last update":"Thu Dec 14 18:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.80800000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]},{"osd":11,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.624},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56499999999999995}]}]},{"osd":4,"up_from":31,"seq":133143986226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6384,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738768,"statfs":{"total":95995035648,"available":95988498432,"internally_reserved":0,"allocated":892928,"data_stored":427822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.376,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38,"15min":0.37},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.373,"15min":0.373},"max":{"1min":0.875,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55100000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.755}]},{"osd":9,"last update":"Thu Dec 14 18:24:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.53900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.56799999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":1.008,"15min":1.008},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.62,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77700000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.80100000000000005}]}]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7040,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738112,"statfs":{"total":95995035648,"available":95987826688,"internally_reserved":0,"allocated":1499136,"data_stored":1018535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.746,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.35099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.37},"min":{"1min":0.29599999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66500000000000004,"5min":0.875,"15min":0.875},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78800000000000003,"5min":1.02,"15min":1.02},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.76900000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.75},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76800000000000002}]},{"osd":8,"last update":"Thu Dec 14 18:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.872,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85799999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Dec 14 18:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":57821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:24:46.162 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-12-14T18:24:46.163 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-14T18:24:46.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 -- 172.21.15.69:0/2395047202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47981014b0 msgr2=0x7f4798101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 --2- 172.21.15.69:0/2395047202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47981014b0 0x7f4798101900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4794009990 tx=0x7f4794009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 -- 172.21.15.69:0/2395047202 shutdown_connections 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 --2- 172.21.15.69:0/2395047202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4798101e40 0x7f4798108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 --2- 172.21.15.69:0/2395047202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47980fe4e0 0x7f47980fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 --2- 172.21.15.69:0/2395047202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47981014b0 0x7f4798101900 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 -- 172.21.15.69:0/2395047202 >> 172.21.15.69:0/2395047202 conn(0x7f47980f9e80 msgr2=0x7f47980fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 -- 172.21.15.69:0/2395047202 shutdown_connections 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.319+0000 7f479fec3700 1 -- 172.21.15.69:0/2395047202 wait complete. 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 Processor -- start 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 -- start start 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47980fe4e0 0x7f4798195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47981014b0 0x7f4798196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 0x7f479819d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479819da50 con 0x7f4798101e40 2023-12-14T18:24:46.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479819db90 con 0x7f47981014b0 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479fec3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479819dd20 con 0x7f47980fe4e0 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 0x7f479819d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 0x7f479819d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60800/0 (socket says 172.21.15.69:60800) 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 -- 172.21.15.69:0/3066315205 learned_addr learned my addr 172.21.15.69:0/3066315205 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479dc5f700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47980fe4e0 0x7f4798195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479d45e700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47981014b0 0x7f4798196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 -- 172.21.15.69:0/3066315205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47980fe4e0 msgr2=0x7f4798195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47980fe4e0 0x7f4798195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 -- 172.21.15.69:0/3066315205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47981014b0 msgr2=0x7f4798196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.320+0000 7f479e460700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47981014b0 0x7f4798196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f479e460700 1 -- 172.21.15.69:0/3066315205 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940095f0 con 0x7f4798101e40 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f479d45e700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47981014b0 0x7f4798196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f479e460700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 0x7f479819d480 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f479000ada0 tx=0x7f479000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000f070 con 0x7f4798101e40 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4790007b30 con 0x7f4798101e40 2023-12-14T18:24:46.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790005280 con 0x7f4798101e40 2023-12-14T18:24:46.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479810ba80 con 0x7f4798101e40 2023-12-14T18:24:46.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.321+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479810b8f0 con 0x7f4798101e40 2023-12-14T18:24:46.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.322+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4798107240 con 0x7f4798101e40 2023-12-14T18:24:46.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.323+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f479000c980 con 0x7f4798101e40 2023-12-14T18:24:46.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.323+0000 7f478effd700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f47840a11e0 0x7f47840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.323+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f47900cc730 con 0x7f4798101e40 2023-12-14T18:24:46.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.323+0000 7f479dc5f700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f47840a11e0 0x7f47840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.324+0000 7f479dc5f700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f47840a11e0 0x7f47840a3690 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4798067bd0 tx=0x7f478800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:46.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.327+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4790095dc0 con 0x7f4798101e40 2023-12-14T18:24:46.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.513+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 --> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4798061c80 con 0x7f47840a11e0 2023-12-14T18:24:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.522+0000 7f478effd700 1 -- 172.21.15.69:0/3066315205 <== mgr.14152 v2:172.21.15.69:6800/4294204545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344565 (secure 0 0 0) 0x7f4798061c80 con 0x7f47840a11e0 2023-12-14T18:24:46.527 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f47840a11e0 msgr2=0x7f47840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f47840a11e0 0x7f47840a3690 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4798067bd0 tx=0x7f478800a3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 msgr2=0x7f479819d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 0x7f479819d480 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f479000ada0 tx=0x7f479000c330 comp rx=0 tx=0).stop 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 shutdown_connections 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f47840a11e0 0x7f47840a3690 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4798101e40 0x7f479819d480 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47980fe4e0 0x7f4798195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 --2- 172.21.15.69:0/3066315205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47981014b0 0x7f4798196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 >> 172.21.15.69:0/3066315205 conn(0x7f47980f9e80 msgr2=0x7f47980fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:46.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 shutdown_connections 2023-12-14T18:24:46.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.526+0000 7f479fec3700 1 -- 172.21.15.69:0/3066315205 wait complete. 2023-12-14T18:24:46.531 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-12-14T18:24:46.539 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-12-14T18:24:46.252745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652643,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":568,"num_read_kb":392,"num_write":339,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80376,"kb_used_data":12376,"kb_used_omap":0,"kb_used_meta":67904,"kb_avail":1124861448,"statfs":{"total":1151940427776,"available":1151858122752,"internally_reserved":0,"allocated":12673024,"data_stored":7071041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69533696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1494,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002995"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529112+0000","last_change":"2023-12-14T18:23:29.325738+0000","last_active":"2023-12-14T18:24:27.529112+0000","last_peered":"2023-12-14T18:24:27.529112+0000","last_clean":"2023-12-14T18:24:27.529112+0000","last_became_active":"2023-12-14T18:23:29.325018+0000","last_became_peered":"2023-12-14T18:23:29.325018+0000","last_unstale":"2023-12-14T18:24:27.529112+0000","last_undegraded":"2023-12-14T18:24:27.529112+0000","last_fullsized":"2023-12-14T18:24:27.529112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:35:22.535471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535348+0000","last_change":"2023-12-14T18:23:29.313922+0000","last_active":"2023-12-14T18:24:27.535348+0000","last_peered":"2023-12-14T18:24:27.535348+0000","last_clean":"2023-12-14T18:24:27.535348+0000","last_became_active":"2023-12-14T18:23:29.313458+0000","last_became_peered":"2023-12-14T18:23:29.313458+0000","last_unstale":"2023-12-14T18:24:27.535348+0000","last_undegraded":"2023-12-14T18:24:27.535348+0000","last_fullsized":"2023-12-14T18:24:27.535348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:01:48.543705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535187+0000","last_change":"2023-12-14T18:23:29.324075+0000","last_active":"2023-12-14T18:24:27.535187+0000","last_peered":"2023-12-14T18:24:27.535187+0000","last_clean":"2023-12-14T18:24:27.535187+0000","last_became_active":"2023-12-14T18:23:29.323781+0000","last_became_peered":"2023-12-14T18:23:29.323781+0000","last_unstale":"2023-12-14T18:24:27.535187+0000","last_undegraded":"2023-12-14T18:24:27.535187+0000","last_fullsized":"2023-12-14T18:24:27.535187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:17:21.027078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555746+0000","last_change":"2023-12-14T18:23:29.329227+0000","last_active":"2023-12-14T18:24:27.555746+0000","last_peered":"2023-12-14T18:24:27.555746+0000","last_clean":"2023-12-14T18:24:27.555746+0000","last_became_active":"2023-12-14T18:23:29.328915+0000","last_became_peered":"2023-12-14T18:23:29.328915+0000","last_unstale":"2023-12-14T18:24:27.555746+0000","last_undegraded":"2023-12-14T18:24:27.555746+0000","last_fullsized":"2023-12-14T18:24:27.555746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:42:34.133523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533189+0000","last_change":"2023-12-14T18:23:29.313220+0000","last_active":"2023-12-14T18:24:27.533189+0000","last_peered":"2023-12-14T18:24:27.533189+0000","last_clean":"2023-12-14T18:24:27.533189+0000","last_became_active":"2023-12-14T18:23:29.312152+0000","last_became_peered":"2023-12-14T18:23:29.312152+0000","last_unstale":"2023-12-14T18:24:27.533189+0000","last_undegraded":"2023-12-14T18:24:27.533189+0000","last_fullsized":"2023-12-14T18:24:27.533189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:40:27.239993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536376+0000","last_change":"2023-12-14T18:23:29.319620+0000","last_active":"2023-12-14T18:24:27.536376+0000","last_peered":"2023-12-14T18:24:27.536376+0000","last_clean":"2023-12-14T18:24:27.536376+0000","last_became_active":"2023-12-14T18:23:29.318381+0000","last_became_peered":"2023-12-14T18:23:29.318381+0000","last_unstale":"2023-12-14T18:24:27.536376+0000","last_undegraded":"2023-12-14T18:24:27.536376+0000","last_fullsized":"2023-12-14T18:24:27.536376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:31:58.835118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532050+0000","last_change":"2023-12-14T18:23:29.323418+0000","last_active":"2023-12-14T18:24:27.532050+0000","last_peered":"2023-12-14T18:24:27.532050+0000","last_clean":"2023-12-14T18:24:27.532050+0000","last_became_active":"2023-12-14T18:23:29.323098+0000","last_became_peered":"2023-12-14T18:23:29.323098+0000","last_unstale":"2023-12-14T18:24:27.532050+0000","last_undegraded":"2023-12-14T18:24:27.532050+0000","last_fullsized":"2023-12-14T18:24:27.532050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:06:12.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.559946+0000","last_change":"2023-12-14T18:23:29.317655+0000","last_active":"2023-12-14T18:24:27.559946+0000","last_peered":"2023-12-14T18:24:27.559946+0000","last_clean":"2023-12-14T18:24:27.559946+0000","last_became_active":"2023-12-14T18:23:29.317295+0000","last_became_peered":"2023-12-14T18:23:29.317295+0000","last_unstale":"2023-12-14T18:24:27.559946+0000","last_undegraded":"2023-12-14T18:24:27.559946+0000","last_fullsized":"2023-12-14T18:24:27.559946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:23:36.985043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535935+0000","last_change":"2023-12-14T18:23:29.315104+0000","last_active":"2023-12-14T18:24:27.535935+0000","last_peered":"2023-12-14T18:24:27.535935+0000","last_clean":"2023-12-14T18:24:27.535935+0000","last_became_active":"2023-12-14T18:23:29.314790+0000","last_became_peered":"2023-12-14T18:23:29.314790+0000","last_unstale":"2023-12-14T18:24:27.535935+0000","last_undegraded":"2023-12-14T18:24:27.535935+0000","last_fullsized":"2023-12-14T18:24:27.535935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:35:10.966257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536957+0000","last_change":"2023-12-14T18:23:29.329295+0000","last_active":"2023-12-14T18:24:27.536957+0000","last_peered":"2023-12-14T18:24:27.536957+0000","last_clean":"2023-12-14T18:24:27.536957+0000","last_became_active":"2023-12-14T18:23:29.328941+0000","last_became_peered":"2023-12-14T18:23:29.328941+0000","last_unstale":"2023-12-14T18:24:27.536957+0000","last_undegraded":"2023-12-14T18:24:27.536957+0000","last_fullsized":"2023-12-14T18:24:27.536957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:41:27.591209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532533+0000","last_change":"2023-12-14T18:23:29.328323+0000","last_active":"2023-12-14T18:24:27.532533+0000","last_peered":"2023-12-14T18:24:27.532533+0000","last_clean":"2023-12-14T18:24:27.532533+0000","last_became_active":"2023-12-14T18:23:29.327956+0000","last_became_peered":"2023-12-14T18:23:29.327956+0000","last_unstale":"2023-12-14T18:24:27.532533+0000","last_undegraded":"2023-12-14T18:24:27.532533+0000","last_fullsized":"2023-12-14T18:24:27.532533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:26:31.532135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555678+0000","last_change":"2023-12-14T18:23:29.328590+0000","last_active":"2023-12-14T18:24:27.555678+0000","last_peered":"2023-12-14T18:24:27.555678+0000","last_clean":"2023-12-14T18:24:27.555678+0000","last_became_active":"2023-12-14T18:23:29.328253+0000","last_became_peered":"2023-12-14T18:23:29.328253+0000","last_unstale":"2023-12-14T18:24:27.555678+0000","last_undegraded":"2023-12-14T18:24:27.555678+0000","last_fullsized":"2023-12-14T18:24:27.555678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:33:08.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528916+0000","last_change":"2023-12-14T18:23:29.316753+0000","last_active":"2023-12-14T18:24:27.528916+0000","last_peered":"2023-12-14T18:24:27.528916+0000","last_clean":"2023-12-14T18:24:27.528916+0000","last_became_active":"2023-12-14T18:23:29.316453+0000","last_became_peered":"2023-12-14T18:23:29.316453+0000","last_unstale":"2023-12-14T18:24:27.528916+0000","last_undegraded":"2023-12-14T18:24:27.528916+0000","last_fullsized":"2023-12-14T18:24:27.528916+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:08:40.131918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534759+0000","last_change":"2023-12-14T18:23:29.318147+0000","last_active":"2023-12-14T18:24:27.534759+0000","last_peered":"2023-12-14T18:24:27.534759+0000","last_clean":"2023-12-14T18:24:27.534759+0000","last_became_active":"2023-12-14T18:23:29.317793+0000","last_became_peered":"2023-12-14T18:23:29.317793+0000","last_unstale":"2023-12-14T18:24:27.534759+0000","last_undegraded":"2023-12-14T18:24:27.534759+0000","last_fullsized":"2023-12-14T18:24:27.534759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:40:39.187953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534875+0000","last_change":"2023-12-14T18:23:29.315619+0000","last_active":"2023-12-14T18:24:27.534875+0000","last_peered":"2023-12-14T18:24:27.534875+0000","last_clean":"2023-12-14T18:24:27.534875+0000","last_became_active":"2023-12-14T18:23:29.315224+0000","last_became_peered":"2023-12-14T18:23:29.315224+0000","last_unstale":"2023-12-14T18:24:27.534875+0000","last_undegraded":"2023-12-14T18:24:27.534875+0000","last_fullsized":"2023-12-14T18:24:27.534875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:41:27.841273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536144+0000","last_change":"2023-12-14T18:23:29.323370+0000","last_active":"2023-12-14T18:24:27.536144+0000","last_peered":"2023-12-14T18:24:27.536144+0000","last_clean":"2023-12-14T18:24:27.536144+0000","last_became_active":"2023-12-14T18:23:29.323008+0000","last_became_peered":"2023-12-14T18:23:29.323008+0000","last_unstale":"2023-12-14T18:24:27.536144+0000","last_undegraded":"2023-12-14T18:24:27.536144+0000","last_fullsized":"2023-12-14T18:24:27.536144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:47:28.177172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529520+0000","last_change":"2023-12-14T18:23:29.326699+0000","last_active":"2023-12-14T18:24:27.529520+0000","last_peered":"2023-12-14T18:24:27.529520+0000","last_clean":"2023-12-14T18:24:27.529520+0000","last_became_active":"2023-12-14T18:23:29.325659+0000","last_became_peered":"2023-12-14T18:23:29.325659+0000","last_unstale":"2023-12-14T18:24:27.529520+0000","last_undegraded":"2023-12-14T18:24:27.529520+0000","last_fullsized":"2023-12-14T18:24:27.529520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:22:30.580736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561675+0000","last_change":"2023-12-14T18:23:29.312779+0000","last_active":"2023-12-14T18:24:27.561675+0000","last_peered":"2023-12-14T18:24:27.561675+0000","last_clean":"2023-12-14T18:24:27.561675+0000","last_became_active":"2023-12-14T18:23:29.312496+0000","last_became_peered":"2023-12-14T18:23:29.312496+0000","last_unstale":"2023-12-14T18:24:27.561675+0000","last_undegraded":"2023-12-14T18:24:27.561675+0000","last_fullsized":"2023-12-14T18:24:27.561675+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:04:12.332074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.563560+0000","last_change":"2023-12-14T18:24:27.563560+0000","last_active":"2023-12-14T18:24:27.563560+0000","last_peered":"2023-12-14T18:24:27.563560+0000","last_clean":"2023-12-14T18:24:27.563560+0000","last_became_active":"2023-12-14T18:24:27.563118+0000","last_became_peered":"2023-12-14T18:24:27.563118+0000","last_unstale":"2023-12-14T18:24:27.563560+0000","last_undegraded":"2023-12-14T18:24:27.563560+0000","last_fullsized":"2023-12-14T18:24:27.563560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:20:45.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561467+0000","last_change":"2023-12-14T18:23:28.901638+0000","last_active":"2023-12-14T18:24:27.561467+0000","last_peered":"2023-12-14T18:24:27.561467+0000","last_clean":"2023-12-14T18:24:27.561467+0000","last_became_active":"2023-12-14T18:23:28.901194+0000","last_became_peered":"2023-12-14T18:23:28.901194+0000","last_unstale":"2023-12-14T18:24:27.561467+0000","last_undegraded":"2023-12-14T18:24:27.561467+0000","last_fullsized":"2023-12-14T18:24:27.561467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:50:02.283701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560240+0000","last_change":"2023-12-14T18:23:29.323427+0000","last_active":"2023-12-14T18:24:27.560240+0000","last_peered":"2023-12-14T18:24:27.560240+0000","last_clean":"2023-12-14T18:24:27.560240+0000","last_became_active":"2023-12-14T18:23:29.323125+0000","last_became_peered":"2023-12-14T18:23:29.323125+0000","last_unstale":"2023-12-14T18:24:27.560240+0000","last_undegraded":"2023-12-14T18:24:27.560240+0000","last_fullsized":"2023-12-14T18:24:27.560240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:14:39.907047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560505+0000","last_change":"2023-12-14T18:23:28.901827+0000","last_active":"2023-12-14T18:24:27.560505+0000","last_peered":"2023-12-14T18:24:27.560505+0000","last_clean":"2023-12-14T18:24:27.560505+0000","last_became_active":"2023-12-14T18:23:28.901485+0000","last_became_peered":"2023-12-14T18:23:28.901485+0000","last_unstale":"2023-12-14T18:24:27.560505+0000","last_undegraded":"2023-12-14T18:24:27.560505+0000","last_fullsized":"2023-12-14T18:24:27.560505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:00:00.837375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535637+0000","last_change":"2023-12-14T18:23:29.308349+0000","last_active":"2023-12-14T18:24:27.535637+0000","last_peered":"2023-12-14T18:24:27.535637+0000","last_clean":"2023-12-14T18:24:27.535637+0000","last_became_active":"2023-12-14T18:23:29.307981+0000","last_became_peered":"2023-12-14T18:23:29.307981+0000","last_unstale":"2023-12-14T18:24:27.535637+0000","last_undegraded":"2023-12-14T18:24:27.535637+0000","last_fullsized":"2023-12-14T18:24:27.535637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:10:53.681088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532807+0000","last_change":"2023-12-14T18:23:28.905082+0000","last_active":"2023-12-14T18:24:27.532807+0000","last_peered":"2023-12-14T18:24:27.532807+0000","last_clean":"2023-12-14T18:24:27.532807+0000","last_became_active":"2023-12-14T18:23:28.904772+0000","last_became_peered":"2023-12-14T18:23:28.904772+0000","last_unstale":"2023-12-14T18:24:27.532807+0000","last_undegraded":"2023-12-14T18:24:27.532807+0000","last_fullsized":"2023-12-14T18:24:27.532807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:30:03.464928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535948+0000","last_change":"2023-12-14T18:23:29.310231+0000","last_active":"2023-12-14T18:24:27.535948+0000","last_peered":"2023-12-14T18:24:27.535948+0000","last_clean":"2023-12-14T18:24:27.535948+0000","last_became_active":"2023-12-14T18:23:29.309890+0000","last_became_peered":"2023-12-14T18:23:29.309890+0000","last_unstale":"2023-12-14T18:24:27.535948+0000","last_undegraded":"2023-12-14T18:24:27.535948+0000","last_fullsized":"2023-12-14T18:24:27.535948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:10:23.147937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533324+0000","last_change":"2023-12-14T18:23:28.902873+0000","last_active":"2023-12-14T18:24:27.533324+0000","last_peered":"2023-12-14T18:24:27.533324+0000","last_clean":"2023-12-14T18:24:27.533324+0000","last_became_active":"2023-12-14T18:23:28.902285+0000","last_became_peered":"2023-12-14T18:23:28.902285+0000","last_unstale":"2023-12-14T18:24:27.533324+0000","last_undegraded":"2023-12-14T18:24:27.533324+0000","last_fullsized":"2023-12-14T18:24:27.533324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:25:58.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534020+0000","last_change":"2023-12-14T18:23:29.320653+0000","last_active":"2023-12-14T18:24:27.534020+0000","last_peered":"2023-12-14T18:24:27.534020+0000","last_clean":"2023-12-14T18:24:27.534020+0000","last_became_active":"2023-12-14T18:23:29.320323+0000","last_became_peered":"2023-12-14T18:23:29.320323+0000","last_unstale":"2023-12-14T18:24:27.534020+0000","last_undegraded":"2023-12-14T18:24:27.534020+0000","last_fullsized":"2023-12-14T18:24:27.534020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:56.771730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'7","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:43.450542+0000","last_change":"2023-12-14T18:23:28.902605+0000","last_active":"2023-12-14T18:24:43.450542+0000","last_peered":"2023-12-14T18:24:43.450542+0000","last_clean":"2023-12-14T18:24:43.450542+0000","last_became_active":"2023-12-14T18:23:28.902133+0000","last_became_peered":"2023-12-14T18:23:28.902133+0000","last_unstale":"2023-12-14T18:24:43.450542+0000","last_undegraded":"2023-12-14T18:24:43.450542+0000","last_fullsized":"2023-12-14T18:24:43.450542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:51:52.453205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532409+0000","last_change":"2023-12-14T18:23:29.315414+0000","last_active":"2023-12-14T18:24:27.532409+0000","last_peered":"2023-12-14T18:24:27.532409+0000","last_clean":"2023-12-14T18:24:27.532409+0000","last_became_active":"2023-12-14T18:23:29.315089+0000","last_became_peered":"2023-12-14T18:23:29.315089+0000","last_unstale":"2023-12-14T18:24:27.532409+0000","last_undegraded":"2023-12-14T18:24:27.532409+0000","last_fullsized":"2023-12-14T18:24:27.532409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:55:03.964494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536287+0000","last_change":"2023-12-14T18:23:28.902621+0000","last_active":"2023-12-14T18:24:27.536287+0000","last_peered":"2023-12-14T18:24:27.536287+0000","last_clean":"2023-12-14T18:24:27.536287+0000","last_became_active":"2023-12-14T18:23:28.902265+0000","last_became_peered":"2023-12-14T18:23:28.902265+0000","last_unstale":"2023-12-14T18:24:27.536287+0000","last_undegraded":"2023-12-14T18:24:27.536287+0000","last_fullsized":"2023-12-14T18:24:27.536287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:03:08.981315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562217+0000","last_change":"2023-12-14T18:24:27.562217+0000","last_active":"2023-12-14T18:24:27.562217+0000","last_peered":"2023-12-14T18:24:27.562217+0000","last_clean":"2023-12-14T18:24:27.562217+0000","last_became_active":"2023-12-14T18:24:27.561910+0000","last_became_peered":"2023-12-14T18:24:27.561910+0000","last_unstale":"2023-12-14T18:24:27.562217+0000","last_undegraded":"2023-12-14T18:24:27.562217+0000","last_fullsized":"2023-12-14T18:24:27.562217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:15.952432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528487+0000","last_change":"2023-12-14T18:23:28.898541+0000","last_active":"2023-12-14T18:24:27.528487+0000","last_peered":"2023-12-14T18:24:27.528487+0000","last_clean":"2023-12-14T18:24:27.528487+0000","last_became_active":"2023-12-14T18:23:28.898011+0000","last_became_peered":"2023-12-14T18:23:28.898011+0000","last_unstale":"2023-12-14T18:24:27.528487+0000","last_undegraded":"2023-12-14T18:24:27.528487+0000","last_fullsized":"2023-12-14T18:24:27.528487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:36:08.840200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.559905+0000","last_change":"2023-12-14T18:23:29.308796+0000","last_active":"2023-12-14T18:24:27.559905+0000","last_peered":"2023-12-14T18:24:27.559905+0000","last_clean":"2023-12-14T18:24:27.559905+0000","last_became_active":"2023-12-14T18:23:29.308469+0000","last_became_peered":"2023-12-14T18:23:29.308469+0000","last_unstale":"2023-12-14T18:24:27.559905+0000","last_undegraded":"2023-12-14T18:24:27.559905+0000","last_fullsized":"2023-12-14T18:24:27.559905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T04:45:55.543091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533853+0000","last_change":"2023-12-14T18:23:28.902270+0000","last_active":"2023-12-14T18:24:27.533853+0000","last_peered":"2023-12-14T18:24:27.533853+0000","last_clean":"2023-12-14T18:24:27.533853+0000","last_became_active":"2023-12-14T18:23:28.901927+0000","last_became_peered":"2023-12-14T18:23:28.901927+0000","last_unstale":"2023-12-14T18:24:27.533853+0000","last_undegraded":"2023-12-14T18:24:27.533853+0000","last_fullsized":"2023-12-14T18:24:27.533853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:21:11.479530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561061+0000","last_change":"2023-12-14T18:23:29.312335+0000","last_active":"2023-12-14T18:24:27.561061+0000","last_peered":"2023-12-14T18:24:27.561061+0000","last_clean":"2023-12-14T18:24:27.561061+0000","last_became_active":"2023-12-14T18:23:29.312009+0000","last_became_peered":"2023-12-14T18:23:29.312009+0000","last_unstale":"2023-12-14T18:24:27.561061+0000","last_undegraded":"2023-12-14T18:24:27.561061+0000","last_fullsized":"2023-12-14T18:24:27.561061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:26.601978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.631472+0000","last_change":"2023-12-14T18:23:28.899236+0000","last_active":"2023-12-14T18:24:41.631472+0000","last_peered":"2023-12-14T18:24:41.631472+0000","last_clean":"2023-12-14T18:24:41.631472+0000","last_became_active":"2023-12-14T18:23:28.898814+0000","last_became_peered":"2023-12-14T18:23:28.898814+0000","last_unstale":"2023-12-14T18:24:41.631472+0000","last_undegraded":"2023-12-14T18:24:41.631472+0000","last_fullsized":"2023-12-14T18:24:41.631472+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:16:02.732524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536065+0000","last_change":"2023-12-14T18:23:29.311672+0000","last_active":"2023-12-14T18:24:27.536065+0000","last_peered":"2023-12-14T18:24:27.536065+0000","last_clean":"2023-12-14T18:24:27.536065+0000","last_became_active":"2023-12-14T18:23:29.310030+0000","last_became_peered":"2023-12-14T18:23:29.310030+0000","last_unstale":"2023-12-14T18:24:27.536065+0000","last_undegraded":"2023-12-14T18:24:27.536065+0000","last_fullsized":"2023-12-14T18:24:27.536065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:00.967006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532412+0000","last_change":"2023-12-14T18:23:28.903782+0000","last_active":"2023-12-14T18:24:27.532412+0000","last_peered":"2023-12-14T18:24:27.532412+0000","last_clean":"2023-12-14T18:24:27.532412+0000","last_became_active":"2023-12-14T18:23:28.903205+0000","last_became_peered":"2023-12-14T18:23:28.903205+0000","last_unstale":"2023-12-14T18:24:27.532412+0000","last_undegraded":"2023-12-14T18:24:27.532412+0000","last_fullsized":"2023-12-14T18:24:27.532412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:42:11.413770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535557+0000","last_change":"2023-12-14T18:23:29.317849+0000","last_active":"2023-12-14T18:24:27.535557+0000","last_peered":"2023-12-14T18:24:27.535557+0000","last_clean":"2023-12-14T18:24:27.535557+0000","last_became_active":"2023-12-14T18:23:29.315362+0000","last_became_peered":"2023-12-14T18:23:29.315362+0000","last_unstale":"2023-12-14T18:24:27.535557+0000","last_undegraded":"2023-12-14T18:24:27.535557+0000","last_fullsized":"2023-12-14T18:24:27.535557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:10:39.663568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534139+0000","last_change":"2023-12-14T18:23:28.906655+0000","last_active":"2023-12-14T18:24:27.534139+0000","last_peered":"2023-12-14T18:24:27.534139+0000","last_clean":"2023-12-14T18:24:27.534139+0000","last_became_active":"2023-12-14T18:23:28.906210+0000","last_became_peered":"2023-12-14T18:23:28.906210+0000","last_unstale":"2023-12-14T18:24:27.534139+0000","last_undegraded":"2023-12-14T18:24:27.534139+0000","last_fullsized":"2023-12-14T18:24:27.534139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:45:31.922598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.539577+0000","last_change":"2023-12-14T18:24:27.539577+0000","last_active":"2023-12-14T18:24:27.539577+0000","last_peered":"2023-12-14T18:24:27.539577+0000","last_clean":"2023-12-14T18:24:27.539577+0000","last_became_active":"2023-12-14T18:24:27.539242+0000","last_became_peered":"2023-12-14T18:24:27.539242+0000","last_unstale":"2023-12-14T18:24:27.539577+0000","last_undegraded":"2023-12-14T18:24:27.539577+0000","last_fullsized":"2023-12-14T18:24:27.539577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:34:30.632737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":194,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:42.448268+0000","last_change":"2023-12-14T18:23:28.901686+0000","last_active":"2023-12-14T18:24:42.448268+0000","last_peered":"2023-12-14T18:24:42.448268+0000","last_clean":"2023-12-14T18:24:42.448268+0000","last_became_active":"2023-12-14T18:23:28.901267+0000","last_became_peered":"2023-12-14T18:23:28.901267+0000","last_unstale":"2023-12-14T18:24:42.448268+0000","last_undegraded":"2023-12-14T18:24:42.448268+0000","last_fullsized":"2023-12-14T18:24:42.448268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:22:43.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56739,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":127,"num_write":30,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532535+0000","last_change":"2023-12-14T18:23:29.324216+0000","last_active":"2023-12-14T18:24:27.532535+0000","last_peered":"2023-12-14T18:24:27.532535+0000","last_clean":"2023-12-14T18:24:27.532535+0000","last_became_active":"2023-12-14T18:23:29.323897+0000","last_became_peered":"2023-12-14T18:23:29.323897+0000","last_unstale":"2023-12-14T18:24:27.532535+0000","last_undegraded":"2023-12-14T18:24:27.532535+0000","last_fullsized":"2023-12-14T18:24:27.532535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:50:34.809496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531111+0000","last_change":"2023-12-14T18:23:28.904023+0000","last_active":"2023-12-14T18:24:27.531111+0000","last_peered":"2023-12-14T18:24:27.531111+0000","last_clean":"2023-12-14T18:24:27.531111+0000","last_became_active":"2023-12-14T18:23:28.903517+0000","last_became_peered":"2023-12-14T18:23:28.903517+0000","last_unstale":"2023-12-14T18:24:27.531111+0000","last_undegraded":"2023-12-14T18:24:27.531111+0000","last_fullsized":"2023-12-14T18:24:27.531111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:34:13.079718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528595+0000","last_change":"2023-12-14T18:23:29.319657+0000","last_active":"2023-12-14T18:24:27.528595+0000","last_peered":"2023-12-14T18:24:27.528595+0000","last_clean":"2023-12-14T18:24:27.528595+0000","last_became_active":"2023-12-14T18:23:29.319249+0000","last_became_peered":"2023-12-14T18:23:29.319249+0000","last_unstale":"2023-12-14T18:24:27.528595+0000","last_undegraded":"2023-12-14T18:24:27.528595+0000","last_fullsized":"2023-12-14T18:24:27.528595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:29:03.280859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534235+0000","last_change":"2023-12-14T18:23:28.901963+0000","last_active":"2023-12-14T18:24:27.534235+0000","last_peered":"2023-12-14T18:24:27.534235+0000","last_clean":"2023-12-14T18:24:27.534235+0000","last_became_active":"2023-12-14T18:23:28.901596+0000","last_became_peered":"2023-12-14T18:23:28.901596+0000","last_unstale":"2023-12-14T18:24:27.534235+0000","last_undegraded":"2023-12-14T18:24:27.534235+0000","last_fullsized":"2023-12-14T18:24:27.534235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:19:31.264438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532288+0000","last_change":"2023-12-14T18:23:29.324435+0000","last_active":"2023-12-14T18:24:27.532288+0000","last_peered":"2023-12-14T18:24:27.532288+0000","last_clean":"2023-12-14T18:24:27.532288+0000","last_became_active":"2023-12-14T18:23:29.324034+0000","last_became_peered":"2023-12-14T18:23:29.324034+0000","last_unstale":"2023-12-14T18:24:27.532288+0000","last_undegraded":"2023-12-14T18:24:27.532288+0000","last_fullsized":"2023-12-14T18:24:27.532288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:38:34.519741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.447138+0000","last_change":"2023-12-14T18:23:28.900356+0000","last_active":"2023-12-14T18:24:41.447138+0000","last_peered":"2023-12-14T18:24:41.447138+0000","last_clean":"2023-12-14T18:24:41.447138+0000","last_became_active":"2023-12-14T18:23:28.899918+0000","last_became_peered":"2023-12-14T18:23:28.899918+0000","last_unstale":"2023-12-14T18:24:41.447138+0000","last_undegraded":"2023-12-14T18:24:41.447138+0000","last_fullsized":"2023-12-14T18:24:41.447138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:11:49.660705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532257+0000","last_change":"2023-12-14T18:23:29.324159+0000","last_active":"2023-12-14T18:24:27.532257+0000","last_peered":"2023-12-14T18:24:27.532257+0000","last_clean":"2023-12-14T18:24:27.532257+0000","last_became_active":"2023-12-14T18:23:29.323477+0000","last_became_peered":"2023-12-14T18:23:29.323477+0000","last_unstale":"2023-12-14T18:24:27.532257+0000","last_undegraded":"2023-12-14T18:24:27.532257+0000","last_fullsized":"2023-12-14T18:24:27.532257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T06:19:36.503753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:28.746333+0000","last_change":"2023-12-14T18:24:28.746333+0000","last_active":"2023-12-14T18:24:28.746333+0000","last_peered":"2023-12-14T18:24:28.746333+0000","last_clean":"2023-12-14T18:24:28.746333+0000","last_became_active":"2023-12-14T18:24:27.556325+0000","last_became_peered":"2023-12-14T18:24:27.556325+0000","last_unstale":"2023-12-14T18:24:28.746333+0000","last_undegraded":"2023-12-14T18:24:28.746333+0000","last_fullsized":"2023-12-14T18:24:28.746333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:07:56.847744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534120+0000","last_change":"2023-12-14T18:23:29.315768+0000","last_active":"2023-12-14T18:24:27.534120+0000","last_peered":"2023-12-14T18:24:27.534120+0000","last_clean":"2023-12-14T18:24:27.534120+0000","last_became_active":"2023-12-14T18:23:29.315307+0000","last_became_peered":"2023-12-14T18:23:29.315307+0000","last_unstale":"2023-12-14T18:24:27.534120+0000","last_undegraded":"2023-12-14T18:24:27.534120+0000","last_fullsized":"2023-12-14T18:24:27.534120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:25:22.539914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532250+0000","last_change":"2023-12-14T18:23:28.896218+0000","last_active":"2023-12-14T18:24:27.532250+0000","last_peered":"2023-12-14T18:24:27.532250+0000","last_clean":"2023-12-14T18:24:27.532250+0000","last_became_active":"2023-12-14T18:23:28.895797+0000","last_became_peered":"2023-12-14T18:23:28.895797+0000","last_unstale":"2023-12-14T18:24:27.532250+0000","last_undegraded":"2023-12-14T18:24:27.532250+0000","last_fullsized":"2023-12-14T18:24:27.532250+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:56:02.582193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529390+0000","last_change":"2023-12-14T18:23:29.318039+0000","last_active":"2023-12-14T18:24:27.529390+0000","last_peered":"2023-12-14T18:24:27.529390+0000","last_clean":"2023-12-14T18:24:27.529390+0000","last_became_active":"2023-12-14T18:23:29.317703+0000","last_became_peered":"2023-12-14T18:23:29.317703+0000","last_unstale":"2023-12-14T18:24:27.529390+0000","last_undegraded":"2023-12-14T18:24:27.529390+0000","last_fullsized":"2023-12-14T18:24:27.529390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:38:52.966158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561638+0000","last_change":"2023-12-14T18:23:28.900638+0000","last_active":"2023-12-14T18:24:27.561638+0000","last_peered":"2023-12-14T18:24:27.561638+0000","last_clean":"2023-12-14T18:24:27.561638+0000","last_became_active":"2023-12-14T18:23:28.900319+0000","last_became_peered":"2023-12-14T18:23:28.900319+0000","last_unstale":"2023-12-14T18:24:27.561638+0000","last_undegraded":"2023-12-14T18:24:27.561638+0000","last_fullsized":"2023-12-14T18:24:27.561638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:42:22.636519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536801+0000","last_change":"2023-12-14T18:23:29.320740+0000","last_active":"2023-12-14T18:24:27.536801+0000","last_peered":"2023-12-14T18:24:27.536801+0000","last_clean":"2023-12-14T18:24:27.536801+0000","last_became_active":"2023-12-14T18:23:29.320394+0000","last_became_peered":"2023-12-14T18:23:29.320394+0000","last_unstale":"2023-12-14T18:24:27.536801+0000","last_undegraded":"2023-12-14T18:24:27.536801+0000","last_fullsized":"2023-12-14T18:24:27.536801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:49:55.072660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532205+0000","last_change":"2023-12-14T18:23:28.904726+0000","last_active":"2023-12-14T18:24:27.532205+0000","last_peered":"2023-12-14T18:24:27.532205+0000","last_clean":"2023-12-14T18:24:27.532205+0000","last_became_active":"2023-12-14T18:23:28.904354+0000","last_became_peered":"2023-12-14T18:23:28.904354+0000","last_unstale":"2023-12-14T18:24:27.532205+0000","last_undegraded":"2023-12-14T18:24:27.532205+0000","last_fullsized":"2023-12-14T18:24:27.532205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:55:48.946039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.536575+0000","last_change":"2023-12-14T18:23:29.320078+0000","last_active":"2023-12-14T18:24:27.536575+0000","last_peered":"2023-12-14T18:24:27.536575+0000","last_clean":"2023-12-14T18:24:27.536575+0000","last_became_active":"2023-12-14T18:23:29.319747+0000","last_became_peered":"2023-12-14T18:23:29.319747+0000","last_unstale":"2023-12-14T18:24:27.536575+0000","last_undegraded":"2023-12-14T18:24:27.536575+0000","last_fullsized":"2023-12-14T18:24:27.536575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:14:52.816044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534000+0000","last_change":"2023-12-14T18:23:29.318311+0000","last_active":"2023-12-14T18:24:27.534000+0000","last_peered":"2023-12-14T18:24:27.534000+0000","last_clean":"2023-12-14T18:24:27.534000+0000","last_became_active":"2023-12-14T18:23:29.317765+0000","last_became_peered":"2023-12-14T18:23:29.317765+0000","last_unstale":"2023-12-14T18:24:27.534000+0000","last_undegraded":"2023-12-14T18:24:27.534000+0000","last_fullsized":"2023-12-14T18:24:27.534000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:05:40.832565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:41.446322+0000","last_change":"2023-12-14T18:23:28.901423+0000","last_active":"2023-12-14T18:24:41.446322+0000","last_peered":"2023-12-14T18:24:41.446322+0000","last_clean":"2023-12-14T18:24:41.446322+0000","last_became_active":"2023-12-14T18:23:28.901113+0000","last_became_peered":"2023-12-14T18:23:28.901113+0000","last_unstale":"2023-12-14T18:24:41.446322+0000","last_undegraded":"2023-12-14T18:24:41.446322+0000","last_fullsized":"2023-12-14T18:24:41.446322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:45:47.779283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560400+0000","last_change":"2023-12-14T18:23:29.307481+0000","last_active":"2023-12-14T18:24:27.560400+0000","last_peered":"2023-12-14T18:24:27.560400+0000","last_clean":"2023-12-14T18:24:27.560400+0000","last_became_active":"2023-12-14T18:23:29.307173+0000","last_became_peered":"2023-12-14T18:23:29.307173+0000","last_unstale":"2023-12-14T18:24:27.560400+0000","last_undegraded":"2023-12-14T18:24:27.560400+0000","last_fullsized":"2023-12-14T18:24:27.560400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:23:08.619045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555375+0000","last_change":"2023-12-14T18:23:28.892066+0000","last_active":"2023-12-14T18:24:27.555375+0000","last_peered":"2023-12-14T18:24:27.555375+0000","last_clean":"2023-12-14T18:24:27.555375+0000","last_became_active":"2023-12-14T18:23:28.891684+0000","last_became_peered":"2023-12-14T18:23:28.891684+0000","last_unstale":"2023-12-14T18:24:27.555375+0000","last_undegraded":"2023-12-14T18:24:27.555375+0000","last_fullsized":"2023-12-14T18:24:27.555375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:27:02.067811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532339+0000","last_change":"2023-12-14T18:22:41.663987+0000","last_active":"2023-12-14T18:24:27.532339+0000","last_peered":"2023-12-14T18:24:27.532339+0000","last_clean":"2023-12-14T18:24:27.532339+0000","last_became_active":"2023-12-14T18:22:41.663524+0000","last_became_peered":"2023-12-14T18:22:41.663524+0000","last_unstale":"2023-12-14T18:24:27.532339+0000","last_undegraded":"2023-12-14T18:24:27.532339+0000","last_fullsized":"2023-12-14T18:24:27.532339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:20:16.553476+0000","last_clean_scrub_stamp":"2023-12-14T18:20:16.553476+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:45:40.168142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528334+0000","last_change":"2023-12-14T18:23:29.314245+0000","last_active":"2023-12-14T18:24:27.528334+0000","last_peered":"2023-12-14T18:24:27.528334+0000","last_clean":"2023-12-14T18:24:27.528334+0000","last_became_active":"2023-12-14T18:23:29.313934+0000","last_became_peered":"2023-12-14T18:23:29.313934+0000","last_unstale":"2023-12-14T18:24:27.528334+0000","last_undegraded":"2023-12-14T18:24:27.528334+0000","last_fullsized":"2023-12-14T18:24:27.528334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:02:39.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532437+0000","last_change":"2023-12-14T18:23:28.904474+0000","last_active":"2023-12-14T18:24:27.532437+0000","last_peered":"2023-12-14T18:24:27.532437+0000","last_clean":"2023-12-14T18:24:27.532437+0000","last_became_active":"2023-12-14T18:23:28.904120+0000","last_became_peered":"2023-12-14T18:23:28.904120+0000","last_unstale":"2023-12-14T18:24:27.532437+0000","last_undegraded":"2023-12-14T18:24:27.532437+0000","last_fullsized":"2023-12-14T18:24:27.532437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:01:50.837514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532619+0000","last_change":"2023-12-14T18:23:28.900634+0000","last_active":"2023-12-14T18:24:27.532619+0000","last_peered":"2023-12-14T18:24:27.532619+0000","last_clean":"2023-12-14T18:24:27.532619+0000","last_became_active":"2023-12-14T18:23:28.899494+0000","last_became_peered":"2023-12-14T18:23:28.899494+0000","last_unstale":"2023-12-14T18:24:27.532619+0000","last_undegraded":"2023-12-14T18:24:27.532619+0000","last_fullsized":"2023-12-14T18:24:27.532619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:30:57.298364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528633+0000","last_change":"2023-12-14T18:23:29.312234+0000","last_active":"2023-12-14T18:24:27.528633+0000","last_peered":"2023-12-14T18:24:27.528633+0000","last_clean":"2023-12-14T18:24:27.528633+0000","last_became_active":"2023-12-14T18:23:29.311949+0000","last_became_peered":"2023-12-14T18:23:29.311949+0000","last_unstale":"2023-12-14T18:24:27.528633+0000","last_undegraded":"2023-12-14T18:24:27.528633+0000","last_fullsized":"2023-12-14T18:24:27.528633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:45:38.005408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561525+0000","last_change":"2023-12-14T18:23:28.896941+0000","last_active":"2023-12-14T18:24:27.561525+0000","last_peered":"2023-12-14T18:24:27.561525+0000","last_clean":"2023-12-14T18:24:27.561525+0000","last_became_active":"2023-12-14T18:23:28.896609+0000","last_became_peered":"2023-12-14T18:23:28.896609+0000","last_unstale":"2023-12-14T18:24:27.561525+0000","last_undegraded":"2023-12-14T18:24:27.561525+0000","last_fullsized":"2023-12-14T18:24:27.561525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:26:30.989444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560724+0000","last_change":"2023-12-14T18:23:29.322142+0000","last_active":"2023-12-14T18:24:27.560724+0000","last_peered":"2023-12-14T18:24:27.560724+0000","last_clean":"2023-12-14T18:24:27.560724+0000","last_became_active":"2023-12-14T18:23:29.321707+0000","last_became_peered":"2023-12-14T18:23:29.321707+0000","last_unstale":"2023-12-14T18:24:27.560724+0000","last_undegraded":"2023-12-14T18:24:27.560724+0000","last_fullsized":"2023-12-14T18:24:27.560724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:50:35.528934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.555511+0000","last_change":"2023-12-14T18:23:28.903425+0000","last_active":"2023-12-14T18:24:27.555511+0000","last_peered":"2023-12-14T18:24:27.555511+0000","last_clean":"2023-12-14T18:24:27.555511+0000","last_became_active":"2023-12-14T18:23:28.903102+0000","last_became_peered":"2023-12-14T18:23:28.903102+0000","last_unstale":"2023-12-14T18:24:27.555511+0000","last_undegraded":"2023-12-14T18:24:27.555511+0000","last_fullsized":"2023-12-14T18:24:27.555511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:08:46.296842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535414+0000","last_change":"2023-12-14T18:23:29.313740+0000","last_active":"2023-12-14T18:24:27.535414+0000","last_peered":"2023-12-14T18:24:27.535414+0000","last_clean":"2023-12-14T18:24:27.535414+0000","last_became_active":"2023-12-14T18:23:29.312984+0000","last_became_peered":"2023-12-14T18:23:29.312984+0000","last_unstale":"2023-12-14T18:24:27.535414+0000","last_undegraded":"2023-12-14T18:24:27.535414+0000","last_fullsized":"2023-12-14T18:24:27.535414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T18:44:49.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.542103+0000","last_change":"2023-12-14T18:24:27.542103+0000","last_active":"2023-12-14T18:24:27.542103+0000","last_peered":"2023-12-14T18:24:27.542103+0000","last_clean":"2023-12-14T18:24:27.542103+0000","last_became_active":"2023-12-14T18:24:27.539409+0000","last_became_peered":"2023-12-14T18:24:27.539409+0000","last_unstale":"2023-12-14T18:24:27.542103+0000","last_undegraded":"2023-12-14T18:24:27.542103+0000","last_fullsized":"2023-12-14T18:24:27.542103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:01:43.400341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532153+0000","last_change":"2023-12-14T18:23:29.318463+0000","last_active":"2023-12-14T18:24:27.532153+0000","last_peered":"2023-12-14T18:24:27.532153+0000","last_clean":"2023-12-14T18:24:27.532153+0000","last_became_active":"2023-12-14T18:23:29.318081+0000","last_became_peered":"2023-12-14T18:23:29.318081+0000","last_unstale":"2023-12-14T18:24:27.532153+0000","last_undegraded":"2023-12-14T18:24:27.532153+0000","last_fullsized":"2023-12-14T18:24:27.532153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:59:43.609677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560282+0000","last_change":"2023-12-14T18:23:28.903889+0000","last_active":"2023-12-14T18:24:27.560282+0000","last_peered":"2023-12-14T18:24:27.560282+0000","last_clean":"2023-12-14T18:24:27.560282+0000","last_became_active":"2023-12-14T18:23:28.903254+0000","last_became_peered":"2023-12-14T18:23:28.903254+0000","last_unstale":"2023-12-14T18:24:27.560282+0000","last_undegraded":"2023-12-14T18:24:27.560282+0000","last_fullsized":"2023-12-14T18:24:27.560282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:47:08.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528956+0000","last_change":"2023-12-14T18:23:29.317240+0000","last_active":"2023-12-14T18:24:27.528956+0000","last_peered":"2023-12-14T18:24:27.528956+0000","last_clean":"2023-12-14T18:24:27.528956+0000","last_became_active":"2023-12-14T18:23:29.316780+0000","last_became_peered":"2023-12-14T18:23:29.316780+0000","last_unstale":"2023-12-14T18:24:27.528956+0000","last_undegraded":"2023-12-14T18:24:27.528956+0000","last_fullsized":"2023-12-14T18:24:27.528956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:24:39.402213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530959+0000","last_change":"2023-12-14T18:23:28.905208+0000","last_active":"2023-12-14T18:24:27.530959+0000","last_peered":"2023-12-14T18:24:27.530959+0000","last_clean":"2023-12-14T18:24:27.530959+0000","last_became_active":"2023-12-14T18:23:28.904840+0000","last_became_peered":"2023-12-14T18:23:28.904840+0000","last_unstale":"2023-12-14T18:24:27.530959+0000","last_undegraded":"2023-12-14T18:24:27.530959+0000","last_fullsized":"2023-12-14T18:24:27.530959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:42:38.930855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.561164+0000","last_change":"2023-12-14T18:23:29.317997+0000","last_active":"2023-12-14T18:24:27.561164+0000","last_peered":"2023-12-14T18:24:27.561164+0000","last_clean":"2023-12-14T18:24:27.561164+0000","last_became_active":"2023-12-14T18:23:29.317713+0000","last_became_peered":"2023-12-14T18:23:29.317713+0000","last_unstale":"2023-12-14T18:24:27.561164+0000","last_undegraded":"2023-12-14T18:24:27.561164+0000","last_fullsized":"2023-12-14T18:24:27.561164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:53:59.350009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.547378+0000","last_change":"2023-12-14T18:24:27.547378+0000","last_active":"2023-12-14T18:24:27.547378+0000","last_peered":"2023-12-14T18:24:27.547378+0000","last_clean":"2023-12-14T18:24:27.547378+0000","last_became_active":"2023-12-14T18:24:27.535734+0000","last_became_peered":"2023-12-14T18:24:27.535734+0000","last_unstale":"2023-12-14T18:24:27.547378+0000","last_undegraded":"2023-12-14T18:24:27.547378+0000","last_fullsized":"2023-12-14T18:24:27.547378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:17:22.214140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532552+0000","last_change":"2023-12-14T18:23:29.318765+0000","last_active":"2023-12-14T18:24:27.532552+0000","last_peered":"2023-12-14T18:24:27.532552+0000","last_clean":"2023-12-14T18:24:27.532552+0000","last_became_active":"2023-12-14T18:23:29.318331+0000","last_became_peered":"2023-12-14T18:23:29.318331+0000","last_unstale":"2023-12-14T18:24:27.532552+0000","last_undegraded":"2023-12-14T18:24:27.532552+0000","last_fullsized":"2023-12-14T18:24:27.532552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T02:51:12.692007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531307+0000","last_change":"2023-12-14T18:23:28.901176+0000","last_active":"2023-12-14T18:24:27.531307+0000","last_peered":"2023-12-14T18:24:27.531307+0000","last_clean":"2023-12-14T18:24:27.531307+0000","last_became_active":"2023-12-14T18:23:28.900831+0000","last_became_peered":"2023-12-14T18:23:28.900831+0000","last_unstale":"2023-12-14T18:24:27.531307+0000","last_undegraded":"2023-12-14T18:24:27.531307+0000","last_fullsized":"2023-12-14T18:24:27.531307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:32:01.037894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532576+0000","last_change":"2023-12-14T18:23:29.318774+0000","last_active":"2023-12-14T18:24:27.532576+0000","last_peered":"2023-12-14T18:24:27.532576+0000","last_clean":"2023-12-14T18:24:27.532576+0000","last_became_active":"2023-12-14T18:23:29.318406+0000","last_became_peered":"2023-12-14T18:23:29.318406+0000","last_unstale":"2023-12-14T18:24:27.532576+0000","last_undegraded":"2023-12-14T18:24:27.532576+0000","last_fullsized":"2023-12-14T18:24:27.532576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T21:45:15.897361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533886+0000","last_change":"2023-12-14T18:23:28.907036+0000","last_active":"2023-12-14T18:24:27.533886+0000","last_peered":"2023-12-14T18:24:27.533886+0000","last_clean":"2023-12-14T18:24:27.533886+0000","last_became_active":"2023-12-14T18:23:28.906479+0000","last_became_peered":"2023-12-14T18:23:28.906479+0000","last_unstale":"2023-12-14T18:24:27.533886+0000","last_undegraded":"2023-12-14T18:24:27.533886+0000","last_fullsized":"2023-12-14T18:24:27.533886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T19:11:10.311368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532158+0000","last_change":"2023-12-14T18:23:29.324057+0000","last_active":"2023-12-14T18:24:27.532158+0000","last_peered":"2023-12-14T18:24:27.532158+0000","last_clean":"2023-12-14T18:24:27.532158+0000","last_became_active":"2023-12-14T18:23:29.323635+0000","last_became_peered":"2023-12-14T18:23:29.323635+0000","last_unstale":"2023-12-14T18:24:27.532158+0000","last_undegraded":"2023-12-14T18:24:27.532158+0000","last_fullsized":"2023-12-14T18:24:27.532158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:21:43.570678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528716+0000","last_change":"2023-12-14T18:23:28.903421+0000","last_active":"2023-12-14T18:24:27.528716+0000","last_peered":"2023-12-14T18:24:27.528716+0000","last_clean":"2023-12-14T18:24:27.528716+0000","last_became_active":"2023-12-14T18:23:28.903106+0000","last_became_peered":"2023-12-14T18:23:28.903106+0000","last_unstale":"2023-12-14T18:24:27.528716+0000","last_undegraded":"2023-12-14T18:24:27.528716+0000","last_fullsized":"2023-12-14T18:24:27.528716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:27.880081+0000","last_clean_scrub_stamp":"2023-12-14T18:23:27.880081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:26:45.633939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.532451+0000","last_change":"2023-12-14T18:23:29.328338+0000","last_active":"2023-12-14T18:24:27.532451+0000","last_peered":"2023-12-14T18:24:27.532451+0000","last_clean":"2023-12-14T18:24:27.532451+0000","last_became_active":"2023-12-14T18:23:29.328026+0000","last_became_peered":"2023-12-14T18:23:29.328026+0000","last_unstale":"2023-12-14T18:24:27.532451+0000","last_undegraded":"2023-12-14T18:24:27.532451+0000","last_fullsized":"2023-12-14T18:24:27.532451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:20:05.461484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562369+0000","last_change":"2023-12-14T18:24:27.562369+0000","last_active":"2023-12-14T18:24:27.562369+0000","last_peered":"2023-12-14T18:24:27.562369+0000","last_clean":"2023-12-14T18:24:27.562369+0000","last_became_active":"2023-12-14T18:24:27.561659+0000","last_became_peered":"2023-12-14T18:24:27.561659+0000","last_unstale":"2023-12-14T18:24:27.562369+0000","last_undegraded":"2023-12-14T18:24:27.562369+0000","last_fullsized":"2023-12-14T18:24:27.562369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T01:39:50.423823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530858+0000","last_change":"2023-12-14T18:23:29.323340+0000","last_active":"2023-12-14T18:24:27.530858+0000","last_peered":"2023-12-14T18:24:27.530858+0000","last_clean":"2023-12-14T18:24:27.530858+0000","last_became_active":"2023-12-14T18:23:29.322809+0000","last_became_peered":"2023-12-14T18:23:29.322809+0000","last_unstale":"2023-12-14T18:24:27.530858+0000","last_undegraded":"2023-12-14T18:24:27.530858+0000","last_fullsized":"2023-12-14T18:24:27.530858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:16:07.611838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.530870+0000","last_change":"2023-12-14T18:23:29.320613+0000","last_active":"2023-12-14T18:24:27.530870+0000","last_peered":"2023-12-14T18:24:27.530870+0000","last_clean":"2023-12-14T18:24:27.530870+0000","last_became_active":"2023-12-14T18:23:29.314305+0000","last_became_peered":"2023-12-14T18:23:29.314305+0000","last_unstale":"2023-12-14T18:24:27.530870+0000","last_undegraded":"2023-12-14T18:24:27.530870+0000","last_fullsized":"2023-12-14T18:24:27.530870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:28:50.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.534826+0000","last_change":"2023-12-14T18:23:29.310786+0000","last_active":"2023-12-14T18:24:27.534826+0000","last_peered":"2023-12-14T18:24:27.534826+0000","last_clean":"2023-12-14T18:24:27.534826+0000","last_became_active":"2023-12-14T18:23:29.310482+0000","last_became_peered":"2023-12-14T18:23:29.310482+0000","last_unstale":"2023-12-14T18:24:27.534826+0000","last_undegraded":"2023-12-14T18:24:27.534826+0000","last_fullsized":"2023-12-14T18:24:27.534826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:15:37.707737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528746+0000","last_change":"2023-12-14T18:23:29.311628+0000","last_active":"2023-12-14T18:24:27.528746+0000","last_peered":"2023-12-14T18:24:27.528746+0000","last_clean":"2023-12-14T18:24:27.528746+0000","last_became_active":"2023-12-14T18:23:29.311012+0000","last_became_peered":"2023-12-14T18:23:29.311012+0000","last_unstale":"2023-12-14T18:24:27.528746+0000","last_undegraded":"2023-12-14T18:24:27.528746+0000","last_fullsized":"2023-12-14T18:24:27.528746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:36:12.147192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.529374+0000","last_change":"2023-12-14T18:23:29.325855+0000","last_active":"2023-12-14T18:24:27.529374+0000","last_peered":"2023-12-14T18:24:27.529374+0000","last_clean":"2023-12-14T18:24:27.529374+0000","last_became_active":"2023-12-14T18:23:29.324922+0000","last_became_peered":"2023-12-14T18:23:29.324922+0000","last_unstale":"2023-12-14T18:24:27.529374+0000","last_undegraded":"2023-12-14T18:24:27.529374+0000","last_fullsized":"2023-12-14T18:24:27.529374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T23:02:10.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.531482+0000","last_change":"2023-12-14T18:23:29.328876+0000","last_active":"2023-12-14T18:24:27.531482+0000","last_peered":"2023-12-14T18:24:27.531482+0000","last_clean":"2023-12-14T18:24:27.531482+0000","last_became_active":"2023-12-14T18:23:29.328430+0000","last_became_peered":"2023-12-14T18:23:29.328430+0000","last_unstale":"2023-12-14T18:24:27.531482+0000","last_undegraded":"2023-12-14T18:24:27.531482+0000","last_fullsized":"2023-12-14T18:24:27.531482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:57:46.031281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560613+0000","last_change":"2023-12-14T18:23:29.311705+0000","last_active":"2023-12-14T18:24:27.560613+0000","last_peered":"2023-12-14T18:24:27.560613+0000","last_clean":"2023-12-14T18:24:27.560613+0000","last_became_active":"2023-12-14T18:23:29.311406+0000","last_became_peered":"2023-12-14T18:23:29.311406+0000","last_unstale":"2023-12-14T18:24:27.560613+0000","last_undegraded":"2023-12-14T18:24:27.560613+0000","last_fullsized":"2023-12-14T18:24:27.560613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T05:05:52.934323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.533876+0000","last_change":"2023-12-14T18:23:29.318078+0000","last_active":"2023-12-14T18:24:27.533876+0000","last_peered":"2023-12-14T18:24:27.533876+0000","last_clean":"2023-12-14T18:24:27.533876+0000","last_became_active":"2023-12-14T18:23:29.316653+0000","last_became_peered":"2023-12-14T18:23:29.316653+0000","last_unstale":"2023-12-14T18:24:27.533876+0000","last_undegraded":"2023-12-14T18:24:27.533876+0000","last_fullsized":"2023-12-14T18:24:27.533876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:53:45.243792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.560150+0000","last_change":"2023-12-14T18:23:29.323255+0000","last_active":"2023-12-14T18:24:27.560150+0000","last_peered":"2023-12-14T18:24:27.560150+0000","last_clean":"2023-12-14T18:24:27.560150+0000","last_became_active":"2023-12-14T18:23:29.322943+0000","last_became_peered":"2023-12-14T18:23:29.322943+0000","last_unstale":"2023-12-14T18:24:27.560150+0000","last_undegraded":"2023-12-14T18:24:27.560150+0000","last_fullsized":"2023-12-14T18:24:27.560150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T22:30:40.898333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.535736+0000","last_change":"2023-12-14T18:23:29.323617+0000","last_active":"2023-12-14T18:24:27.535736+0000","last_peered":"2023-12-14T18:24:27.535736+0000","last_clean":"2023-12-14T18:24:27.535736+0000","last_became_active":"2023-12-14T18:23:29.323258+0000","last_became_peered":"2023-12-14T18:23:29.323258+0000","last_unstale":"2023-12-14T18:24:27.535736+0000","last_undegraded":"2023-12-14T18:24:27.535736+0000","last_fullsized":"2023-12-14T18:24:27.535736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T03:43:41.122487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.528954+0000","last_change":"2023-12-14T18:23:29.322331+0000","last_active":"2023-12-14T18:24:27.528954+0000","last_peered":"2023-12-14T18:24:27.528954+0000","last_clean":"2023-12-14T18:24:27.528954+0000","last_became_active":"2023-12-14T18:23:29.322022+0000","last_became_peered":"2023-12-14T18:23:29.322022+0000","last_unstale":"2023-12-14T18:24:27.528954+0000","last_undegraded":"2023-12-14T18:24:27.528954+0000","last_fullsized":"2023-12-14T18:24:27.528954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T20:41:42.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-14T18:24:27.562048+0000","last_change":"2023-12-14T18:24:27.562048+0000","last_active":"2023-12-14T18:24:27.562048+0000","last_peered":"2023-12-14T18:24:27.562048+0000","last_clean":"2023-12-14T18:24:27.562048+0000","last_became_active":"2023-12-14T18:24:27.561655+0000","last_became_peered":"2023-12-14T18:24:27.561655+0000","last_unstale":"2023-12-14T18:24:27.562048+0000","last_undegraded":"2023-12-14T18:24:27.562048+0000","last_fullsized":"2023-12-14T18:24:27.562048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-14T18:23:28.881853+0000","last_clean_scrub_stamp":"2023-12-14T18:23:28.881853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-16T00:42:53.330004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62029,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":442,"num_read_kb":283,"num_write":156,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":189411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5984,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739168,"statfs":{"total":95995035648,"available":95988908032,"internally_reserved":0,"allocated":876544,"data_stored":426808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.746}]},{"osd":6,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.88400000000000001}]},{"osd":8,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89400000000000002}]},{"osd":9,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.0949999999999998,"5min":7.0949999999999998,"15min":7.0949999999999998},"last":0.872},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":9.1150000000000002,"5min":9.1150000000000002,"15min":9.1150000000000002},"last":0.94199999999999995}]},{"osd":10,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.90700000000000003}]}]},{"osd":10,"up_from":67,"seq":287762808860,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6912,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738240,"statfs":{"total":95995035648,"available":95987957760,"internally_reserved":0,"allocated":1564672,"data_stored":1075543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.44},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61199999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.45200000000000001},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.505},{"interface":"front","average":{"1min":0.63,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.42799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.51200000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.54200000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97099999999999997,"5min":1.014,"15min":1.014},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.052},"last":0.62},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.503},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.72399999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.022,"5min":1.073,"15min":1.073},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.69799999999999995,"15min":0.68799999999999994},"min":{"1min":0.60299999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98999999999999999,"5min":1.034,"15min":1.034},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85299999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.81499999999999995}]}]},{"osd":9,"up_from":62,"seq":266287972385,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6128,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93739024,"statfs":{"total":95995035648,"available":95988760576,"internally_reserved":0,"allocated":892928,"data_stored":427044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71499999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58699999999999997,"15min":0.60099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79900000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":1.163,"15min":1.163},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.49399999999999999,"15min":0.51500000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61699999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.65600000000000003,"15min":0.67400000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":0.877,"15min":0.877},"last":0.441},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84199999999999997,"5min":1.236,"15min":1.236},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.024,"15min":1.024},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73399999999999999,"5min":1.331,"15min":1.331},"last":0.498}]},{"osd":8,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91500000000000004,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93000000000000005,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61599999999999999}]},{"osd":10,"last update":"Thu Dec 14 18:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89600000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.86099999999999999,"5min":1.141,"15min":1.141},"last":0.64300000000000002}]}]},{"osd":8,"up_from":55,"seq":236223201316,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6320,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738832,"statfs":{"total":95995035648,"available":95988563968,"internally_reserved":0,"allocated":892928,"data_stored":426964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.623}]},{"osd":1,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45500000000000002,"15min":0.44500000000000001},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.877,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88400000000000001}]},{"osd":9,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95699999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.753}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.76000000000000001,"15min":0.74399999999999999},"min":{"1min":0.75,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.73899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81899999999999995}]}]},{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6964,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738188,"statfs":{"total":95995035648,"available":95987904512,"internally_reserved":0,"allocated":1486848,"data_stored":1020189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.503}]},{"osd":2,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82199999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.499},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Dec 14 18:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.622,"15min":0.625},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66600000000000004}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93400000000000005,"5min":1.986,"15min":1.986},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.83499999999999996}]},{"osd":9,"last update":"Thu Dec 14 18:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85399999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72499999999999998}]},{"osd":10,"last update":"Thu Dec 14 18:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.50900000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91400000000000003,"5min":1.069,"15min":1.069},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.53400000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.746}]}]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6244,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738908,"statfs":{"total":95995035648,"available":95988641792,"internally_reserved":0,"allocated":880640,"data_stored":426439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41399999999999998,"15min":0.41699999999999998},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.70699999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80600000000000005,"5min":0.872,"15min":0.872},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:24:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Dec 14 18:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.77600000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7324,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737828,"statfs":{"total":95995035648,"available":95987535872,"internally_reserved":0,"allocated":937984,"data_stored":482965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.52900000000000003,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.19,"15min":0.19},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.46000000000000002},"min":{"1min":0.38900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.70399999999999996,"5min":0.87,"15min":0.87},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.50800000000000001},"min":{"1min":0.42399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80900000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.745},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54000000000000004,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78600000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Dec 14 18:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.60799999999999998,"15min":0.56200000000000006},"min":{"1min":0.39000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.57399999999999995,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4809999999999999,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.44}]},{"osd":4,"last update":"Thu Dec 14 18:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.436},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80100000000000005,"5min":0.878,"15min":0.878},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Dec 14 18:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.77200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83899999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.65400000000000003,"15min":0.60799999999999998},"min":{"1min":0.501,"5min":0.373,"15min":0.373},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.70399999999999996,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.92300000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":0.995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95399999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73699999999999999}]},{"osd":9,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.753,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.3099999999999996,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.625},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.75900000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.3380000000000001,"5min":5.3380000000000001,"15min":5.3380000000000001},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Dec 14 18:24:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76700000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7160,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737992,"statfs":{"total":95995035648,"available":95987703808,"internally_reserved":0,"allocated":901120,"data_stored":427704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.438,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.46400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.51300000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.39500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.627,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Dec 14 18:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.496},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.496,"15min":0.52000000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.54700000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Dec 14 18:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71299999999999997,"5min":0.876,"15min":0.876},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.61599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.433},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67100000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.40500000000000003}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74199999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.754,"5min":0.876,"15min":0.876},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Dec 14 18:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.63400000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411384,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7400,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737752,"statfs":{"total":95995035648,"available":95987458048,"internally_reserved":0,"allocated":950272,"data_stored":483774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70399999999999996,"5min":0.747,"15min":0.747},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48799999999999999,"15min":0.47799999999999998},"min":{"1min":0.40000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Dec 14 18:24:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.52400000000000002,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65600000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.501}]},{"osd":4,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Dec 14 18:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Dec 14 18:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Dec 14 18:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.497}]},{"osd":8,"last update":"Thu Dec 14 18:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.45600000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.62},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77900000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64600000000000002}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81699999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Dec 14 18:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63300000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":426756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.33600000000000002},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.495,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60099999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Dec 14 18:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Dec 14 18:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.496}]},{"osd":6,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59799999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.437},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.49099999999999999,"15min":0.496},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.621,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68600000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Dec 14 18:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":10,"last update":"Thu Dec 14 18:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.80800000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]},{"osd":11,"last update":"Thu Dec 14 18:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.624},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56499999999999995}]}]},{"osd":4,"up_from":31,"seq":133143986226,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6384,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738768,"statfs":{"total":95995035648,"available":95988498432,"internally_reserved":0,"allocated":892928,"data_stored":427822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47199999999999998,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.376,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38,"15min":0.37},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Dec 14 18:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Dec 14 18:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.373,"15min":0.373},"max":{"1min":0.875,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55100000000000005}]},{"osd":8,"last update":"Thu Dec 14 18:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.755}]},{"osd":9,"last update":"Thu Dec 14 18:24:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.53900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu Dec 14 18:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.56799999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":1.008,"15min":1.008},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.62,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77700000000000002}]},{"osd":11,"last update":"Thu Dec 14 18:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.80100000000000005}]}]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7040,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738112,"statfs":{"total":95995035648,"available":95987826688,"internally_reserved":0,"allocated":1499136,"data_stored":1019033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.38,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.746,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.441}]},{"osd":1,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.35099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.37},"min":{"1min":0.29599999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66500000000000004,"5min":0.875,"15min":0.875},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Dec 14 18:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78800000000000003,"5min":1.02,"15min":1.02},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Dec 14 18:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.76900000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Dec 14 18:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68899999999999995}]},{"osd":8,"last update":"Thu Dec 14 18:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56999999999999995}]},{"osd":9,"last update":"Thu Dec 14 18:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.872,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85799999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55300000000000005}]},{"osd":10,"last update":"Thu Dec 14 18:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.51100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.54800000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89100000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":57821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-14T18:24:46.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:46.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 -- 172.21.15.69:0/12505980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100c90 msgr2=0x7f56cc107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/12505980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100c90 0x7f56cc107550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f56c400b0a0 tx=0x7f56c400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 -- 172.21.15.69:0/12505980 shutdown_connections 2023-12-14T18:24:46.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/12505980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100c90 0x7f56cc107550 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/12505980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc0ff110 0x7f56cc0ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/12505980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc100300 0x7f56cc100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 -- 172.21.15.69:0/12505980 >> 172.21.15.69:0/12505980 conn(0x7f56cc0fa6f0 msgr2=0x7f56cc0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:46.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 -- 172.21.15.69:0/12505980 shutdown_connections 2023-12-14T18:24:46.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.700+0000 7f56d2fc0700 1 -- 172.21.15.69:0/12505980 wait complete. 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 Processor -- start 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 -- start start 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc0ff110 0x7f56cc194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 0x7f56cc195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc100c90 0x7f56cc19c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc19ca60 con 0x7f56cc100300 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc19cba0 con 0x7f56cc100c90 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56d2fc0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc19cd30 con 0x7f56cc0ff110 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56cbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 0x7f56cc195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56cbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 0x7f56cc195420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60806/0 (socket says 172.21.15.69:60806) 2023-12-14T18:24:46.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.701+0000 7f56cbfff700 1 -- 172.21.15.69:0/3199230420 learned_addr learned my addr 172.21.15.69:0/3199230420 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56d0d5c700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc0ff110 0x7f56cc194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56d155d700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc100c90 0x7f56cc19c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56cbfff700 1 -- 172.21.15.69:0/3199230420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc0ff110 msgr2=0x7f56cc194ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56cbfff700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc0ff110 0x7f56cc194ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56cbfff700 1 -- 172.21.15.69:0/3199230420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc100c90 msgr2=0x7f56cc19c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56cbfff700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc100c90 0x7f56cc19c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56cbfff700 1 -- 172.21.15.69:0/3199230420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4009d00 con 0x7f56cc100300 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56d0d5c700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc0ff110 0x7f56cc194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56cbfff700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 0x7f56cc195420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c970 tx=0x7f56b400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4007aa0 con 0x7f56cc100300 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56b4004cc0 con 0x7f56cc100300 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc10a940 con 0x7f56cc100300 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40054a0 con 0x7f56cc100300 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.702+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc10a7b0 con 0x7f56cc100300 2023-12-14T18:24:46.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.703+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc19d370 con 0x7f56cc100300 2023-12-14T18:24:46.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.704+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f56b4004750 con 0x7f56cc100300 2023-12-14T18:24:46.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.705+0000 7f56c9ffb700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f56b80a11e0 0x7f56b80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:46.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.705+0000 7f56d0d5c700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f56b80a11e0 0x7f56b80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:46.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.705+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f56b4013070 con 0x7f56cc100300 2023-12-14T18:24:46.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.705+0000 7f56d0d5c700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f56b80a11e0 0x7f56b80a3690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56cc100160 tx=0x7f56bc00b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:46.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.708+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f56b4096220 con 0x7f56cc100300 2023-12-14T18:24:46.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.897+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56cc106010 con 0x7f56cc100300 2023-12-14T18:24:46.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.898+0000 7f56c9ffb700 1 -- 172.21.15.69:0/3199230420 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f56b4099840 con 0x7f56cc100300 2023-12-14T18:24:46.900 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:46.900 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.900+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f56b80a11e0 msgr2=0x7f56b80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.900+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f56b80a11e0 0x7f56b80a3690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56cc100160 tx=0x7f56bc00b670 comp rx=0 tx=0).stop 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.900+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 msgr2=0x7f56cc195420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.900+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 0x7f56cc195420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c970 tx=0x7f56b400cd30 comp rx=0 tx=0).stop 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 shutdown_connections 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f56b80a11e0 0x7f56b80a3690 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc100c90 0x7f56cc19c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56cc0ff110 0x7f56cc194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 --2- 172.21.15.69:0/3199230420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56cc100300 0x7f56cc195420 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:46.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 >> 172.21.15.69:0/3199230420 conn(0x7f56cc0fa6f0 msgr2=0x7f56cc0fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:46.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 shutdown_connections 2023-12-14T18:24:46.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:46.901+0000 7f56d2fc0700 1 -- 172.21.15.69:0/3199230420 wait complete. 2023-12-14T18:24:46.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:24:46.914 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:24:47.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 -- 172.21.15.69:0/2014160528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 msgr2=0x7f3b64107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2014160528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64107560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b0a0 tx=0x7f3b5c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 -- 172.21.15.69:0/2014160528 shutdown_connections 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2014160528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64107560 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2014160528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b640ff120 0x7f3b640ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2014160528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b64100310 0x7f3b64100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 -- 172.21.15.69:0/2014160528 >> 172.21.15.69:0/2014160528 conn(0x7f3b640fa740 msgr2=0x7f3b640fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 -- 172.21.15.69:0/2014160528 shutdown_connections 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.038+0000 7f3b6903c700 1 -- 172.21.15.69:0/2014160528 wait complete. 2023-12-14T18:24:47.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 Processor -- start 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 -- start start 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b640ff120 0x7f3b641030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b64100310 0x7f3b641016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641023d0 con 0x7f3b64100ca0 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64102540 con 0x7f3b640ff120 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6903c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641a0060 con 0x7f3b64100310 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64101c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60822/0 (socket says 172.21.15.69:60822) 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6359e700 1 -- 172.21.15.69:0/2892137573 learned_addr learned my addr 172.21.15.69:0/2892137573 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.039+0000 7f3b6259c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b64100310 0x7f3b641016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6359e700 1 -- 172.21.15.69:0/2892137573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b64100310 msgr2=0x7f3b641016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6359e700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b64100310 0x7f3b641016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6359e700 1 -- 172.21.15.69:0/2892137573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b640ff120 msgr2=0x7f3b641030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6359e700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b640ff120 0x7f3b641030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6359e700 1 -- 172.21.15.69:0/2892137573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c009d00 con 0x7f3b64100ca0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6359e700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64101c30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b070 tx=0x7f3b5c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00e040 con 0x7f3b64100ca0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b5c003e90 con 0x7f3b64100ca0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6410a990 con 0x7f3b64100ca0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c004020 con 0x7f3b64100ca0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.040+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6410a800 con 0x7f3b64100ca0 2023-12-14T18:24:47.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.041+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b640679f0 con 0x7f3b64100ca0 2023-12-14T18:24:47.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.042+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3b5c01b660 con 0x7f3b64100ca0 2023-12-14T18:24:47.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.042+0000 7f3b5bfff700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3b500a11e0 0x7f3b500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.043+0000 7f3b62d9d700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3b500a11e0 0x7f3b500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.043+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b5c0cecf0 con 0x7f3b64100ca0 2023-12-14T18:24:47.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.043+0000 7f3b62d9d700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3b500a11e0 0x7f3b500a3690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b64100170 tx=0x7f3b4c009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.046+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3b5c098320 con 0x7f3b64100ca0 2023-12-14T18:24:47.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.233+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b641a0e50 con 0x7f3b64100ca0 2023-12-14T18:24:47.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.234+0000 7f3b5bfff700 1 -- 172.21.15.69:0/2892137573 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b5c09b940 con 0x7f3b64100ca0 2023-12-14T18:24:47.234 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3b500a11e0 msgr2=0x7f3b500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3b500a11e0 0x7f3b500a3690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b64100170 tx=0x7f3b4c009470 comp rx=0 tx=0).stop 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 msgr2=0x7f3b64101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64101c30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b070 tx=0x7f3b5c004d30 comp rx=0 tx=0).stop 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 shutdown_connections 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3b500a11e0 0x7f3b500a3690 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b64100ca0 0x7f3b64101c30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b640ff120 0x7f3b641030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 --2- 172.21.15.69:0/2892137573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b64100310 0x7f3b641016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 >> 172.21.15.69:0/2892137573 conn(0x7f3b640fa740 msgr2=0x7f3b64067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:47.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 shutdown_connections 2023-12-14T18:24:47.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.236+0000 7f3b6903c700 1 -- 172.21.15.69:0/2892137573 wait complete. 2023-12-14T18:24:47.249 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:24:47.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 -- 172.21.15.69:0/2376490129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 msgr2=0x7fba10103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 --2- 172.21.15.69:0/2376490129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10103090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fba04009990 tx=0x7fba04009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 -- 172.21.15.69:0/2376490129 shutdown_connections 2023-12-14T18:24:47.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 --2- 172.21.15.69:0/2376490129 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba10105ef0 0x7fba10108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 --2- 172.21.15.69:0/2376490129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10103090 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 --2- 172.21.15.69:0/2376490129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba101035d0 0x7fba101059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 -- 172.21.15.69:0/2376490129 >> 172.21.15.69:0/2376490129 conn(0x7fba100fa750 msgr2=0x7fba100fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 -- 172.21.15.69:0/2376490129 shutdown_connections 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.372+0000 7fba1767e700 1 -- 172.21.15.69:0/2376490129 wait complete. 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 Processor -- start 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 -- start start 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba101035d0 0x7fba10196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba10105ef0 0x7fba1019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1019d9d0 con 0x7fba10100cb0 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1019db10 con 0x7fba101035d0 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1767e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1019dca0 con 0x7fba10105ef0 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60836/0 (socket says 172.21.15.69:60836) 2023-12-14T18:24:47.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 -- 172.21.15.69:0/2276993794 learned_addr learned my addr 172.21.15.69:0/2276993794 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba14c19700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba101035d0 0x7fba10196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 -- 172.21.15.69:0/2276993794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba10105ef0 msgr2=0x7fba1019d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba10105ef0 0x7fba1019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 -- 172.21.15.69:0/2276993794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba101035d0 msgr2=0x7fba10196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba101035d0 0x7fba10196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 -- 172.21.15.69:0/2276993794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040095f0 con 0x7fba10100cb0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.373+0000 7fba1541a700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10195e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba04006010 tx=0x7fba04003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.374+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0401d070 con 0x7fba10100cb0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.374+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1010ba40 con 0x7fba10100cb0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.374+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba04004640 con 0x7fba10100cb0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.374+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400f460 con 0x7fba10100cb0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.374+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1010b8b0 con 0x7fba10100cb0 2023-12-14T18:24:47.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.375+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100fc2c0 con 0x7fba10100cb0 2023-12-14T18:24:47.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.375+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fba04022470 con 0x7fba10100cb0 2023-12-14T18:24:47.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.376+0000 7fba027fc700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb9fc0a11e0 0x7fb9fc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.376+0000 7fba14c19700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb9fc0a11e0 0x7fb9fc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.376+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fba040ce000 con 0x7fba10100cb0 2023-12-14T18:24:47.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.377+0000 7fba14c19700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb9fc0a11e0 0x7fb9fc0a3690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fba0c005fd0 tx=0x7fba0c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:47.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.380+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fba0405c730 con 0x7fba10100cb0 2023-12-14T18:24:47.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.568+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba100617b0 con 0x7fba10100cb0 2023-12-14T18:24:47.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.569+0000 7fba027fc700 1 -- 172.21.15.69:0/2276993794 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba04097690 con 0x7fba10100cb0 2023-12-14T18:24:47.570 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb9fc0a11e0 msgr2=0x7fb9fc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb9fc0a11e0 0x7fb9fc0a3690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fba0c005fd0 tx=0x7fba0c00a560 comp rx=0 tx=0).stop 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 msgr2=0x7fba10195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10195e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba04006010 tx=0x7fba04003b00 comp rx=0 tx=0).stop 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 shutdown_connections 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb9fc0a11e0 0x7fb9fc0a3690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba10105ef0 0x7fba1019d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba10100cb0 0x7fba10195e50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 --2- 172.21.15.69:0/2276993794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba101035d0 0x7fba10196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 >> 172.21.15.69:0/2276993794 conn(0x7fba100fa750 msgr2=0x7fba10101910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:47.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 shutdown_connections 2023-12-14T18:24:47.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.571+0000 7fba1767e700 1 -- 172.21.15.69:0/2276993794 wait complete. 2023-12-14T18:24:47.584 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- 172.21.15.69:0/3534882937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d40ff120 msgr2=0x7fb1d40ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/3534882937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d40ff120 0x7fb1d40ff530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009990 tx=0x7fb1d0009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- 172.21.15.69:0/3534882937 shutdown_connections 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/3534882937 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d4100ca0 0x7fb1d4107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/3534882937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d40ff120 0x7fb1d40ff530 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/3534882937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100310 0x7fb1d4100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- 172.21.15.69:0/3534882937 >> 172.21.15.69:0/3534882937 conn(0x7fb1d40fa740 msgr2=0x7fb1d40fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- 172.21.15.69:0/3534882937 shutdown_connections 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- 172.21.15.69:0/3534882937 wait complete. 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 Processor -- start 2023-12-14T18:24:47.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- start start 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d40ff120 0x7fb1d4195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 0x7fb1d4196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100ca0 0x7fb1d419d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d419da50 con 0x7fb1d4100310 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d419db90 con 0x7fb1d40ff120 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.708+0000 7fb1dbb19700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d419dd20 con 0x7fb1d4100ca0 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 0x7fb1d4196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 0x7fb1d4196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60842/0 (socket says 172.21.15.69:60842) 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 -- 172.21.15.69:0/953322083 learned_addr learned my addr 172.21.15.69:0/953322083 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d98b5700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d40ff120 0x7fb1d4195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1da0b6700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100ca0 0x7fb1d419d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 -- 172.21.15.69:0/953322083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100ca0 msgr2=0x7fb1d419d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100ca0 0x7fb1d419d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 -- 172.21.15.69:0/953322083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d40ff120 msgr2=0x7fb1d4195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d40ff120 0x7fb1d4195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 -- 172.21.15.69:0/953322083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00095f0 con 0x7fb1d4100310 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1da0b6700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100ca0 0x7fb1d419d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1d90b4700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 0x7fb1d4196410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c920 tx=0x7fb1c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4007b00 con 0x7fb1d4100310 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d410a940 con 0x7fb1d4100310 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1c400ce70 con 0x7fb1d4100310 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40053e0 con 0x7fb1d4100310 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.709+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d410a7b0 con 0x7fb1d4100310 2023-12-14T18:24:47.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.710+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d419e3b0 con 0x7fb1d4100310 2023-12-14T18:24:47.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.711+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb1c4005560 con 0x7fb1d4100310 2023-12-14T18:24:47.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.712+0000 7fb1caffd700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1c00a11e0 0x7fb1c00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:47.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.712+0000 7fb1d98b5700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1c00a11e0 0x7fb1c00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:47.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.712+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb1c40ccaa0 con 0x7fb1d4100310 2023-12-14T18:24:47.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.712+0000 7fb1d98b5700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1c00a11e0 0x7fb1c00a3690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b5c0 tx=0x7fb1d0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:47.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.715+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb1c4096040 con 0x7fb1d4100310 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3199230420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2892137573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:47 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2276993794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-14T18:24:47.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3199230420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:47.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2892137573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:47.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:47 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2276993794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:47.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.903+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1d419e960 con 0x7fb1d4100310 2023-12-14T18:24:47.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.903+0000 7fb1caffd700 1 -- 172.21.15.69:0/953322083 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1c401d020 con 0x7fb1d4100310 2023-12-14T18:24:47.904 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:24:47.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1c00a11e0 msgr2=0x7fb1c00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1c00a11e0 0x7fb1c00a3690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b5c0 tx=0x7fb1d0005960 comp rx=0 tx=0).stop 2023-12-14T18:24:47.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 msgr2=0x7fb1d4196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 0x7fb1d4196410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c920 tx=0x7fb1c400cc30 comp rx=0 tx=0).stop 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 shutdown_connections 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1c00a11e0 0x7fb1c00a3690 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d4100ca0 0x7fb1d419d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d40ff120 0x7fb1d4195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 --2- 172.21.15.69:0/953322083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1d4100310 0x7fb1d4196410 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.905+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 >> 172.21.15.69:0/953322083 conn(0x7fb1d40fa740 msgr2=0x7fb1d40fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.906+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 shutdown_connections 2023-12-14T18:24:47.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:47.906+0000 7fb1dbb19700 1 -- 172.21.15.69:0/953322083 wait complete. 2023-12-14T18:24:47.917 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-14T18:24:47.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-14T18:24:47.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3199230420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:47.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2892137573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:24:47.918 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:47 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2276993794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:24:47.919 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 -- 172.21.15.69:0/3471653599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8341035f0 msgr2=0x7fd8341059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 --2- 172.21.15.69:0/3471653599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8341035f0 0x7fd8341059d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd824009990 tx=0x7fd824009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 -- 172.21.15.69:0/3471653599 shutdown_connections 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 --2- 172.21.15.69:0/3471653599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd834105f10 0x7fd834108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 --2- 172.21.15.69:0/3471653599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834100cd0 0x7fd8341030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 --2- 172.21.15.69:0/3471653599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8341035f0 0x7fd8341059d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 -- 172.21.15.69:0/3471653599 >> 172.21.15.69:0/3471653599 conn(0x7fd8340fa750 msgr2=0x7fd8340fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 -- 172.21.15.69:0/3471653599 shutdown_connections 2023-12-14T18:24:48.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 -- 172.21.15.69:0/3471653599 wait complete. 2023-12-14T18:24:48.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.039+0000 7fd839a37700 1 Processor -- start 2023-12-14T18:24:48.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 -- start start 2023-12-14T18:24:48.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 0x7fd834195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8341035f0 0x7fd834196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834105f10 0x7fd83419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83419da40 con 0x7fd834100cd0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83419db80 con 0x7fd834105f10 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83419dd10 con 0x7fd8341035f0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 0x7fd834195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 0x7fd834195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60866/0 (socket says 172.21.15.69:60866) 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 -- 172.21.15.69:0/2002967517 learned_addr learned my addr 172.21.15.69:0/2002967517 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd8327fc700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8341035f0 0x7fd834196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd8337fe700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834105f10 0x7fd83419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 -- 172.21.15.69:0/2002967517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8341035f0 msgr2=0x7fd834196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8341035f0 0x7fd834196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 -- 172.21.15.69:0/2002967517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834105f10 msgr2=0x7fd83419d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834105f10 0x7fd83419d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 -- 172.21.15.69:0/2002967517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240095f0 con 0x7fd834100cd0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd8337fe700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834105f10 0x7fd83419d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd832ffd700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 0x7fd834195ec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00d950 tx=0x7fd81c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c009b40 con 0x7fd834100cd0 2023-12-14T18:24:48.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd81c009ca0 con 0x7fd834100cd0 2023-12-14T18:24:48.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.040+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83410bac0 con 0x7fd834100cd0 2023-12-14T18:24:48.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.041+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00f620 con 0x7fd834100cd0 2023-12-14T18:24:48.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.041+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83410b930 con 0x7fd834100cd0 2023-12-14T18:24:48.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.041+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8340fc2c0 con 0x7fd834100cd0 2023-12-14T18:24:48.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.042+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd81c010460 con 0x7fd834100cd0 2023-12-14T18:24:48.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.043+0000 7fd838a35700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd8200a11e0 0x7fd8200a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.043+0000 7fd8327fc700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd8200a11e0 0x7fd8200a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.043+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd81c0ccdf0 con 0x7fd834100cd0 2023-12-14T18:24:48.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.043+0000 7fd8327fc700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd8200a11e0 0x7fd8200a3690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd82400b5c0 tx=0x7fd824005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.047+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd81c0963f0 con 0x7fd834100cd0 2023-12-14T18:24:48.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.282+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8340618d0 con 0x7fd834100cd0 2023-12-14T18:24:48.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.282+0000 7fd838a35700 1 -- 172.21.15.69:0/2002967517 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7fd81c020090 con 0x7fd834100cd0 2023-12-14T18:24:48.283 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:48.283 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:24:48.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd8200a11e0 msgr2=0x7fd8200a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd8200a11e0 0x7fd8200a3690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd82400b5c0 tx=0x7fd824005fb0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 msgr2=0x7fd834195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 0x7fd834195ec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00d950 tx=0x7fd81c00dd10 comp rx=0 tx=0).stop 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 shutdown_connections 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd8200a11e0 0x7fd8200a3690 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd834105f10 0x7fd83419d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd834100cd0 0x7fd834195ec0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 --2- 172.21.15.69:0/2002967517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8341035f0 0x7fd834196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.284+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 >> 172.21.15.69:0/2002967517 conn(0x7fd8340fa750 msgr2=0x7fd834101930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.285+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 shutdown_connections 2023-12-14T18:24:48.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.285+0000 7fd839a37700 1 -- 172.21.15.69:0/2002967517 wait complete. 2023-12-14T18:24:48.287 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:24:48.298 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 -- 172.21.15.69:0/277651686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e641003a0 msgr2=0x7f0e64100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/277651686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e641003a0 0x7f0e64100810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009990 tx=0x7f0e58009ca0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 -- 172.21.15.69:0/277651686 shutdown_connections 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/277651686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e64100d50 0x7f0e641075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/277651686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 0x7f0e640ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/277651686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e641003a0 0x7f0e64100810 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 -- 172.21.15.69:0/277651686 >> 172.21.15.69:0/277651686 conn(0x7f0e640f9ed0 msgr2=0x7f0e640fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 -- 172.21.15.69:0/277651686 shutdown_connections 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 -- 172.21.15.69:0/277651686 wait complete. 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.418+0000 7f0e69cc8700 1 Processor -- start 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 -- start start 2023-12-14T18:24:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 0x7f0e64195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e641003a0 0x7f0e641963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 0x7f0e6419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6419da10 con 0x7f0e64100d50 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6419db50 con 0x7f0e640ff690 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e69cc8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6419dce0 con 0x7f0e641003a0 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 0x7f0e6419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 0x7f0e6419d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60886/0 (socket says 172.21.15.69:60886) 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 -- 172.21.15.69:0/4112615398 learned_addr learned my addr 172.21.15.69:0/4112615398 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e637fe700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 0x7f0e64195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e62ffd700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e641003a0 0x7f0e641963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 -- 172.21.15.69:0/4112615398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e641003a0 msgr2=0x7f0e641963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e641003a0 0x7f0e641963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 -- 172.21.15.69:0/4112615398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 msgr2=0x7f0e64195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 0x7f0e64195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 -- 172.21.15.69:0/4112615398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580095f0 con 0x7f0e64100d50 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e637fe700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 0x7f0e64195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.419+0000 7f0e63fff700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 0x7f0e6419d440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00c970 tx=0x7f0e5c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.420+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c007b00 con 0x7f0e64100d50 2023-12-14T18:24:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.420+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e5c004cc0 con 0x7f0e64100d50 2023-12-14T18:24:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.420+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6410a990 con 0x7f0e64100d50 2023-12-14T18:24:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.420+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c005410 con 0x7f0e64100d50 2023-12-14T18:24:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.420+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6410a800 con 0x7f0e64100d50 2023-12-14T18:24:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.421+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e64067e40 con 0x7f0e64100d50 2023-12-14T18:24:48.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.422+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0e5c004750 con 0x7f0e64100d50 2023-12-14T18:24:48.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.422+0000 7f0e60ff9700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0e4c0a11e0 0x7f0e4c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.422+0000 7f0e637fe700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0e4c0a11e0 0x7f0e4c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.422+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0e5c0cc750 con 0x7f0e64100d50 2023-12-14T18:24:48.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.423+0000 7f0e637fe700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0e4c0a11e0 0x7f0e4c0a3690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e64068be0 tx=0x7f0e54009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.426+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0e5c095d50 con 0x7f0e64100d50 2023-12-14T18:24:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.619+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e6419e960 con 0x7f0e64100d50 2023-12-14T18:24:48.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.620+0000 7f0e60ff9700 1 -- 172.21.15.69:0/4112615398 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f0e5c099370 con 0x7f0e64100d50 2023-12-14T18:24:48.621 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:24:48.622 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:24:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0e4c0a11e0 msgr2=0x7f0e4c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0e4c0a11e0 0x7f0e4c0a3690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e64068be0 tx=0x7f0e54009040 comp rx=0 tx=0).stop 2023-12-14T18:24:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 msgr2=0x7f0e6419d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 0x7f0e6419d440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00c970 tx=0x7f0e5c00cd30 comp rx=0 tx=0).stop 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 shutdown_connections 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f0e4c0a11e0 0x7f0e4c0a3690 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e64100d50 0x7f0e6419d440 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e640ff690 0x7f0e64195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 --2- 172.21.15.69:0/4112615398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e641003a0 0x7f0e641963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 >> 172.21.15.69:0/4112615398 conn(0x7f0e640f9ed0 msgr2=0x7f0e640fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 shutdown_connections 2023-12-14T18:24:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.622+0000 7f0e69cc8700 1 -- 172.21.15.69:0/4112615398 wait complete. 2023-12-14T18:24:48.636 DEBUG:tasks.fwd_scrub:Yielding 2023-12-14T18:24:48.636 INFO:teuthology.run_tasks:Running task workunit... 2023-12-14T18:24:48.648 INFO:tasks.workunit:Pulling workunits from ref bf026da9d69000f3d4a9d16360156095d6612a2d 2023-12-14T18:24:48.648 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-14T18:24:48.649 INFO:tasks.workunit:timeout=3h 2023-12-14T18:24:48.649 INFO:tasks.workunit:cleanup=True 2023-12-14T18:24:48.649 DEBUG:teuthology.orchestra.run.smithi069:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:48.649 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-12-14T18:24:48.649 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T18:24:48.649 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 7ch/124d Inode: 1 Links: 2 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:fusefs_t:s0 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-14 18:23:34.737440171 +0000 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-14 18:23:34.737440171 +0000 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-14 18:24:42.220778516 +0000 2023-12-14T18:24:48.668 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-12-14T18:24:48.668 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-14T18:24:48.668 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-14T18:24:48.742 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/chrisphoffman/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bf026da9d69000f3d4a9d16360156095d6612a2d 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 -- 172.21.15.69:0/830746092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878105f60 msgr2=0x7fa878108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 --2- 172.21.15.69:0/830746092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878105f60 0x7fa878108360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa87000b0a0 tx=0x7fa87000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 -- 172.21.15.69:0/830746092 shutdown_connections 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 --2- 172.21.15.69:0/830746092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878105f60 0x7fa878108360 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 --2- 172.21.15.69:0/830746092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa878100d20 0x7fa878103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 --2- 172.21.15.69:0/830746092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa878103640 0x7fa878105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 -- 172.21.15.69:0/830746092 >> 172.21.15.69:0/830746092 conn(0x7fa8780fa780 msgr2=0x7fa8780fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 -- 172.21.15.69:0/830746092 shutdown_connections 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 -- 172.21.15.69:0/830746092 wait complete. 2023-12-14T18:24:48.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 Processor -- start 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.778+0000 7fa8800fb700 1 -- start start 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa878100d20 0x7fa878195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 0x7fa8781964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa878105f60 0x7fa87819d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819dae0 con 0x7fa878103640 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819dc20 con 0x7fa878100d20 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819ddb0 con 0x7fa878105f60 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 0x7fa8781964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 0x7fa8781964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60910/0 (socket says 172.21.15.69:60910) 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 -- 172.21.15.69:0/3763077249 learned_addr learned my addr 172.21.15.69:0/3763077249 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87de97700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa878100d20 0x7fa878195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87e698700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa878105f60 0x7fa87819d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 -- 172.21.15.69:0/3763077249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa878105f60 msgr2=0x7fa87819d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa878105f60 0x7fa87819d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 -- 172.21.15.69:0/3763077249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa878100d20 msgr2=0x7fa878195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa878100d20 0x7fa878195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 -- 172.21.15.69:0/3763077249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009d00 con 0x7fa878103640 2023-12-14T18:24:48.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa87d696700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 0x7fa8781964a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa87400d950 tx=0x7fa87400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa86effd700 1 -- 172.21.15.69:0/3763077249 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400f890 con 0x7fa878103640 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa86effd700 1 -- 172.21.15.69:0/3763077249 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa87400fe80 con 0x7fa878103640 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87810ba50 con 0x7fa878103640 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa86effd700 1 -- 172.21.15.69:0/3763077249 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400e3b0 con 0x7fa878103640 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.779+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87810b8c0 con 0x7fa878103640 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.782+0000 7fa86effd700 1 -- 172.21.15.69:0/3763077249 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa874010460 con 0x7fa878103640 2023-12-14T18:24:48.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.782+0000 7fa86effd700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8640a1260 0x7fa8640a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa86effd700 1 -- 172.21.15.69:0/3763077249 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8740cc7f0 con 0x7fa878103640 2023-12-14T18:24:48.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa87de97700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8640a1260 0x7fa8640a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 Processor -- start 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa87de97700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8640a1260 0x7fa8640a3710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa868005950 tx=0x7fa86800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 -- start start 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5580 0x5639745d5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 0x5639745d67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639744be660 con 0x5639745d5ed0 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397452d8f0 con 0x5639745d6d80 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.783+0000 7fa88c289b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563974526d80 con 0x5639745d5580 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 0x5639745d67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 0x5639745d67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60922/0 (socket says 172.21.15.69:60922) 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 -- 172.21.15.69:0/2988601566 learned_addr learned my addr 172.21.15.69:0/2988601566 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87e698700 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87de97700 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5580 0x5639745d5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 -- 172.21.15.69:0/2988601566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5580 msgr2=0x5639745d5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5580 0x5639745d5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 -- 172.21.15.69:0/2988601566 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 msgr2=0x5639745d71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745d71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 -- 172.21.15.69:0/2988601566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639743a8430 con 0x5639745d5ed0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa87d696700 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 0x5639745d67f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa874096520 tx=0x7fa874099510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d118eb27318c553e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa863fff700 1 -- 172.21.15.69:0/2988601566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87409dae0 con 0x5639745d5ed0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa863fff700 1 -- 172.21.15.69:0/2988601566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8740a1f00 con 0x5639745d5ed0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.784+0000 7fa863fff700 1 -- 172.21.15.69:0/2988601566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740a1cd0 con 0x5639745d5ed0 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 -- 172.21.15.69:0/2988601566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 msgr2=0x5639745d67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 0x5639745d67f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa874096520 tx=0x7fa874099510 comp rx=0 tx=0).stop 2023-12-14T18:24:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 -- 172.21.15.69:0/2988601566 shutdown_connections 2023-12-14T18:24:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745d71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5580 0x5639745d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 --2- 172.21.15.69:0/2988601566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5ed0 0x5639745d67f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 -- 172.21.15.69:0/2988601566 >> 172.21.15.69:0/2988601566 conn(0x5639745cad20 msgr2=0x5639745d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 -- 172.21.15.69:0/2988601566 shutdown_connections 2023-12-14T18:24:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.785+0000 7fa88c289b80 1 -- 172.21.15.69:0/2988601566 wait complete. 2023-12-14T18:24:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 -- start start 2023-12-14T18:24:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 Processor -- start 2023-12-14T18:24:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5ed0 0x5639745df530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745e6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639744c3010 con 0x5639745d5580 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639744c2cb0 con 0x5639745d6d80 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639743aa720 con 0x5639745d5ed0 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa88c289b80 10 client.0 _ll_register_callbacks cb 0x5639744e6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745deff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60936/0 (socket says 172.21.15.69:60936) 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 -- 172.21.15.69:0/3825451829 learned_addr learned my addr 172.21.15.69:0/3825451829 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87d696700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5ed0 0x5639745df530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87e698700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 -- 172.21.15.69:0/3825451829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5ed0 msgr2=0x5639745df530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5ed0 0x5639745df530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 -- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 msgr2=0x5639745e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.786+0000 7fa87de97700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745e6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa87de97700 1 -- 172.21.15.69:0/3825451829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87810b8c0 con 0x5639745d5580 2023-12-14T18:24:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa87e698700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa87de97700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745deff0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa86801da90 tx=0x7fa8680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f715728765d3cb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa8617fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa8617fa700 1 -- 172.21.15.69:0/3825451829 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868010900 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639745c8330 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa8617fa700 1 -- 172.21.15.69:0/3825451829 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa868010a60 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa8617fa700 1 -- 172.21.15.69:0/3825451829 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa868010c20 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 10 client.15381 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5639744ed1f0 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa8617fa700 1 -- 172.21.15.69:0/3825451829 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5639745c8330 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa8617fa700 1 -- 172.21.15.69:0/3825451829 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa86801b420 con 0x5639745d5580 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 10 client.15381 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 20 client.15381 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639745eadf0 0x5639745ed200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 4 client.15381 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.787+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56397451fd60 con 0x5639745eadf0 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.788+0000 7fa87d696700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639745eadf0 0x5639745ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.788+0000 7fa8617fa700 10 client.15381 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.788+0000 7fa87d696700 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639745eadf0 0x5639745ed200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=948bd85d8026c771 server_cookie=a94e51510442af45 in_seq=0 out_seq=0 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa8617fa700 1 -- 172.21.15.69:0/3825451829 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56397451fd60 con 0x5639745eadf0 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa8617fa700 10 client.15381 handle_command_reply: tid=0 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 client.15381 shutdown 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 msgr2=0x5639745deff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745deff0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa86801da90 tx=0x7fa8680047c0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 shutdown_connections 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639745eadf0 0x5639745ed200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d6d80 0x5639745e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745deff0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa8617fa700 0 client.15381 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 --2- 172.21.15.69:0/3825451829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d5ed0 0x5639745df530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 >> 172.21.15.69:0/3825451829 conn(0x5639745cad20 msgr2=0x5639745cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 shutdown_connections 2023-12-14T18:24:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 1 -- 172.21.15.69:0/3825451829 wait complete. 2023-12-14T18:24:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.789+0000 7fa88c289b80 20 client.15381 trim_cache size 0 max 16384 2023-12-14T18:24:48.797 INFO:tasks.workunit.client.0.smithi069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-14T18:24:48.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.806+0000 7fa88c289b80 1 Processor -- start 2023-12-14T18:24:48.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.806+0000 7fa88c289b80 1 -- start start 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa88c289b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639745de540 con 0x5639745d5580 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa88c289b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639745d7600 con 0x5639745d5ed0 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa88c289b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639745cf630 con 0x5639745d6d80 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60944/0 (socket says 172.21.15.69:60944) 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 -- 172.21.15.69:0/1082088881 learned_addr learned my addr 172.21.15.69:0/1082088881 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87d696700 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87e698700 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 -- 172.21.15.69:0/1082088881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 msgr2=0x5639745d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745d46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 -- 172.21.15.69:0/1082088881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 msgr2=0x5639745e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 -- 172.21.15.69:0/1082088881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639744ecf40 con 0x5639745d5580 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87d696700 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa87de97700 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745d4170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa868005c80 tx=0x7fa86800f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56adb435716ed779 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa86cff9700 1 -- 172.21.15.69:0/1082088881 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86801b420 con 0x5639745d5580 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa86cff9700 1 -- 172.21.15.69:0/1082088881 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa868014070 con 0x5639745d5580 2023-12-14T18:24:48.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.807+0000 7fa86cff9700 1 -- 172.21.15.69:0/1082088881 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868032400 con 0x5639745d5580 2023-12-14T18:24:48.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 -- 172.21.15.69:0/1082088881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 msgr2=0x5639745d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745d4170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa868005c80 tx=0x7fa86800f960 comp rx=0 tx=0).stop 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 -- 172.21.15.69:0/1082088881 shutdown_connections 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745d4170 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 --2- 172.21.15.69:0/1082088881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 -- 172.21.15.69:0/1082088881 >> 172.21.15.69:0/1082088881 conn(0x5639745cad20 msgr2=0x5639745d9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 -- 172.21.15.69:0/1082088881 shutdown_connections 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 -- 172.21.15.69:0/1082088881 wait complete. 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.808+0000 7fa88c289b80 1 -- start start 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 Processor -- start 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745e6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639745e3930 con 0x5639745d5580 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397463eca0 con 0x5639745d5ed0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397463ede0 con 0x5639745d6d80 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa88c289b80 10 client.0 _ll_register_callbacks cb 0x7fa86801d430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745e6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60948/0 (socket says 172.21.15.69:60948) 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 -- 172.21.15.69:0/606515339 learned_addr learned my addr 172.21.15.69:0/606515339 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87d696700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87e698700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 -- 172.21.15.69:0/606515339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 msgr2=0x5639745e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 -- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 msgr2=0x5639745e2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.809+0000 7fa87de97700 1 -- 172.21.15.69:0/606515339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639744ed1f0 con 0x5639745d5580 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa87de97700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745e6370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa868000c00 tx=0x7fa86801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8173b20f9f91b74f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa8617fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:48.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa8617fa700 1 -- 172.21.15.69:0/606515339 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868010910 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa8617fa700 1 -- 172.21.15.69:0/606515339 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa868004770 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8740a1f00 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa8617fa700 1 -- 172.21.15.69:0/606515339 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa868004930 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 10 client.15387 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5639744d3a20 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa8617fa700 1 -- 172.21.15.69:0/606515339 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8740a1f00 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa8617fa700 1 -- 172.21.15.69:0/606515339 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa868005490 con 0x5639745d5580 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 10 client.15387 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 20 client.15387 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639746404a0 0x5639746428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 4 client.15387 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.810+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56397451fa80 con 0x5639746404a0 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.811+0000 7fa87d696700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639746404a0 0x5639746428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.811+0000 7fa8617fa700 10 client.15387 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.811+0000 7fa87d696700 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639746404a0 0x5639746428b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b250318c948bfc35 server_cookie=25b8bca4efefa0b0 in_seq=0 out_seq=0 2023-12-14T18:24:48.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa8617fa700 1 -- 172.21.15.69:0/606515339 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56397451fa80 con 0x5639746404a0 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa8617fa700 10 client.15387 handle_command_reply: tid=0 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 client.15387 shutdown 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 msgr2=0x5639745e6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745e6370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa868000c00 tx=0x7fa86801ba30 comp rx=0 tx=0).stop 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 shutdown_connections 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5639746404a0 0x5639746428b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5639745d6d80 0x5639745e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5639745d5580 0x5639745e6370 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa8617fa700 0 client.15387 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 --2- 172.21.15.69:0/606515339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5639745d5ed0 0x5639745e2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 >> 172.21.15.69:0/606515339 conn(0x5639745cad20 msgr2=0x5639745cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 shutdown_connections 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 1 -- 172.21.15.69:0/606515339 wait complete. 2023-12-14T18:24:48.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.812+0000 7fa88c289b80 20 client.15387 trim_cache size 0 max 16384 2023-12-14T18:24:48.818 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:48.818 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T18:24:48.818 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "67e4fe5d-66bb-4546-b95d-557fb043ebd9", 2023-12-14T18:24:48.818 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T18:24:48.818 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8640a1260 msgr2=0x7fa8640a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8640a1260 0x7fa8640a3710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa868005950 tx=0x7fa86800a300 comp rx=0 tx=0).stop 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 msgr2=0x7fa8781964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 0x7fa8781964a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa87400d950 tx=0x7fa87400dc60 comp rx=0 tx=0).stop 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 shutdown_connections 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8640a1260 0x7fa8640a3710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa878105f60 0x7fa87819d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa878100d20 0x7fa878195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 --2- 172.21.15.69:0/3763077249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878103640 0x7fa8781964a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 >> 172.21.15.69:0/3763077249 conn(0x7fa8780fa780 msgr2=0x7fa878101980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 shutdown_connections 2023-12-14T18:24:48.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.813+0000 7fa8800fb700 1 -- 172.21.15.69:0/3763077249 wait complete. 2023-12-14T18:24:48.826 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:24:48.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:48 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/953322083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:48.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:48 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2002967517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:48.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:48 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/953322083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:48.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:48 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2002967517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:48.889 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:48 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/953322083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:24:48.889 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:48 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2002967517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:24:48.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 -- 172.21.15.69:0/2138074177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e80ff140 msgr2=0x7f24e80ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2138074177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e80ff140 0x7f24e80ff550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b0a0 tx=0x7f24d800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 -- 172.21.15.69:0/2138074177 shutdown_connections 2023-12-14T18:24:48.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2138074177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e8100cc0 0x7f24e8107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2138074177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e80ff140 0x7f24e80ff550 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2138074177 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24e8100330 0x7f24e8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 -- 172.21.15.69:0/2138074177 >> 172.21.15.69:0/2138074177 conn(0x7f24e80fa740 msgr2=0x7f24e80fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:48.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 -- 172.21.15.69:0/2138074177 shutdown_connections 2023-12-14T18:24:48.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.990+0000 7f24ecc23700 1 -- 172.21.15.69:0/2138074177 wait complete. 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 Processor -- start 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 -- start start 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e80ff140 0x7f24e80699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24e8100330 0x7f24e819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 0x7f24e819d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e819dae0 con 0x7f24e8100cc0 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e819dc50 con 0x7f24e8100330 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24ecc23700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e819de10 con 0x7f24e80ff140 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 0x7f24e819d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 0x7f24e819d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60962/0 (socket says 172.21.15.69:60962) 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24e6d9d700 1 -- 172.21.15.69:0/2265349723 learned_addr learned my addr 172.21.15.69:0/2265349723 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.991+0000 7f24e659c700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e80ff140 0x7f24e80699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24e8100330 0x7f24e819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e6d9d700 1 -- 172.21.15.69:0/2265349723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e80ff140 msgr2=0x7f24e80699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e80ff140 0x7f24e80699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e6d9d700 1 -- 172.21.15.69:0/2265349723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24e8100330 msgr2=0x7f24e819acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24e8100330 0x7f24e819acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e6d9d700 1 -- 172.21.15.69:0/2265349723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8009d00 con 0x7f24e8100cc0 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 0x7f24e819d340 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24e000d980 tx=0x7f24e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24df7fe700 1 -- 172.21.15.69:0/2265349723 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0004a30 con 0x7f24e8100cc0 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e810a960 con 0x7f24e8100cc0 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24df7fe700 1 -- 172.21.15.69:0/2265349723 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e000b5c0 con 0x7f24e8100cc0 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24df7fe700 1 -- 172.21.15.69:0/2265349723 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0009a40 con 0x7f24e8100cc0 2023-12-14T18:24:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.992+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e810a7d0 con 0x7f24e8100cc0 2023-12-14T18:24:48.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.994+0000 7f24df7fe700 1 -- 172.21.15.69:0/2265349723 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f24e0009be0 con 0x7f24e8100cc0 2023-12-14T18:24:48.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.994+0000 7f24df7fe700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d40a11e0 0x7f24d40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:48.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.995+0000 7f24e659c700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d40a11e0 0x7f24d40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:48.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.995+0000 7f24df7fe700 1 -- 172.21.15.69:0/2265349723 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24e00cc9a0 con 0x7f24e8100cc0 2023-12-14T18:24:48.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.995+0000 7f24e659c700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d40a11e0 0x7f24d40a3690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f24d8007a30 tx=0x7f24d800b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:48.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.995+0000 7f24f8db1b80 1 Processor -- start 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 -- start start 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cf4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cf5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3cf6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3bd95e0 con 0x5602e3cf6110 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3c48870 con 0x5602e3cf5260 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3c41d00 con 0x5602e3cf4910 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3cf6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3cf6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60974/0 (socket says 172.21.15.69:60974) 2023-12-14T18:24:49.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 -- 172.21.15.69:0/1178807986 learned_addr learned my addr 172.21.15.69:0/1178807986 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cf5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e659c700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cf4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 -- 172.21.15.69:0/1178807986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 msgr2=0x5602e3cf4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cf4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 -- 172.21.15.69:0/1178807986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 msgr2=0x5602e3cf5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cf5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 -- 172.21.15.69:0/1178807986 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602e3ac33b0 con 0x5602e3cf6110 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cf5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e659c700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cf4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3cf6580 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f24e00966d0 tx=0x7f24e0099690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbb290df21d2f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24dcff9700 1 -- 172.21.15.69:0/1178807986 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e00a20b0 con 0x5602e3cf6110 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24dcff9700 1 -- 172.21.15.69:0/1178807986 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e00ca5b0 con 0x5602e3cf6110 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.996+0000 7f24dcff9700 1 -- 172.21.15.69:0/1178807986 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e00a1e40 con 0x5602e3cf6110 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 -- 172.21.15.69:0/1178807986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 msgr2=0x5602e3cf6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:49.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3cf6580 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f24e00966d0 tx=0x7f24e0099690 comp rx=0 tx=0).stop 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 -- 172.21.15.69:0/1178807986 shutdown_connections 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3cf6580 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cf4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/1178807986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cf5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 -- 172.21.15.69:0/1178807986 >> 172.21.15.69:0/1178807986 conn(0x5602e3ce5ca0 msgr2=0x5602e3ceb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 -- 172.21.15.69:0/1178807986 shutdown_connections 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.997+0000 7f24f8db1b80 1 -- 172.21.15.69:0/1178807986 wait complete. 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 -- start start 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 Processor -- start 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cfea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3d05ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3bddf90 con 0x5602e3cf6110 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3bddc30 con 0x5602e3cf5260 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3ac56a0 con 0x5602e3cf4910 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24f8db1b80 10 client.0 _ll_register_callbacks cb 0x5602e3c01910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:49.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3d05ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3d05ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60982/0 (socket says 172.21.15.69:60982) 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 -- 172.21.15.69:0/670021122 learned_addr learned my addr 172.21.15.69:0/670021122 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cfea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 -- 172.21.15.69:0/670021122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 msgr2=0x5602e3cfe530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 -- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 msgr2=0x5602e3cfea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cfea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 -- 172.21.15.69:0/670021122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e810a7d0 con 0x5602e3cf6110 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cfea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3d05ab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f24e0099960 tx=0x7f24e0099b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53d84271e6b937e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.998+0000 7f24cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24cdffb700 1 -- 172.21.15.69:0/670021122 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e00a20b0 con 0x5602e3cf6110 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24cdffb700 1 -- 172.21.15.69:0/670021122 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24e00a1e30 con 0x5602e3cf6110 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602e3ce32b0 con 0x5602e3cf6110 2023-12-14T18:24:49.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24cdffb700 1 -- 172.21.15.69:0/670021122 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24e0095a50 con 0x5602e3cf6110 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 10 client.15399 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5602e3c08170 con 0x5602e3cf6110 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24cdffb700 1 -- 172.21.15.69:0/670021122 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5602e3ce32b0 con 0x5602e3cf6110 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24cdffb700 1 -- 172.21.15.69:0/670021122 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f24e0078d10 con 0x5602e3cf6110 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 10 client.15399 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 20 client.15399 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d09e60 0x5602e3d0c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 4 client.15399 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602e3c3ace0 con 0x5602e3d09e60 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:48.999+0000 7f24e659c700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d09e60 0x5602e3d0c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24cdffb700 10 client.15399 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24e659c700 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d09e60 0x5602e3d0c270 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f33ce4f878dfb61 server_cookie=fe894149501952f9 in_seq=0 out_seq=0 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24cdffb700 1 -- 172.21.15.69:0/670021122 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5602e3c3ace0 con 0x5602e3d09e60 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24cdffb700 10 client.15399 handle_command_reply: tid=0 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24f8db1b80 1 client.15399 shutdown 2023-12-14T18:24:49.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 msgr2=0x5602e3d05ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3d05ab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f24e0099960 tx=0x7f24e0099b60 comp rx=0 tx=0).stop 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 shutdown_connections 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.000+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d09e60 0x5602e3d0c270 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf6110 0x5602e3d05ab0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfe530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/670021122 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf5260 0x5602e3cfea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 >> 172.21.15.69:0/670021122 conn(0x5602e3ce5ca0 msgr2=0x5602e3ce9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24cdffb700 0 client.15399 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 shutdown_connections 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 1 -- 172.21.15.69:0/670021122 wait complete. 2023-12-14T18:24:49.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.001+0000 7f24f8db1b80 20 client.15399 trim_cache size 0 max 16384 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 Processor -- start 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 -- start start 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d05a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf6110 0x5602e3d062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3cec510 con 0x5602e3cf5260 2023-12-14T18:24:49.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3ce5820 con 0x5602e3cf6110 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.017+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3cff6b0 con 0x5602e3cf4910 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d05a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d05a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60990/0 (socket says 172.21.15.69:60990) 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 -- 172.21.15.69:0/499624391 learned_addr learned my addr 172.21.15.69:0/499624391 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e659c700 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf6110 0x5602e3d062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 -- 172.21.15.69:0/499624391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 msgr2=0x5602e3cfdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 -- 172.21.15.69:0/499624391 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf6110 msgr2=0x5602e3d062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf6110 0x5602e3d062e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 -- 172.21.15.69:0/499624391 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602e3cea200 con 0x5602e3cf5260 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d05a70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f24d000ecd0 tx=0x7f24d0012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5155bda266d9ed server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24dd7fa700 1 -- 172.21.15.69:0/499624391 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0004020 con 0x5602e3cf5260 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24dd7fa700 1 -- 172.21.15.69:0/499624391 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24d0003680 con 0x5602e3cf5260 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.018+0000 7f24dd7fa700 1 -- 172.21.15.69:0/499624391 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d00106a0 con 0x5602e3cf5260 2023-12-14T18:24:49.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- 172.21.15.69:0/499624391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 msgr2=0x5602e3d05a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d05a70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f24d000ecd0 tx=0x7f24d0012450 comp rx=0 tx=0).stop 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- 172.21.15.69:0/499624391 shutdown_connections 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf6110 0x5602e3d062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf4910 0x5602e3cfdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/499624391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d05a70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- 172.21.15.69:0/499624391 >> 172.21.15.69:0/499624391 conn(0x5602e3ce5ca0 msgr2=0x5602e3cfd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- 172.21.15.69:0/499624391 shutdown_connections 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- 172.21.15.69:0/499624391 wait complete. 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- start start 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 Processor -- start 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 0x5602e3d01c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d02140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf6110 0x5602e3d04df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3d05330 con 0x5602e3cf5260 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3d054a0 con 0x5602e3cf4910 2023-12-14T18:24:49.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602e3d05660 con 0x5602e3cf6110 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.019+0000 7f24f8db1b80 10 client.0 _ll_register_callbacks cb 0x5602e3c01910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d02140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 0x5602e3d01c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d02140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32768/0 (socket says 172.21.15.69:32768) 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 0x5602e3d01c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:58130/0 (socket says 172.21.15.69:58130) 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e5d9b700 1 -- 172.21.15.69:0/2967820340 learned_addr learned my addr 172.21.15.69:0/2967820340 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e6d9d700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf6110 0x5602e3d04df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 -- 172.21.15.69:0/2967820340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf6110 msgr2=0x5602e3d04df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf6110 0x5602e3d04df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 -- 172.21.15.69:0/2967820340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 msgr2=0x5602e3d02140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d02140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 -- 172.21.15.69:0/2967820340 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d000e8a0 con 0x5602e3cf4910 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d02140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24e659c700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 0x5602e3d01c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009fd0 tx=0x7f24d80099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ef72558cba78e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:24:49.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24cdffb700 1 -- 172.21.15.69:0/2967820340 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800e040 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24e00ca5b0 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24cdffb700 1 -- 172.21.15.69:0/2967820340 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24d80054c0 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24cdffb700 1 -- 172.21.15.69:0/2967820340 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24d8005680 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24f8db1b80 10 client.24983 fetch_fsmap learned FSMap version 22 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.020+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5602e3a6fb60 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24cdffb700 1 -- 172.21.15.69:0/2967820340 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e00ca5b0 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24cdffb700 1 -- 172.21.15.69:0/2967820340 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f24d8029cf0 con 0x5602e3cf4910 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24f8db1b80 10 client.24983 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24f8db1b80 10 client.24983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24f8db1b80 20 client.24983 populate_metadata read hostname 'smithi069' 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d5ebc0 0x5602e3d60fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24f8db1b80 4 client.24983 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5602e3c3aa00 con 0x5602e3d5ebc0 2023-12-14T18:24:49.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d5ebc0 0x5602e3d60fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24cdffb700 10 client.24983 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.021+0000 7f24e5d9b700 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d5ebc0 0x5602e3d60fd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced7e4f8c496bdfd server_cookie=8a06a0e2ca40c218 in_seq=0 out_seq=0 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24cdffb700 1 -- 172.21.15.69:0/2967820340 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5602e3c3aa00 con 0x5602e3d5ebc0 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24cdffb700 10 client.24983 handle_command_reply: tid=0 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 client.24983 shutdown 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 msgr2=0x5602e3d01c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 0x5602e3d01c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009fd0 tx=0x7f24d80099e0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 shutdown_connections 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5602e3d5ebc0 0x5602e3d60fd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602e3cf6110 0x5602e3d04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5602e3cf4910 0x5602e3d01c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 --2- 172.21.15.69:0/2967820340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5602e3cf5260 0x5602e3d02140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24cdffb700 0 client.24983 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 >> 172.21.15.69:0/2967820340 conn(0x5602e3ce5ca0 msgr2=0x5602e3d0be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:49.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 shutdown_connections 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 1 -- 172.21.15.69:0/2967820340 wait complete. 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24f8db1b80 20 client.24983 trim_cache size 0 max 16384 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: "67e4fe5d-66bb-4546-b95d-557fb043ebd9": { 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "67e4fe5d-66bb-4546-b95d-557fb043ebd9", 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:24:49.029 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:24:49.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d40a11e0 msgr2=0x7f24d40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:49.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d40a11e0 0x7f24d40a3690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f24d8007a30 tx=0x7f24d800b7b0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 msgr2=0x7f24e819d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:24:49.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 0x7f24e819d340 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24e000d980 tx=0x7f24e000dc90 comp rx=0 tx=0).stop 2023-12-14T18:24:49.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 shutdown_connections 2023-12-14T18:24:49.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f24d40a11e0 0x7f24d40a3690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24e8100cc0 0x7f24e819d340 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24e80ff140 0x7f24e80699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 --2- 172.21.15.69:0/2265349723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24e8100330 0x7f24e819acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:24:49.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.022+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 >> 172.21.15.69:0/2265349723 conn(0x7f24e80fa740 msgr2=0x7f24e8103820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:24:49.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.023+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 shutdown_connections 2023-12-14T18:24:49.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:24:49.023+0000 7f24ecc23700 1 -- 172.21.15.69:0/2265349723 wait complete. 2023-12-14T18:24:49.035 INFO:tasks.cephfs.filesystem:scrub status for tag:67e4fe5d-66bb-4546-b95d-557fb043ebd9 - {'path': '/', 'tag': '67e4fe5d-66bb-4546-b95d-557fb043ebd9', 'options': 'recursive,force'} 2023-12-14T18:24:49.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:49 smithi119 ceph-mon[43973]: pgmap v262: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 8 op/s 2023-12-14T18:24:49.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:49 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4112615398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:49.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:49 smithi091 ceph-mon[43601]: pgmap v262: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 8 op/s 2023-12-14T18:24:49.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:49 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4112615398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:49.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:49 smithi069 ceph-mon[42047]: pgmap v262: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 8 op/s 2023-12-14T18:24:49.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:49 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4112615398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:24:50.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:50 smithi119 ceph-mon[43973]: scrub queued for path: / 2023-12-14T18:24:50.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:50 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:24:50.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:50 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:24:50.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:50 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:24:50.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:50 smithi091 ceph-mon[43601]: scrub queued for path: / 2023-12-14T18:24:50.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:50 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:24:50.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:50 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:24:50.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:50 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:24:50.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:50 smithi069 ceph-mon[42047]: scrub queued for path: / 2023-12-14T18:24:50.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:50 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:24:50.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:50 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:24:50.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:50 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:24:51.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:51 smithi119 ceph-mon[43973]: pgmap v263: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2023-12-14T18:24:51.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:51 smithi091 ceph-mon[43601]: pgmap v263: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2023-12-14T18:24:51.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:51 smithi069 ceph-mon[42047]: pgmap v263: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2023-12-14T18:24:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:53 smithi119 ceph-mon[43973]: pgmap v264: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2023-12-14T18:24:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:53 smithi091 ceph-mon[43601]: pgmap v264: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2023-12-14T18:24:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:53 smithi069 ceph-mon[42047]: pgmap v264: 97 pgs: 97 active+clean; 642 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2023-12-14T18:24:54.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:54 smithi119 ceph-mon[43973]: scrub summary: idle 2023-12-14T18:24:54.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:54 smithi091 ceph-mon[43601]: scrub summary: idle 2023-12-14T18:24:54.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:54 smithi069 ceph-mon[42047]: scrub summary: idle 2023-12-14T18:24:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:55 smithi119 ceph-mon[43973]: pgmap v265: 97 pgs: 97 active+clean; 647 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-12-14T18:24:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:55 smithi091 ceph-mon[43601]: pgmap v265: 97 pgs: 97 active+clean; 647 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-12-14T18:24:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:55 smithi069 ceph-mon[42047]: pgmap v265: 97 pgs: 97 active+clean; 647 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-12-14T18:24:57.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:57 smithi091 ceph-mon[43601]: pgmap v266: 97 pgs: 97 active+clean; 647 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-14T18:24:57.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:57 smithi091 ceph-mon[43601]: mgrmap e18: x(active, since 6m), standbys: z, y 2023-12-14T18:24:57.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:57 smithi069 ceph-mon[42047]: pgmap v266: 97 pgs: 97 active+clean; 647 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-14T18:24:57.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:57 smithi069 ceph-mon[42047]: mgrmap e18: x(active, since 6m), standbys: z, y 2023-12-14T18:24:58.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:57 smithi119 ceph-mon[43973]: pgmap v266: 97 pgs: 97 active+clean; 647 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-14T18:24:58.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:57 smithi119 ceph-mon[43973]: mgrmap e18: x(active, since 6m), standbys: z, y 2023-12-14T18:24:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:24:59 smithi091 ceph-mon[43601]: pgmap v267: 97 pgs: 97 active+clean; 652 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-14T18:24:59.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:24:59 smithi069 ceph-mon[42047]: pgmap v267: 97 pgs: 97 active+clean; 652 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-14T18:25:00.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:24:59 smithi119 ceph-mon[43973]: pgmap v267: 97 pgs: 97 active+clean; 652 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-14T18:25:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:01 smithi069 ceph-mon[42047]: pgmap v268: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2023-12-14T18:25:02.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:01 smithi119 ceph-mon[43973]: pgmap v268: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2023-12-14T18:25:02.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:01 smithi091 ceph-mon[43601]: pgmap v268: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2023-12-14T18:25:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:03 smithi069 ceph-mon[42047]: pgmap v269: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2023-12-14T18:25:04.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:03 smithi119 ceph-mon[43973]: pgmap v269: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2023-12-14T18:25:04.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:03 smithi091 ceph-mon[43601]: pgmap v269: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2023-12-14T18:25:05.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:05 smithi069 ceph-mon[42047]: pgmap v270: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2023-12-14T18:25:06.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:05 smithi119 ceph-mon[43973]: pgmap v270: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2023-12-14T18:25:06.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:05 smithi091 ceph-mon[43601]: pgmap v270: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2023-12-14T18:25:07.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:07 smithi069 ceph-mon[42047]: pgmap v271: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-14T18:25:08.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:07 smithi119 ceph-mon[43973]: pgmap v271: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-14T18:25:08.243 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:07 smithi091 ceph-mon[43601]: pgmap v271: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-14T18:25:09.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:09 smithi069 ceph-mon[42047]: pgmap v272: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-14T18:25:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:09 smithi119 ceph-mon[43973]: pgmap v272: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-14T18:25:10.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:09 smithi091 ceph-mon[43601]: pgmap v272: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-14T18:25:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:11 smithi069 ceph-mon[42047]: pgmap v273: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:25:12.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:11 smithi119 ceph-mon[43973]: pgmap v273: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:25:12.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:11 smithi091 ceph-mon[43601]: pgmap v273: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-14T18:25:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:13 smithi069 ceph-mon[42047]: pgmap v274: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T18:25:14.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:13 smithi119 ceph-mon[43973]: pgmap v274: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T18:25:14.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:13 smithi091 ceph-mon[43601]: pgmap v274: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-14T18:25:15.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:15 smithi069 ceph-mon[42047]: pgmap v275: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:25:16.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:15 smithi119 ceph-mon[43973]: pgmap v275: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:25:16.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:15 smithi091 ceph-mon[43601]: pgmap v275: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:25:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:17 smithi069 ceph-mon[42047]: pgmap v276: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:25:18.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:17 smithi119 ceph-mon[43973]: pgmap v276: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:25:18.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:17 smithi091 ceph-mon[43601]: pgmap v276: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:25:19.036 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:25:19.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 -- 172.21.15.69:0/1473826412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c100310 msgr2=0x7efd9c100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 --2- 172.21.15.69:0/1473826412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c100310 0x7efd9c100760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009990 tx=0x7efd8c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 -- 172.21.15.69:0/1473826412 shutdown_connections 2023-12-14T18:25:19.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 --2- 172.21.15.69:0/1473826412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9c100ca0 0x7efd9c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 --2- 172.21.15.69:0/1473826412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c0ff120 0x7efd9c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 --2- 172.21.15.69:0/1473826412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c100310 0x7efd9c100760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 -- 172.21.15.69:0/1473826412 >> 172.21.15.69:0/1473826412 conn(0x7efd9c0fa740 msgr2=0x7efd9c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 -- 172.21.15.69:0/1473826412 shutdown_connections 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.228+0000 7efda4382700 1 -- 172.21.15.69:0/1473826412 wait complete. 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 Processor -- start 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 -- start start 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c0ff120 0x7efd9c1a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 0x7efd9c1a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9c100ca0 0x7efd9c1a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1a89e0 con 0x7efd9c100ca0 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1a8b50 con 0x7efd9c0ff120 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda4382700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1a8d10 con 0x7efd9c100310 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.229+0000 7efda191d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 0x7efd9c1a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 0x7efd9c1a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59060/0 (socket says 172.21.15.69:59060) 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda211e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c0ff120 0x7efd9c1a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 -- 172.21.15.69:0/2931697116 learned_addr learned my addr 172.21.15.69:0/2931697116 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda291f700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9c100ca0 0x7efd9c1a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 -- 172.21.15.69:0/2931697116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c0ff120 msgr2=0x7efd9c1a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c0ff120 0x7efd9c1a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 -- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9c100ca0 msgr2=0x7efd9c1a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9c100ca0 0x7efd9c1a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 -- 172.21.15.69:0/2931697116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0095f0 con 0x7efd9c100310 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda211e700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c0ff120 0x7efd9c1a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda191d700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 0x7efd9c1a53c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd8c005f50 tx=0x7efd8c0047a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efd937fe700 1 -- 172.21.15.69:0/2931697116 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c01d070 con 0x7efd9c100310 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efd937fe700 1 -- 172.21.15.69:0/2931697116 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd8c00be50 con 0x7efd9c100310 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efd937fe700 1 -- 172.21.15.69:0/2931697116 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c005320 con 0x7efd9c100310 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.230+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c10a9b0 con 0x7efd9c100310 2023-12-14T18:25:19.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.231+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c10a820 con 0x7efd9c100310 2023-12-14T18:25:19.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.234+0000 7efd937fe700 1 -- 172.21.15.69:0/2931697116 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7efd8c004a80 con 0x7efd9c100310 2023-12-14T18:25:19.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.235+0000 7efd937fe700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efd880a1150 0x7efd880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.235+0000 7efdb0510b80 1 Processor -- start 2023-12-14T18:25:19.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.235+0000 7efd937fe700 1 -- 172.21.15.69:0/2931697116 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efd8c0cd6e0 con 0x7efd9c100310 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 -- start start 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efda211e700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efd880a1150 0x7efd880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb49910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb4a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9ea325e0 con 0x555c9eb49500 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eaa1870 con 0x555c9eb4ad00 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efdb0510b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9ea9ad00 con 0x555c9eb49e50 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efda191d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efda191d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb4a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59072/0 (socket says 172.21.15.69:59072) 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efda191d700 1 -- 172.21.15.69:0/1818301595 learned_addr learned my addr 172.21.15.69:0/1818301595 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.236+0000 7efda211e700 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb49910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda191d700 1 -- 172.21.15.69:0/1818301595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 msgr2=0x555c9eb4b170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda191d700 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda191d700 1 -- 172.21.15.69:0/1818301595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 msgr2=0x555c9eb49910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda191d700 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb49910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda191d700 1 -- 172.21.15.69:0/1818301595 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c9e91c3b0 con 0x555c9eb49e50 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda191d700 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb4a770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd8c09ab20 tx=0x7efd8c09a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=246c71ed85a61fd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efd90dac700 1 -- 172.21.15.69:0/1818301595 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0ba050 con 0x555c9eb49e50 2023-12-14T18:25:19.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efda211e700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efd880a1150 0x7efd880a3600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd9c100170 tx=0x7efd98011cd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efd90dac700 1 -- 172.21.15.69:0/1818301595 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd8c09ab90 con 0x555c9eb49e50 2023-12-14T18:25:19.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.237+0000 7efd90dac700 1 -- 172.21.15.69:0/1818301595 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0a2ac0 con 0x555c9eb49e50 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 -- 172.21.15.69:0/1818301595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 msgr2=0x555c9eb4a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb4a770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd8c09ab20 tx=0x7efd8c09a6d0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 -- 172.21.15.69:0/1818301595 shutdown_connections 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb49910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 --2- 172.21.15.69:0/1818301595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb4a770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 -- 172.21.15.69:0/1818301595 >> 172.21.15.69:0/1818301595 conn(0x555c9eb3eca0 msgr2=0x555c9eb44430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 -- 172.21.15.69:0/1818301595 shutdown_connections 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.238+0000 7efdb0510b80 1 -- 172.21.15.69:0/1818301595 wait complete. 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.239+0000 7efdb0510b80 1 -- start start 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.239+0000 7efdb0510b80 1 Processor -- start 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 0x555c9eb52d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb4ad00 0x555c9eb5a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9ea36f90 con 0x555c9eb4ad00 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9ea36c30 con 0x555c9eb49e50 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9e91e6a0 con 0x555c9eb49500 2023-12-14T18:25:19.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efdb0510b80 10 client.0 _ll_register_callbacks cb 0x555c9ea5a910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 0x555c9eb52d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 0x555c9eb52d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59086/0 (socket says 172.21.15.69:59086) 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 -- 172.21.15.69:0/2156258020 learned_addr learned my addr 172.21.15.69:0/2156258020 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda191d700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda291f700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb4ad00 0x555c9eb5a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 -- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 msgr2=0x555c9eb532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 -- 172.21.15.69:0/2156258020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb4ad00 msgr2=0x555c9eb5a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb4ad00 0x555c9eb5a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.240+0000 7efda211e700 1 -- 172.21.15.69:0/2156258020 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c10a820 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efda211e700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 0x555c9eb52d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd98009c30 tx=0x7efd980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5cbbe46af45cb22 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efd85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efd85ffb700 1 -- 172.21.15.69:0/2156258020 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800ebd0 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efd85ffb700 1 -- 172.21.15.69:0/2156258020 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efd9800ed30 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c9eb3c2b0 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efd85ffb700 1 -- 172.21.15.69:0/2156258020 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd98004830 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efdb0510b80 10 client.24937 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555c9ea61170 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efd85ffb700 1 -- 172.21.15.69:0/2156258020 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c9eb3c2b0 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.241+0000 7efd85ffb700 1 -- 172.21.15.69:0/2156258020 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efd98033070 con 0x555c9eb49500 2023-12-14T18:25:19.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efdb0510b80 10 client.24937 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efdb0510b80 10 client.24937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efdb0510b80 20 client.24937 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efdb0510b80 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9eb5eb50 0x555c9eb60f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efdb0510b80 4 client.24937 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c9ea93ce0 con 0x555c9eb5eb50 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.242+0000 7efda191d700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9eb5eb50 0x555c9eb60f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efd85ffb700 10 client.24937 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efda191d700 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9eb5eb50 0x555c9eb60f60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174ec7968ce80e90 server_cookie=d87392a43575ff91 in_seq=0 out_seq=0 2023-12-14T18:25:19.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efd85ffb700 1 -- 172.21.15.69:0/2156258020 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555c9ea93ce0 con 0x555c9eb5eb50 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efd85ffb700 10 client.24937 handle_command_reply: tid=0 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efdb0510b80 1 client.24937 shutdown 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 msgr2=0x555c9eb52d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.243+0000 7efdb0510b80 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 0x555c9eb52d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd98009c30 tx=0x7efd980047c0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 shutdown_connections 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9eb5eb50 0x555c9eb60f60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb4ad00 0x555c9eb5a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49500 0x555c9eb52d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 --2- 172.21.15.69:0/2156258020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 >> 172.21.15.69:0/2156258020 conn(0x555c9eb3eca0 msgr2=0x555c9eb42f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efd85ffb700 0 client.24937 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:19.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 shutdown_connections 2023-12-14T18:25:19.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 1 -- 172.21.15.69:0/2156258020 wait complete. 2023-12-14T18:25:19.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.244+0000 7efdb0510b80 20 client.24937 trim_cache size 0 max 16384 2023-12-14T18:25:19.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 Processor -- start 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 -- start start 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb51020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb5a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eb4e6c0 con 0x555c9eb49500 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eb5e850 con 0x555c9eb4ad00 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efdb0510b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eb61270 con 0x555c9eb49e50 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efda191d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb5a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efda291f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efda191d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb5a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59098/0 (socket says 172.21.15.69:59098) 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efda291f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:42198/0 (socket says 172.21.15.69:42198) 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.276+0000 7efda191d700 1 -- 172.21.15.69:0/3063414978 learned_addr learned my addr 172.21.15.69:0/3063414978 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda211e700 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb51020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda191d700 1 -- 172.21.15.69:0/3063414978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 msgr2=0x555c9eb4db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda191d700 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda191d700 1 -- 172.21.15.69:0/3063414978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 msgr2=0x555c9eb51020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda191d700 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb51020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda191d700 1 -- 172.21.15.69:0/3063414978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c9eb4b3a0 con 0x555c9eb49e50 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda211e700 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb51020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efda191d700 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb5a2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd8c097090 tx=0x7efd8c0a0040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226ff2893d7bf11 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efd915ad700 1 -- 172.21.15.69:0/3063414978 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0a2f50 con 0x555c9eb49e50 2023-12-14T18:25:19.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efd915ad700 1 -- 172.21.15.69:0/3063414978 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd8c09a0f0 con 0x555c9eb49e50 2023-12-14T18:25:19.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.277+0000 7efd915ad700 1 -- 172.21.15.69:0/3063414978 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0a2d20 con 0x555c9eb49e50 2023-12-14T18:25:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 -- 172.21.15.69:0/3063414978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 msgr2=0x555c9eb5a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb5a2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd8c097090 tx=0x7efd8c0a0040 comp rx=0 tx=0).stop 2023-12-14T18:25:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 -- 172.21.15.69:0/3063414978 shutdown_connections 2023-12-14T18:25:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb4ad00 0x555c9eb4db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb51020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 --2- 172.21.15.69:0/3063414978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb49e50 0x555c9eb5a2c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 -- 172.21.15.69:0/3063414978 >> 172.21.15.69:0/3063414978 conn(0x555c9eb3eca0 msgr2=0x555c9eb60b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 -- 172.21.15.69:0/3063414978 shutdown_connections 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.278+0000 7efdb0510b80 1 -- 172.21.15.69:0/3063414978 wait complete. 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 -- start start 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 Processor -- start 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb55a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb55f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb4ad00 0x555c9eb58f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eb594a0 con 0x555c9eb49500 2023-12-14T18:25:19.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eb59610 con 0x555c9eb49e50 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9eb597d0 con 0x555c9eb4ad00 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.279+0000 7efdb0510b80 10 client.0 _ll_register_callbacks cb 0x7efd9800f8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb55f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda211e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb55a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda211e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb55a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35434/0 (socket says 172.21.15.69:35434) 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda211e700 1 -- 172.21.15.69:0/4047174725 learned_addr learned my addr 172.21.15.69:0/4047174725 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda291f700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb4ad00 0x555c9eb58f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 -- 172.21.15.69:0/4047174725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb4ad00 msgr2=0x555c9eb58f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb4ad00 0x555c9eb58f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 -- 172.21.15.69:0/4047174725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 msgr2=0x555c9eb55a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb55a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 -- 172.21.15.69:0/4047174725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c9e91c3b0 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda211e700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb55a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efda191d700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb55f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd8c09ab20 tx=0x7efd8c099120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88cca908c5aa8dd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efd85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efd85ffb700 1 -- 172.21.15.69:0/4047174725 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0a2ac0 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c9eb52130 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.280+0000 7efd85ffb700 1 -- 172.21.15.69:0/4047174725 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efd8c0a2c20 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efd85ffb700 1 -- 172.21.15.69:0/4047174725 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd8c005480 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 10 client.24998 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555c9e8c8b60 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efd85ffb700 1 -- 172.21.15.69:0/4047174725 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c9eb52130 con 0x555c9eb49e50 2023-12-14T18:25:19.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efd85ffb700 1 -- 172.21.15.69:0/4047174725 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efd8c096b60 con 0x555c9eb49e50 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 10 client.24998 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 10 client.24998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 20 client.24998 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9ebb2e70 0x555c9ebb5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 4 client.24998 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7efd8c09ab90 con 0x555c9ebb2e70 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.281+0000 7efda211e700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9ebb2e70 0x555c9ebb5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efd85ffb700 10 client.24998 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efda211e700 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9ebb2e70 0x555c9ebb5280 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87448dbf2e5c0c81 server_cookie=2b38fb32a70423bb in_seq=0 out_seq=0 2023-12-14T18:25:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efd85ffb700 1 -- 172.21.15.69:0/4047174725 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7efd8c09ab90 con 0x555c9ebb2e70 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efd85ffb700 10 client.24998 handle_command_reply: tid=0 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 client.24998 shutdown 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 msgr2=0x555c9eb55f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb55f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd8c09ab20 tx=0x7efd8c099120 comp rx=0 tx=0).stop 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 shutdown_connections 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555c9ebb2e70 0x555c9ebb5280 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555c9eb4ad00 0x555c9eb58f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efd85ffb700 0 client.24998 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c9eb49500 0x555c9eb55a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 --2- 172.21.15.69:0/4047174725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555c9eb49e50 0x555c9eb55f40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 >> 172.21.15.69:0/4047174725 conn(0x555c9eb3eca0 msgr2=0x555c9eb51020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 shutdown_connections 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.282+0000 7efdb0510b80 1 -- 172.21.15.69:0/4047174725 wait complete. 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efdb0510b80 20 client.24998 trim_cache size 0 max 16384 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T18:25:19.291 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:25:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efd880a1150 msgr2=0x7efd880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efd880a1150 0x7efd880a3600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd9c100170 tx=0x7efd98011cd0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 msgr2=0x7efd9c1a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 0x7efd9c1a53c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd8c005f50 tx=0x7efd8c0047a0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 shutdown_connections 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7efd880a1150 0x7efd880a3600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9c100ca0 0x7efd9c1a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd9c0ff120 0x7efd9c1a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 --2- 172.21.15.69:0/2931697116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd9c100310 0x7efd9c1a53c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 >> 172.21.15.69:0/2931697116 conn(0x7efd9c0fa740 msgr2=0x7efd9c0fb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 shutdown_connections 2023-12-14T18:25:19.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.283+0000 7efda4382700 1 -- 172.21.15.69:0/2931697116 wait complete. 2023-12-14T18:25:19.300 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T18:25:19.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:25:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 -- 172.21.15.69:0/3576751210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 msgr2=0x7f6efc108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 --2- 172.21.15.69:0/3576751210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc108680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400b0a0 tx=0x7f6ef400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 -- 172.21.15.69:0/3576751210 shutdown_connections 2023-12-14T18:25:19.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 --2- 172.21.15.69:0/3576751210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc108680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 --2- 172.21.15.69:0/3576751210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6efc100240 0x7f6efc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 --2- 172.21.15.69:0/3576751210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc101430 0x7f6efc101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 -- 172.21.15.69:0/3576751210 >> 172.21.15.69:0/3576751210 conn(0x7f6efc0fb820 msgr2=0x7f6efc0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 -- 172.21.15.69:0/3576751210 shutdown_connections 2023-12-14T18:25:19.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 -- 172.21.15.69:0/3576751210 wait complete. 2023-12-14T18:25:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 Processor -- start 2023-12-14T18:25:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.440+0000 7f6f02889700 1 -- start start 2023-12-14T18:25:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f02889700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 0x7f6efc06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f02889700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6efc101430 0x7f6efc06f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f02889700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc195040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f02889700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc06ff20 con 0x7f6efc100240 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f02889700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc070090 con 0x7f6efc101dc0 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f02889700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc195600 con 0x7f6efc101430 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 0x7f6efc06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 0x7f6efc06f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35452/0 (socket says 172.21.15.69:35452) 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 -- 172.21.15.69:0/4006624904 learned_addr learned my addr 172.21.15.69:0/4006624904 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efb7fe700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6efc101430 0x7f6efc06f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f00e26700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc195040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 -- 172.21.15.69:0/4006624904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6efc101430 msgr2=0x7f6efc06f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6efc101430 0x7f6efc06f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 -- 172.21.15.69:0/4006624904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 msgr2=0x7f6efc195040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc195040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 -- 172.21.15.69:0/4006624904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009d00 con 0x7f6efc100240 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6f00e26700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc195040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.441+0000 7f6efbfff700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 0x7f6efc06f3e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00e970 tx=0x7f6eec00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.442+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec009790 con 0x7f6efc100240 2023-12-14T18:25:19.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.442+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6eec0044b0 con 0x7f6efc100240 2023-12-14T18:25:19.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.442+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc10ba60 con 0x7f6efc100240 2023-12-14T18:25:19.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.442+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec003dd0 con 0x7f6efc100240 2023-12-14T18:25:19.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.442+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc10b8d0 con 0x7f6efc100240 2023-12-14T18:25:19.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.443+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc1070d0 con 0x7f6efc100240 2023-12-14T18:25:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.451+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6eec004020 con 0x7f6efc100240 2023-12-14T18:25:19.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.452+0000 7f6ef97fa700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ee40a11d0 0x7f6ee40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.452+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6eec014070 con 0x7f6efc100240 2023-12-14T18:25:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.452+0000 7f6efb7fe700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ee40a11d0 0x7f6ee40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.453+0000 7f6efb7fe700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ee40a11d0 0x7f6ee40a3680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6efc070500 tx=0x7f6ef0005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.454+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6eec096490 con 0x7f6efc100240 2023-12-14T18:25:19.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.733+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6efc02cfe0 con 0x7f6efc100240 2023-12-14T18:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.734+0000 7f6ef97fa700 1 -- 172.21.15.69:0/4006624904 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10792 (secure 0 0 0) 0x7f6eec099ab0 con 0x7f6efc100240 2023-12-14T18:25:19.735 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:25:19.736 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:23:34.332024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ee40a11d0 msgr2=0x7f6ee40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ee40a11d0 0x7f6ee40a3680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6efc070500 tx=0x7f6ef0005d50 comp rx=0 tx=0).stop 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 msgr2=0x7f6efc06f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 0x7f6efc06f3e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00e970 tx=0x7f6eec00ed30 comp rx=0 tx=0).stop 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 shutdown_connections 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ee40a11d0 0x7f6ee40a3680 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6efc070500 tx=0x7f6ef0005d50 comp rx=0 tx=0).stop 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6efc101dc0 0x7f6efc195040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6efc100240 0x7f6efc06f3e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 --2- 172.21.15.69:0/4006624904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6efc101430 0x7f6efc06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.736+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 >> 172.21.15.69:0/4006624904 conn(0x7f6efc0fb820 msgr2=0x7f6efc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.738+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 shutdown_connections 2023-12-14T18:25:19.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.738+0000 7f6f02889700 1 -- 172.21.15.69:0/4006624904 wait complete. 2023-12-14T18:25:19.740 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2023-12-14T18:25:19.751 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T18:25:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 -- 172.21.15.69:0/3581144320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 msgr2=0x7fa9081059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 --2- 172.21.15.69:0/3581144320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa9081059e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009990 tx=0x7fa8fc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 -- 172.21.15.69:0/3581144320 shutdown_connections 2023-12-14T18:25:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 --2- 172.21.15.69:0/3581144320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 0x7fa908108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 --2- 172.21.15.69:0/3581144320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa908100ce0 0x7fa9081030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 --2- 172.21.15.69:0/3581144320 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa9081059e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 -- 172.21.15.69:0/3581144320 >> 172.21.15.69:0/3581144320 conn(0x7fa9080fa780 msgr2=0x7fa9080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 -- 172.21.15.69:0/3581144320 shutdown_connections 2023-12-14T18:25:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.879+0000 7fa90d974700 1 -- 172.21.15.69:0/3581144320 wait complete. 2023-12-14T18:25:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 Processor -- start 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 -- start start 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa908100ce0 0x7fa908195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa908196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 0x7fa90819d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90819da60 con 0x7fa908100ce0 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90806a510 con 0x7fa908103600 2023-12-14T18:25:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa90d974700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90806a6a0 con 0x7fa908105f20 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa9067fc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa908196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa9077fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 0x7fa90819d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa9067fc700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa908196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:42258/0 (socket says 172.21.15.69:42258) 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa9077fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 0x7fa90819d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59150/0 (socket says 172.21.15.69:59150) 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.880+0000 7fa9067fc700 1 -- 172.21.15.69:0/872808959 learned_addr learned my addr 172.21.15.69:0/872808959 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa906ffd700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa908100ce0 0x7fa908195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa9067fc700 1 -- 172.21.15.69:0/872808959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 msgr2=0x7fa90819d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa9067fc700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 0x7fa90819d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa9067fc700 1 -- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa908100ce0 msgr2=0x7fa908195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa9067fc700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa908100ce0 0x7fa908195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa9067fc700 1 -- 172.21.15.69:0/872808959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0095f0 con 0x7fa908103600 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa9067fc700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa908196420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0059d0 tx=0x7fa8fc004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa90c972700 1 -- 172.21.15.69:0/872808959 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc01d070 con 0x7fa908103600 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90810bad0 con 0x7fa908103600 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90810b940 con 0x7fa908103600 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa90c972700 1 -- 172.21.15.69:0/872808959 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8fc00be30 con 0x7fa908103600 2023-12-14T18:25:19.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.881+0000 7fa90c972700 1 -- 172.21.15.69:0/872808959 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00fd30 con 0x7fa908103600 2023-12-14T18:25:19.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.884+0000 7fa90c972700 1 -- 172.21.15.69:0/872808959 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa8fc00f460 con 0x7fa908103600 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.885+0000 7fa90c972700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8f00a1250 0x7fa8f00a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.885+0000 7fa90c972700 1 -- 172.21.15.69:0/872808959 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8fc0cdc10 con 0x7fa908103600 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.885+0000 7fa906ffd700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8f00a1250 0x7fa8f00a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa906ffd700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8f00a1250 0x7fa8f00a3700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009a10 tx=0x7fa8f8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 Processor -- start 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 -- start start 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a0500 0x5603061a0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a1d00 0x5603061a2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603060895e0 con 0x5603061a0e50 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603060f8870 con 0x5603061a1d00 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa919b02b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603060f1d00 con 0x5603061a0500 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa9067fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa9067fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35478/0 (socket says 172.21.15.69:35478) 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa9067fc700 1 -- 172.21.15.69:0/345084722 learned_addr learned my addr 172.21.15.69:0/345084722 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa906ffd700 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a0500 0x5603061a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.886+0000 7fa9077fe700 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a1d00 0x5603061a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa906ffd700 1 -- 172.21.15.69:0/345084722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a1d00 msgr2=0x5603061a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa906ffd700 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a1d00 0x5603061a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa906ffd700 1 -- 172.21.15.69:0/345084722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 msgr2=0x5603061a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa906ffd700 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa906ffd700 1 -- 172.21.15.69:0/345084722 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560305f733b0 con 0x5603061a0500 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa906ffd700 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a0500 0x5603061a0910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800e9e0 tx=0x7fa8f8011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa22fcb515706707 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa8edffb700 1 -- 172.21.15.69:0/345084722 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800ee20 con 0x5603061a0500 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa8edffb700 1 -- 172.21.15.69:0/345084722 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8f8015910 con 0x5603061a0500 2023-12-14T18:25:19.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.887+0000 7fa8edffb700 1 -- 172.21.15.69:0/345084722 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8013890 con 0x5603061a0500 2023-12-14T18:25:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 -- 172.21.15.69:0/345084722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a0500 msgr2=0x5603061a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a0500 0x5603061a0910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800e9e0 tx=0x7fa8f8011000 comp rx=0 tx=0).stop 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 -- 172.21.15.69:0/345084722 shutdown_connections 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a1d00 0x5603061a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a0500 0x5603061a0910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 --2- 172.21.15.69:0/345084722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 -- 172.21.15.69:0/345084722 >> 172.21.15.69:0/345084722 conn(0x560306195ca0 msgr2=0x56030619b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 -- 172.21.15.69:0/345084722 shutdown_connections 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 -- 172.21.15.69:0/345084722 wait complete. 2023-12-14T18:25:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.888+0000 7fa919b02b80 1 -- start start 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 Processor -- start 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x5603061ba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56030608df90 con 0x5603061b8070 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56030608dc30 con 0x5603061a0e50 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560305f756a0 con 0x5603061a1d00 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa919b02b80 10 client.0 _ll_register_callbacks cb 0x5603060b1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa9077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x5603061ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa9077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x5603061ba450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35486/0 (socket says 172.21.15.69:35486) 2023-12-14T18:25:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa9077fe700 1 -- 172.21.15.69:0/4182335951 learned_addr learned my addr 172.21.15.69:0/4182335951 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa9067fc700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.889+0000 7fa906ffd700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9067fc700 1 -- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 msgr2=0x5603061b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9067fc700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9067fc700 1 -- 172.21.15.69:0/4182335951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 msgr2=0x5603061ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9067fc700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x5603061ba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9067fc700 1 -- 172.21.15.69:0/4182335951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f800e6c0 con 0x5603061a1d00 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa906ffd700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9077fe700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x5603061ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa9067fc700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061b3040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc097620 tx=0x7fa8fc09b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a27a2a217aff005 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa8e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/4182335951 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0a3250 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/4182335951 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8fc09b120 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603061932b0 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/4182335951 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8fc09ac60 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa919b02b80 10 client.24958 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.890+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5603060b8170 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/4182335951 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603061932b0 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/4182335951 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8fc0b9250 con 0x5603061a1d00 2023-12-14T18:25:19.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa919b02b80 10 client.24958 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa919b02b80 10 client.24958 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa919b02b80 20 client.24958 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa919b02b80 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x5603061be980 0x5603061c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa919b02b80 4 client.24958 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.891+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603060eace0 con 0x5603061be980 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.892+0000 7fa906ffd700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x5603061be980 0x5603061c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.892+0000 7fa8e6ffd700 10 client.24958 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.892+0000 7fa906ffd700 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x5603061be980 0x5603061c0d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=421be41761cc953 server_cookie=6aeb84646cd56878 in_seq=0 out_seq=0 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/4182335951 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5603060eace0 con 0x5603061be980 2023-12-14T18:25:19.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa8e6ffd700 10 client.24958 handle_command_reply: tid=0 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 client.24958 shutdown 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 msgr2=0x5603061b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061b3040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc097620 tx=0x7fa8fc09b660 comp rx=0 tx=0).stop 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 shutdown_connections 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x5603061be980 0x5603061c0d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x5603061ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa8e6ffd700 0 client.24958 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 --2- 172.21.15.69:0/4182335951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061b3040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 >> 172.21.15.69:0/4182335951 conn(0x560306195ca0 msgr2=0x560306199f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 shutdown_connections 2023-12-14T18:25:19.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 1 -- 172.21.15.69:0/4182335951 wait complete. 2023-12-14T18:25:19.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.893+0000 7fa919b02b80 20 client.24958 trim_cache size 0 max 16384 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.906+0000 7fa919b02b80 1 Processor -- start 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 -- start start 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061a8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061b8070 0x5603061b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56030619c6f0 con 0x5603061a0e50 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603061b2670 con 0x5603061b8070 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa919b02b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56030619b9e0 con 0x5603061a1d00 2023-12-14T18:25:19.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35490/0 (socket says 172.21.15.69:35490) 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 -- 172.21.15.69:0/1585665686 learned_addr learned my addr 172.21.15.69:0/1585665686 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa9067fc700 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa9077fe700 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061b8070 0x5603061b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 -- 172.21.15.69:0/1585665686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 msgr2=0x5603061a8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061a8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 -- 172.21.15.69:0/1585665686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061b8070 msgr2=0x5603061b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061b8070 0x5603061b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa906ffd700 1 -- 172.21.15.69:0/1585665686 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603060b7ec0 con 0x5603061a0e50 2023-12-14T18:25:19.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.907+0000 7fa9077fe700 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061b8070 0x5603061b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:19.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.908+0000 7fa906ffd700 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061ce610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800e9b0 tx=0x7fa8f8006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5943ec180f73e919 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.908+0000 7fa8ee7fc700 1 -- 172.21.15.69:0/1585665686 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8015c80 con 0x5603061a0e50 2023-12-14T18:25:19.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.908+0000 7fa8ee7fc700 1 -- 172.21.15.69:0/1585665686 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8f8015de0 con 0x5603061a0e50 2023-12-14T18:25:19.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.908+0000 7fa8ee7fc700 1 -- 172.21.15.69:0/1585665686 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80336b0 con 0x5603061a0e50 2023-12-14T18:25:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 -- 172.21.15.69:0/1585665686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 msgr2=0x5603061ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061ce610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800e9b0 tx=0x7fa8f8006d90 comp rx=0 tx=0).stop 2023-12-14T18:25:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 -- 172.21.15.69:0/1585665686 shutdown_connections 2023-12-14T18:25:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061b8070 0x5603061b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061a0e50 0x5603061ce610 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1585665686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061a8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 -- 172.21.15.69:0/1585665686 >> 172.21.15.69:0/1585665686 conn(0x560306195ca0 msgr2=0x5603061bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 -- 172.21.15.69:0/1585665686 shutdown_connections 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 -- 172.21.15.69:0/1585665686 wait complete. 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.909+0000 7fa919b02b80 1 -- start start 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 Processor -- start 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x560306210fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603062115b0 con 0x5603061b8070 2023-12-14T18:25:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x560306211720 con 0x5603061a0e50 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603062118e0 con 0x5603061a1d00 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa919b02b80 10 client.0 _ll_register_callbacks cb 0x5603060b1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061a7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:42304/0 (socket says 172.21.15.69:42304) 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 -- 172.21.15.69:0/1702715629 learned_addr learned my addr 172.21.15.69:0/1702715629 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa9077fe700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x560306210fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 -- 172.21.15.69:0/1702715629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 msgr2=0x5603061ce610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061ce610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 -- 172.21.15.69:0/1702715629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 msgr2=0x560306210fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x560306210fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa906ffd700 1 -- 172.21.15.69:0/1702715629 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560305f733b0 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.910+0000 7fa9077fe700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x560306210fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa906ffd700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061a7680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8034750 tx=0x7fa8f8015a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d335f352a91ef67c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa8e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/1702715629 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8034e90 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8f8015910 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/1702715629 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8f802d040 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/1702715629 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8f804b480 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa919b02b80 10 client.25019 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56030609e9a0 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/1702715629 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8f8015910 con 0x5603061a0e50 2023-12-14T18:25:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.911+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/1702715629 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8f803b040 con 0x5603061a0e50 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 10 client.25019 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 10 client.25019 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 20 client.25019 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x560306212f50 0x560306215360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 4 client.25019 mds_command: new command op to 24458 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5603060eaa00 con 0x560306212f50 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa9067fc700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x560306212f50 0x560306215360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa9067fc700 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x560306212f50 0x560306215360 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d1fbd7549215aff server_cookie=f5037fae9d5d0166 in_seq=0 out_seq=0 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa8e6ffd700 10 client.25019 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa8e6ffd700 1 -- 172.21.15.69:0/1702715629 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5603060eaa00 con 0x560306212f50 2023-12-14T18:25:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa8e6ffd700 10 client.25019 handle_command_reply: tid=0 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 1 client.25019 shutdown 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 msgr2=0x5603061a7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.912+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061a7680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8034750 tx=0x7fa8f8015a80 comp rx=0 tx=0).stop 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 shutdown_connections 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x560306212f50 0x560306215360 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603061b8070 0x560306210fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603061a0e50 0x5603061a7680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa8e6ffd700 0 client.25019 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 --2- 172.21.15.69:0/1702715629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603061a1d00 0x5603061ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 >> 172.21.15.69:0/1702715629 conn(0x560306195ca0 msgr2=0x5603061a8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 shutdown_connections 2023-12-14T18:25:19.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 1 -- 172.21.15.69:0/1702715629 wait complete. 2023-12-14T18:25:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa919b02b80 20 client.25019 trim_cache size 0 max 16384 2023-12-14T18:25:19.921 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8f00a1250 msgr2=0x7fa8f00a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa90d974700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8f00a1250 0x7fa8f00a3700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009a10 tx=0x7fa8f8009190 comp rx=0 tx=0).stop 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 msgr2=0x7fa908196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.913+0000 7fa90d974700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa908196420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0059d0 tx=0x7fa8fc004790 comp rx=0 tx=0).stop 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.914+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 shutdown_connections 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.914+0000 7fa90d974700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa8f00a1250 0x7fa8f00a3700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.914+0000 7fa90d974700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa908105f20 0x7fa90819d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.914+0000 7fa90d974700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa908100ce0 0x7fa908195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.914+0000 7fa90d974700 1 --2- 172.21.15.69:0/872808959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa908103600 0x7fa908196420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:19.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.914+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 >> 172.21.15.69:0/872808959 conn(0x7fa9080fa780 msgr2=0x7fa908102160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:19.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.916+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 shutdown_connections 2023-12-14T18:25:19.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:19.916+0000 7fa90d974700 1 -- 172.21.15.69:0/872808959 wait complete. 2023-12-14T18:25:19.928 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:19 smithi069 ceph-mon[42047]: pgmap v277: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:25:19.930 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T18:25:20.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 -- 172.21.15.69:0/33865200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 msgr2=0x7f4c200ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 --2- 172.21.15.69:0/33865200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c200ff570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009a10 tx=0x7f4c1c009d20 comp rx=0 tx=0).stop 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 -- 172.21.15.69:0/33865200 shutdown_connections 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 --2- 172.21.15.69:0/33865200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 0x7f4c201075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 --2- 172.21.15.69:0/33865200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c200ff570 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 --2- 172.21.15.69:0/33865200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 0x7f4c201007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 -- 172.21.15.69:0/33865200 >> 172.21.15.69:0/33865200 conn(0x7f4c200fa780 msgr2=0x7f4c200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 -- 172.21.15.69:0/33865200 shutdown_connections 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.059+0000 7f4c277b0700 1 -- 172.21.15.69:0/33865200 wait complete. 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 Processor -- start 2023-12-14T18:25:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 -- start start 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c20193cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 0x7f4c20194230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 0x7f4c2019b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2019b830 con 0x7f4c200ff160 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2019b9a0 con 0x7f4c20100350 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c277b0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2019bb60 con 0x7f4c20100ce0 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c2554c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c20193cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c2554c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c20193cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35520/0 (socket says 172.21.15.69:35520) 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c2554c700 1 -- 172.21.15.69:0/3114931994 learned_addr learned my addr 172.21.15.69:0/3114931994 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.060+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 0x7f4c20194230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 0x7f4c2019b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c2554c700 1 -- 172.21.15.69:0/3114931994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 msgr2=0x7f4c2019b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c2554c700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 0x7f4c2019b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c2554c700 1 -- 172.21.15.69:0/3114931994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 msgr2=0x7f4c20194230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c2554c700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 0x7f4c20194230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c2554c700 1 -- 172.21.15.69:0/3114931994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0095f0 con 0x7f4c200ff160 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 0x7f4c2019b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 0x7f4c20194230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c2554c700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c20193cf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c167fc700 1 -- 172.21.15.69:0/3114931994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00bdc0 con 0x7f4c200ff160 2023-12-14T18:25:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c167fc700 1 -- 172.21.15.69:0/3114931994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c1c005450 con 0x7f4c200ff160 2023-12-14T18:25:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c167fc700 1 -- 172.21.15.69:0/3114931994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0226c0 con 0x7f4c200ff160 2023-12-14T18:25:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c20109940 con 0x7f4c200ff160 2023-12-14T18:25:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.061+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c201097b0 con 0x7f4c200ff160 2023-12-14T18:25:20.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.064+0000 7f4c167fc700 1 -- 172.21.15.69:0/3114931994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4c1c004500 con 0x7f4c200ff160 2023-12-14T18:25:20.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.064+0000 7f4c167fc700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4c0c0a1150 0x7f4c0c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c167fc700 1 -- 172.21.15.69:0/3114931994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4c1c0d2ac0 con 0x7f4c200ff160 2023-12-14T18:25:20.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4c0c0a1150 0x7f4c0c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 Processor -- start 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 -- start start 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4c0c0a1150 0x7f4c0c0a3600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4c10005950 tx=0x7f4c100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea2605fd10 0x55ea26060120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26060f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 0x55ea26061980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea25f405e0 con 0x55ea26061510 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea25faf870 con 0x55ea2605fd10 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.065+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea25fa8d00 con 0x55ea26060660 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 0x55ea26061980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 0x55ea26061980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35528/0 (socket says 172.21.15.69:35528) 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 -- 172.21.15.69:0/93599579 learned_addr learned my addr 172.21.15.69:0/93599579 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c2554c700 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea2605fd10 0x55ea26060120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 -- 172.21.15.69:0/93599579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 msgr2=0x55ea26060f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26060f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 -- 172.21.15.69:0/93599579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea2605fd10 msgr2=0x55ea26060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea2605fd10 0x55ea26060120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 -- 172.21.15.69:0/93599579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea25e2a3b0 con 0x55ea26061510 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c2554c700 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea2605fd10 0x55ea26060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 0x55ea26061980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800b480 tx=0x7f4c1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142490ea08b9f7f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c0b7fe700 1 -- 172.21.15.69:0/93599579 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18010040 con 0x55ea26061510 2023-12-14T18:25:20.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c0b7fe700 1 -- 172.21.15.69:0/93599579 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c18014ab0 con 0x55ea26061510 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.066+0000 7f4c0b7fe700 1 -- 172.21.15.69:0/93599579 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18007a90 con 0x55ea26061510 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 -- 172.21.15.69:0/93599579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 msgr2=0x55ea26061980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 0x55ea26061980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800b480 tx=0x7f4c1800b040 comp rx=0 tx=0).stop 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 -- 172.21.15.69:0/93599579 shutdown_connections 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26061510 0x55ea26061980 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea2605fd10 0x55ea26060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/93599579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26060f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 -- 172.21.15.69:0/93599579 >> 172.21.15.69:0/93599579 conn(0x55ea2604cca0 msgr2=0x55ea26052380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 -- 172.21.15.69:0/93599579 shutdown_connections 2023-12-14T18:25:20.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.067+0000 7f4c3393eb80 1 -- 172.21.15.69:0/93599579 wait complete. 2023-12-14T18:25:20.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.068+0000 7f4c3393eb80 1 -- start start 2023-12-14T18:25:20.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.068+0000 7f4c3393eb80 1 Processor -- start 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.068+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea26069940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.068+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea25f44f90 con 0x55ea2605fd10 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea25f44c30 con 0x55ea26061510 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea25e2c6a0 con 0x55ea26060660 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c3393eb80 10 client.0 _ll_register_callbacks cb 0x55ea25f68910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea26069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea26069940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35540/0 (socket says 172.21.15.69:35540) 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 -- 172.21.15.69:0/1055619747 learned_addr learned my addr 172.21.15.69:0/1055619747 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 -- 172.21.15.69:0/1055619747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 msgr2=0x55ea26069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 -- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 msgr2=0x55ea26070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 -- 172.21.15.69:0/1055619747 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1800b0b0 con 0x55ea2605fd10 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c2554c700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea26069940 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c01dfd0 tx=0x7f4c1c09fff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4da783832aec299 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c08ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:20.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c08ff9700 1 -- 172.21.15.69:0/1055619747 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0a8330 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c08ff9700 1 -- 172.21.15.69:0/1055619747 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4c1c09e310 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.069+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea2604a2b0 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.070+0000 7f4c08ff9700 1 -- 172.21.15.69:0/1055619747 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c1c0a01d0 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.070+0000 7f4c3393eb80 10 client.15450 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.070+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ea25f6f170 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.070+0000 7f4c08ff9700 1 -- 172.21.15.69:0/1055619747 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c1c0bc020 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c08ff9700 1 -- 172.21.15.69:0/1055619747 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c1c0a7ea0 con 0x55ea2605fd10 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c3393eb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c3393eb80 10 client.15450 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:25:20.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c3393eb80 20 client.15450 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea26086400 0x55ea26088810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c3393eb80 4 client.15450 mds_command: new command op to 24482 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea25fa1ce0 con 0x55ea26086400 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea26086400 0x55ea26088810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c08ff9700 10 client.15450 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.071+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea26086400 0x55ea26088810 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=957ced51238f714b server_cookie=e0bde65ba3c9219d in_seq=0 out_seq=0 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c08ff9700 1 -- 172.21.15.69:0/1055619747 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ea25fa1ce0 con 0x55ea26086400 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c08ff9700 10 client.15450 handle_command_reply: tid=0 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 client.15450 shutdown 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 msgr2=0x55ea26069940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea26069940 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c01dfd0 tx=0x7f4c1c09fff0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 shutdown_connections 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea26086400 0x55ea26088810 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea26069940 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1055619747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26060660 0x55ea26069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 >> 172.21.15.69:0/1055619747 conn(0x55ea2604cca0 msgr2=0x55ea26052230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c08ff9700 0 client.15450 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 shutdown_connections 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.072+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1055619747 wait complete. 2023-12-14T18:25:20.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.073+0000 7f4c3393eb80 20 client.15450 trim_cache size 0 max 16384 2023-12-14T18:25:20.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.085+0000 7f4c3393eb80 1 Processor -- start 2023-12-14T18:25:20.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.085+0000 7f4c3393eb80 1 -- start start 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 0x55ea260827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26060660 0x55ea26070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26067890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea26067640 con 0x55ea26060660 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea26064f30 con 0x55ea26061510 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea26068420 con 0x55ea2605fd10 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 0x55ea260827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 0x55ea260827c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59244/0 (socket says 172.21.15.69:59244) 2023-12-14T18:25:20.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 -- 172.21.15.69:0/1006954979 learned_addr learned my addr 172.21.15.69:0/1006954979 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26067890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 -- 172.21.15.69:0/1006954979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 msgr2=0x55ea26067890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26067890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 -- 172.21.15.69:0/1006954979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26060660 msgr2=0x55ea26070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26060660 0x55ea26070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 -- 172.21.15.69:0/1006954979 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea26061bb0 con 0x55ea2605fd10 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.086+0000 7f4c2554c700 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 0x55ea260827c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c09c9e0 tx=0x7f4c1c09c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee83eea7754679b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c0bfff700 1 -- 172.21.15.69:0/1006954979 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0a8330 con 0x55ea2605fd10 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c0bfff700 1 -- 172.21.15.69:0/1006954979 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c1c0bc070 con 0x55ea2605fd10 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c0bfff700 1 -- 172.21.15.69:0/1006954979 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0b3be0 con 0x55ea2605fd10 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1006954979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 msgr2=0x55ea260827c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 0x55ea260827c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c09c9e0 tx=0x7f4c1c09c330 comp rx=0 tx=0).stop 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1006954979 shutdown_connections 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26061510 0x55ea26067890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea2605fd10 0x55ea260827c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/1006954979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea26060660 0x55ea26070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1006954979 >> 172.21.15.69:0/1006954979 conn(0x55ea2604cca0 msgr2=0x55ea260686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1006954979 shutdown_connections 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.087+0000 7f4c3393eb80 1 -- 172.21.15.69:0/1006954979 wait complete. 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 -- start start 2023-12-14T18:25:20.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 Processor -- start 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea2606c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 0x55ea2606ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26061510 0x55ea2606feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea260703f0 con 0x55ea2605fd10 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea26070560 con 0x55ea26060660 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea26070720 con 0x55ea26061510 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c3393eb80 10 client.0 _ll_register_callbacks cb 0x7f4c1c09fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c24d4b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 0x55ea2606ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c24d4b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 0x55ea2606ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:42346/0 (socket says 172.21.15.69:42346) 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c24d4b700 1 -- 172.21.15.69:0/536985252 learned_addr learned my addr 172.21.15.69:0/536985252 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.088+0000 7f4c25d4d700 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26061510 0x55ea2606feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c24d4b700 1 -- 172.21.15.69:0/536985252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26061510 msgr2=0x55ea2606feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26061510 0x55ea2606feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c24d4b700 1 -- 172.21.15.69:0/536985252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 msgr2=0x55ea2606c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea2606c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c24d4b700 1 -- 172.21.15.69:0/536985252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea25f6f170 con 0x55ea26060660 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c24d4b700 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 0x55ea2606ce90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000b5d0 tx=0x7f4c10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a69b44739d11d1a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c08ff9700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c08ff9700 1 -- 172.21.15.69:0/536985252 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10017040 con 0x55ea26060660 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c08ff9700 1 -- 172.21.15.69:0/536985252 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4c100263b0 con 0x55ea26060660 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c18014ab0 con 0x55ea26060660 2023-12-14T18:25:20.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c08ff9700 1 -- 172.21.15.69:0/536985252 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c10026570 con 0x55ea26060660 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c3393eb80 10 client.25037 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ea25dd6b60 con 0x55ea26060660 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.089+0000 7f4c08ff9700 1 -- 172.21.15.69:0/536985252 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c18014ab0 con 0x55ea26060660 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c08ff9700 1 -- 172.21.15.69:0/536985252 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c10003890 con 0x55ea26060660 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c3393eb80 10 client.25037 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c3393eb80 10 client.25037 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c3393eb80 20 client.25037 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea260dafe0 0x55ea260dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c3393eb80 4 client.25037 mds_command: new command op to 24482 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ea25fa1a00 con 0x55ea260dafe0 2023-12-14T18:25:20.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.090+0000 7f4c2554c700 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea260dafe0 0x55ea260dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c08ff9700 10 client.25037 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c2554c700 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea260dafe0 0x55ea260dd3f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8415c258d0bfca1c server_cookie=90e95ff9cf950c74 in_seq=0 out_seq=0 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c08ff9700 1 -- 172.21.15.69:0/536985252 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ea25fa1a00 con 0x55ea260dafe0 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c08ff9700 10 client.25037 handle_command_reply: tid=0 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 client.25037 shutdown 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 msgr2=0x55ea2606ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 0x55ea2606ce90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000b5d0 tx=0x7f4c10004750 comp rx=0 tx=0).stop 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 shutdown_connections 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55ea260dafe0 0x55ea260dd3f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea26061510 0x55ea2606feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c08ff9700 0 client.25037 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:20.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ea2605fd10 0x55ea2606c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 --2- 172.21.15.69:0/536985252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ea26060660 0x55ea2606ce90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 >> 172.21.15.69:0/536985252 conn(0x55ea2604cca0 msgr2=0x55ea260827c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 shutdown_connections 2023-12-14T18:25:20.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 1 -- 172.21.15.69:0/536985252 wait complete. 2023-12-14T18:25:20.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.091+0000 7f4c3393eb80 20 client.25037 trim_cache size 0 max 16384 2023-12-14T18:25:20.099 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:25:20.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4c0c0a1150 msgr2=0x7f4c0c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4c0c0a1150 0x7f4c0c0a3600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4c10005950 tx=0x7f4c100058e0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 msgr2=0x7f4c20193cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c20193cf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c00bb20 comp rx=0 tx=0).stop 2023-12-14T18:25:20.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 shutdown_connections 2023-12-14T18:25:20.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4c0c0a1150 0x7f4c0c0a3600 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c20100ce0 0x7f4c2019b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c200ff160 0x7f4c20193cf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 --2- 172.21.15.69:0/3114931994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c20100350 0x7f4c20194230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 >> 172.21.15.69:0/3114931994 conn(0x7f4c200fa780 msgr2=0x7f4c200fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 shutdown_connections 2023-12-14T18:25:20.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.092+0000 7f4c277b0700 1 -- 172.21.15.69:0/3114931994 wait complete. 2023-12-14T18:25:20.105 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T18:25:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:19 smithi119 ceph-mon[43973]: pgmap v277: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:25:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:19 smithi091 ceph-mon[43601]: pgmap v277: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-14T18:25:20.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 -- 172.21.15.69:0/3072017943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438103600 msgr2=0x7f34381059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 --2- 172.21.15.69:0/3072017943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438103600 0x7f34381059e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3428009990 tx=0x7f3428009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 -- 172.21.15.69:0/3072017943 shutdown_connections 2023-12-14T18:25:20.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 --2- 172.21.15.69:0/3072017943 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3438105f20 0x7f3438108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 --2- 172.21.15.69:0/3072017943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f34381030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 --2- 172.21.15.69:0/3072017943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438103600 0x7f34381059e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 -- 172.21.15.69:0/3072017943 >> 172.21.15.69:0/3072017943 conn(0x7f34380fa780 msgr2=0x7f34380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 -- 172.21.15.69:0/3072017943 shutdown_connections 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.232+0000 7f343ffd4700 1 -- 172.21.15.69:0/3072017943 wait complete. 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 Processor -- start 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 -- start start 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f3438193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3438103600 0x7f34381941e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438105f20 0x7f343819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343819b810 con 0x7f3438105f20 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343819b980 con 0x7f3438103600 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343ffd4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343819bb40 con 0x7f3438100ce0 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343dd70700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f3438193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.233+0000 7f343e571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438105f20 0x7f343819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343e571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438105f20 0x7f343819b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35586/0 (socket says 172.21.15.69:35586) 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f3438193ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59256/0 (socket says 172.21.15.69:59256) 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343e571700 1 -- 172.21.15.69:0/114643410 learned_addr learned my addr 172.21.15.69:0/114643410 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 -- 172.21.15.69:0/114643410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3438103600 msgr2=0x7f34381941e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-14T18:25:20.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3438103600 0x7f34381941e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 -- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438105f20 msgr2=0x7f343819b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438105f20 0x7f343819b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 -- 172.21.15.69:0/114643410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280095f0 con 0x7f3438100ce0 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343dd70700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f3438193ca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f343400e9f0 tx=0x7f343400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f342effd700 1 -- 172.21.15.69:0/114643410 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400eee0 con 0x7f3438100ce0 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f342effd700 1 -- 172.21.15.69:0/114643410 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f343400cbd0 con 0x7f3438100ce0 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34381098c0 con 0x7f3438100ce0 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f342effd700 1 -- 172.21.15.69:0/114643410 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434018680 con 0x7f3438100ce0 2023-12-14T18:25:20.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.234+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3438109730 con 0x7f3438100ce0 2023-12-14T18:25:20.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.237+0000 7f342effd700 1 -- 172.21.15.69:0/114643410 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f343400cd40 con 0x7f3438100ce0 2023-12-14T18:25:20.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.238+0000 7f342effd700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34240a1150 0x7f34240a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.238+0000 7f343d56f700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34240a1150 0x7f34240a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.238+0000 7f342effd700 1 -- 172.21.15.69:0/114643410 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3434014070 con 0x7f3438100ce0 2023-12-14T18:25:20.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.239+0000 7f344c162b80 1 Processor -- start 2023-12-14T18:25:20.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.239+0000 7f344c162b80 1 -- start start 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f344c162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22555120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f344c162b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22555f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f344c162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22556980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f344c162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df224355e0 con 0x55df22554d10 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f344c162b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df224a4870 con 0x55df22555660 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f344c162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df2249dd00 con 0x55df22556510 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343d56f700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34240a1150 0x7f34240a3600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f342801a040 tx=0x7f3428005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22556980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22556980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:59258/0 (socket says 172.21.15.69:59258) 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 -- 172.21.15.69:0/3339688891 learned_addr learned my addr 172.21.15.69:0/3339688891 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343dd70700 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22555120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343d56f700 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22555f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 -- 172.21.15.69:0/3339688891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 msgr2=0x55df22555f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22555f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 -- 172.21.15.69:0/3339688891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 msgr2=0x55df22555120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22555120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.240+0000 7f343e571700 1 -- 172.21.15.69:0/3339688891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df2231f3b0 con 0x55df22556510 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.241+0000 7f343e571700 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22556980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3430009f60 tx=0x7f3430009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4c52dec878308a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.241+0000 7f3423fff700 1 -- 172.21.15.69:0/3339688891 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300147f0 con 0x55df22556510 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.241+0000 7f3423fff700 1 -- 172.21.15.69:0/3339688891 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f343000f040 con 0x55df22556510 2023-12-14T18:25:20.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.241+0000 7f3423fff700 1 -- 172.21.15.69:0/3339688891 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430015a60 con 0x55df22556510 2023-12-14T18:25:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 -- 172.21.15.69:0/3339688891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 msgr2=0x55df22556980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22556980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3430009f60 tx=0x7f3430009230 comp rx=0 tx=0).stop 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 -- 172.21.15.69:0/3339688891 shutdown_connections 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22556980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22555120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 --2- 172.21.15.69:0/3339688891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22555f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 -- 172.21.15.69:0/3339688891 >> 172.21.15.69:0/3339688891 conn(0x55df22541ca0 msgr2=0x55df22547430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 -- 172.21.15.69:0/3339688891 shutdown_connections 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 -- 172.21.15.69:0/3339688891 wait complete. 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 -- start start 2023-12-14T18:25:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.242+0000 7f344c162b80 1 Processor -- start 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22554d10 0x55df2255e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df2255ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df22565ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df22439f90 con 0x55df22556510 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df22439c30 con 0x55df22555660 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df223216a0 con 0x55df22554d10 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f344c162b80 10 client.0 _ll_register_callbacks cb 0x55df2245d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f343e571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df22565ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f343e571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df22565ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35602/0 (socket says 172.21.15.69:35602) 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f343dd70700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22554d10 0x55df2255e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f343e571700 1 -- 172.21.15.69:0/1058294794 learned_addr learned my addr 172.21.15.69:0/1058294794 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.243+0000 7f343d56f700 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df2255ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f343e571700 1 -- 172.21.15.69:0/1058294794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22554d10 msgr2=0x55df2255e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f343e571700 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22554d10 0x55df2255e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f343e571700 1 -- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 msgr2=0x55df2255ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f343e571700 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df2255ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f343e571700 1 -- 172.21.15.69:0/1058294794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3430009b90 con 0x55df22556510 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f343e571700 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df22565ea0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3430000f80 tx=0x7f3430016f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ef5b5980f2ed3c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f34217fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f34217fa700 1 -- 172.21.15.69:0/1058294794 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430003c00 con 0x55df22556510 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f34217fa700 1 -- 172.21.15.69:0/1058294794 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3430003d60 con 0x55df22556510 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df2253f2b0 con 0x55df22556510 2023-12-14T18:25:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f34217fa700 1 -- 172.21.15.69:0/1058294794 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34300148c0 con 0x55df22556510 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f344c162b80 10 client.15462 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55df22464170 con 0x55df22556510 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.244+0000 7f34217fa700 1 -- 172.21.15.69:0/1058294794 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55df2253f2b0 con 0x55df22556510 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f34217fa700 1 -- 172.21.15.69:0/1058294794 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f343002f070 con 0x55df22556510 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f344c162b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f344c162b80 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f344c162b80 20 client.15462 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f344c162b80 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2256a560 0x55df2256c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f344c162b80 4 client.15462 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df22496ce0 con 0x55df2256a560 2023-12-14T18:25:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f343dd70700 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2256a560 0x55df2256c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f34217fa700 10 client.15462 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.245+0000 7f343dd70700 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2256a560 0x55df2256c970 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1e5a83691b4942 server_cookie=6e8ccae00084fe64 in_seq=0 out_seq=0 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f34217fa700 1 -- 172.21.15.69:0/1058294794 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55df22496ce0 con 0x55df2256a560 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f34217fa700 10 client.15462 handle_command_reply: tid=0 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 client.15462 shutdown 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 msgr2=0x55df22565ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df22565ea0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3430000f80 tx=0x7f3430016f40 comp rx=0 tx=0).stop 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 shutdown_connections 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2256a560 0x55df2256c970 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df22565ea0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f34217fa700 0 client.15462 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:20.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22554d10 0x55df2255e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 --2- 172.21.15.69:0/1058294794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df2255ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 >> 172.21.15.69:0/1058294794 conn(0x55df22541ca0 msgr2=0x55df22545f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 shutdown_connections 2023-12-14T18:25:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 1 -- 172.21.15.69:0/1058294794 wait complete. 2023-12-14T18:25:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.246+0000 7f344c162b80 20 client.15462 trim_cache size 0 max 16384 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.259+0000 7f344c162b80 1 Processor -- start 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 -- start start 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22554d10 0x55df22566790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22555660 0x55df22565e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df2255c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df2255f580 con 0x55df22556510 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df22559c80 con 0x55df22554d10 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f344c162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df22555d40 con 0x55df22555660 2023-12-14T18:25:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df2255c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df2255c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35604/0 (socket says 172.21.15.69:35604) 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 -- 172.21.15.69:0/615223303 learned_addr learned my addr 172.21.15.69:0/615223303 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343dd70700 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22554d10 0x55df22566790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343d56f700 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22555660 0x55df22565e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 -- 172.21.15.69:0/615223303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22555660 msgr2=0x55df22565e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22555660 0x55df22565e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 -- 172.21.15.69:0/615223303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22554d10 msgr2=0x55df22566790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22554d10 0x55df22566790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.260+0000 7f343e571700 1 -- 172.21.15.69:0/615223303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df22463ec0 con 0x55df22556510 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.261+0000 7f343e571700 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df2255c820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3430009a10 tx=0x7f34300047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848afe41704ce0e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.261+0000 7f342cff9700 1 -- 172.21.15.69:0/615223303 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430016270 con 0x55df22556510 2023-12-14T18:25:20.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.261+0000 7f342cff9700 1 -- 172.21.15.69:0/615223303 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f343002c070 con 0x55df22556510 2023-12-14T18:25:20.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.261+0000 7f342cff9700 1 -- 172.21.15.69:0/615223303 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430004a80 con 0x55df22556510 2023-12-14T18:25:20.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 -- 172.21.15.69:0/615223303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 msgr2=0x55df2255c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df2255c820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3430009a10 tx=0x7f34300047a0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 -- 172.21.15.69:0/615223303 shutdown_connections 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22556510 0x55df2255c820 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22554d10 0x55df22566790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 --2- 172.21.15.69:0/615223303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22555660 0x55df22565e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 -- 172.21.15.69:0/615223303 >> 172.21.15.69:0/615223303 conn(0x55df22541ca0 msgr2=0x55df225712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 -- 172.21.15.69:0/615223303 shutdown_connections 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 -- 172.21.15.69:0/615223303 wait complete. 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 -- start start 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.262+0000 7f344c162b80 1 Processor -- start 2023-12-14T18:25:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22561ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22562530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22565030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df22565570 con 0x55df22554d10 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df225656b0 con 0x55df22555660 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df22565840 con 0x55df22556510 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f344c162b80 10 client.0 _ll_register_callbacks cb 0x7f3434095b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22561ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22561ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35606/0 (socket says 172.21.15.69:35606) 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 -- 172.21.15.69:0/2865379920 learned_addr learned my addr 172.21.15.69:0/2865379920 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343d56f700 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22562530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 -- 172.21.15.69:0/2865379920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 msgr2=0x55df22565030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22565030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 -- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 msgr2=0x55df22562530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22562530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 -- 172.21.15.69:0/2865379920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df22464170 con 0x55df22554d10 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f343dd70700 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22561ff0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3434096440 tx=0x7f3434096280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93d39c1204425c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.263+0000 7f34217fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f34217fa700 1 -- 172.21.15.69:0/2865379920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434099630 con 0x55df22554d10 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f343000f040 con 0x55df22554d10 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f34217fa700 1 -- 172.21.15.69:0/2865379920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f34340b8300 con 0x55df22554d10 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f34217fa700 1 -- 172.21.15.69:0/2865379920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34340ca140 con 0x55df22554d10 2023-12-14T18:25:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 10 client.15468 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55df2244a9a0 con 0x55df22554d10 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f34217fa700 1 -- 172.21.15.69:0/2865379920 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f343000f040 con 0x55df22554d10 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f34217fa700 1 -- 172.21.15.69:0/2865379920 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f34340b8020 con 0x55df22554d10 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 20 client.15468 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2254cf70 0x55df2254f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 4 client.15468 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55df22496a00 con 0x55df2254cf70 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.264+0000 7f343d56f700 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2254cf70 0x55df2254f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f34217fa700 10 client.15468 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f343d56f700 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2254cf70 0x55df2254f380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e47858179fe8eb4 server_cookie=1919e2bb00819674 in_seq=0 out_seq=0 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f34217fa700 1 -- 172.21.15.69:0/2865379920 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55df22496a00 con 0x55df2254cf70 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f34217fa700 10 client.15468 handle_command_reply: tid=0 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 client.15468 shutdown 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 msgr2=0x55df22561ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22561ff0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3434096440 tx=0x7f3434096280 comp rx=0 tx=0).stop 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 shutdown_connections 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55df2254cf70 0x55df2254f380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df22556510 0x55df22565030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55df22554d10 0x55df22561ff0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 --2- 172.21.15.69:0/2865379920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55df22555660 0x55df22562530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 >> 172.21.15.69:0/2865379920 conn(0x55df22541ca0 msgr2=0x55df22566790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.265+0000 7f34217fa700 0 client.15468 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:20.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 shutdown_connections 2023-12-14T18:25:20.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f344c162b80 1 -- 172.21.15.69:0/2865379920 wait complete. 2023-12-14T18:25:20.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f344c162b80 20 client.15468 trim_cache size 0 max 16384 2023-12-14T18:25:20.272 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34240a1150 msgr2=0x7f34240a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34240a1150 0x7f34240a3600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f342801a040 tx=0x7f3428005bc0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 msgr2=0x7f3438193ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f3438193ca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f343400e9f0 tx=0x7f343400ed00 comp rx=0 tx=0).stop 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 shutdown_connections 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34240a1150 0x7f34240a3600 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3438105f20 0x7f343819b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3438100ce0 0x7f3438193ca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 --2- 172.21.15.69:0/114643410 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3438103600 0x7f34381941e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:20.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 >> 172.21.15.69:0/114643410 conn(0x7f34380fa780 msgr2=0x7f34381019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:20.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 shutdown_connections 2023-12-14T18:25:20.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:20.266+0000 7f343ffd4700 1 -- 172.21.15.69:0/114643410 wait complete. 2023-12-14T18:25:20.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:20 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4006624904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:25:21.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:20 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4006624904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:25:21.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:20 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4006624904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:25:21.280 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T18:25:21.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T18:25:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 -- 172.21.15.69:0/8054567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 msgr2=0x7f9d800ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 --2- 172.21.15.69:0/8054567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d800ff530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009990 tx=0x7f9d70009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 -- 172.21.15.69:0/8054567 shutdown_connections 2023-12-14T18:25:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 --2- 172.21.15.69:0/8054567 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100ca0 0x7f9d80107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 --2- 172.21.15.69:0/8054567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d800ff530 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 --2- 172.21.15.69:0/8054567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100310 0x7f9d80100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 -- 172.21.15.69:0/8054567 >> 172.21.15.69:0/8054567 conn(0x7f9d800fa740 msgr2=0x7f9d800fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 -- 172.21.15.69:0/8054567 shutdown_connections 2023-12-14T18:25:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.442+0000 7f9d87c07700 1 -- 172.21.15.69:0/8054567 wait complete. 2023-12-14T18:25:21.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 Processor -- start 2023-12-14T18:25:21.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 -- start start 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d80194df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100310 0x7f9d80195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100ca0 0x7f9d8019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019c970 con 0x7f9d800ff120 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019cab0 con 0x7f9d80100310 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d87c07700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019cc40 con 0x7f9d80100ca0 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d859a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d80194df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d859a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d80194df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35622/0 (socket says 172.21.15.69:35622) 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d859a3700 1 -- 172.21.15.69:0/1965269390 learned_addr learned my addr 172.21.15.69:0/1965269390 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.443+0000 7f9d861a4700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100ca0 0x7f9d8019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d851a2700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100310 0x7f9d80195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d859a3700 1 -- 172.21.15.69:0/1965269390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100ca0 msgr2=0x7f9d8019c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d859a3700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100ca0 0x7f9d8019c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d859a3700 1 -- 172.21.15.69:0/1965269390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100310 msgr2=0x7f9d80195330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d859a3700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100310 0x7f9d80195330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d859a3700 1 -- 172.21.15.69:0/1965269390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700095f0 con 0x7f9d800ff120 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d851a2700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100310 0x7f9d80195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d859a3700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d80194df0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9d70000c00 tx=0x7f9d70009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d76ffd700 1 -- 172.21.15.69:0/1965269390 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7001f070 con 0x7f9d800ff120 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8010a9d0 con 0x7f9d800ff120 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d76ffd700 1 -- 172.21.15.69:0/1965269390 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d70019600 con 0x7f9d800ff120 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d76ffd700 1 -- 172.21.15.69:0/1965269390 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000f6c0 con 0x7f9d800ff120 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.444+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8010a840 con 0x7f9d800ff120 2023-12-14T18:25:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.447+0000 7f9d76ffd700 1 -- 172.21.15.69:0/1965269390 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9d7000ba80 con 0x7f9d800ff120 2023-12-14T18:25:21.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.448+0000 7f9d76ffd700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d6c0a11a0 0x7f9d6c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.448+0000 7f9d851a2700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d6c0a11a0 0x7f9d6c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.448+0000 7f9d76ffd700 1 -- 172.21.15.69:0/1965269390 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d700cfdd0 con 0x7f9d800ff120 2023-12-14T18:25:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.448+0000 7f9d851a2700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d6c0a11a0 0x7f9d6c0a3650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009cb0 tx=0x7f9d7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 Processor -- start 2023-12-14T18:25:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 -- start start 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1af580 0x5585cb1af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1afed0 0x5585cb1b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 0x5585cb1b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb098660 con 0x5585cb1b0d80 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb1078f0 con 0x5585cb1afed0 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb100d80 con 0x5585cb1af580 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d861a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 0x5585cb1b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d861a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 0x5585cb1b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35636/0 (socket says 172.21.15.69:35636) 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d861a4700 1 -- 172.21.15.69:0/1269398980 learned_addr learned my addr 172.21.15.69:0/1269398980 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d851a2700 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1afed0 0x5585cb1b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.449+0000 7f9d859a3700 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1af580 0x5585cb1af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d861a4700 1 -- 172.21.15.69:0/1269398980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1af580 msgr2=0x5585cb1af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d861a4700 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1af580 0x5585cb1af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d861a4700 1 -- 172.21.15.69:0/1269398980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1afed0 msgr2=0x5585cb1b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d861a4700 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1afed0 0x5585cb1b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d861a4700 1 -- 172.21.15.69:0/1269398980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585caf82430 con 0x5585cb1b0d80 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d861a4700 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 0x5585cb1b11f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800f5a0 tx=0x7f9d7800f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aed57ba9c822575 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d6bfff700 1 -- 172.21.15.69:0/1269398980 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78004bb0 con 0x5585cb1b0d80 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d6bfff700 1 -- 172.21.15.69:0/1269398980 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d78004d10 con 0x5585cb1b0d80 2023-12-14T18:25:21.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.450+0000 7f9d6bfff700 1 -- 172.21.15.69:0/1269398980 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78005020 con 0x5585cb1b0d80 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 -- 172.21.15.69:0/1269398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 msgr2=0x5585cb1b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 0x5585cb1b11f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800f5a0 tx=0x7f9d7800f8b0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 -- 172.21.15.69:0/1269398980 shutdown_connections 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1b0d80 0x5585cb1b11f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1af580 0x5585cb1af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/1269398980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1afed0 0x5585cb1b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 -- 172.21.15.69:0/1269398980 >> 172.21.15.69:0/1269398980 conn(0x5585cb1a4d20 msgr2=0x5585cb1aa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 -- 172.21.15.69:0/1269398980 shutdown_connections 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 -- 172.21.15.69:0/1269398980 wait complete. 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 -- start start 2023-12-14T18:25:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.451+0000 7f9d93d95b80 1 Processor -- start 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb1b9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb09d010 con 0x5585cb1af580 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb09ccb0 con 0x5585cb1b0d80 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585caf84720 con 0x5585cb1afed0 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d93d95b80 10 client.0 _ll_register_callbacks cb 0x5585cb0c0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d859a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d859a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1bc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35646/0 (socket says 172.21.15.69:35646) 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d859a3700 1 -- 172.21.15.69:0/686484761 learned_addr learned my addr 172.21.15.69:0/686484761 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d861a4700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb1b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d851a2700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.452+0000 7f9d859a3700 1 -- 172.21.15.69:0/686484761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 msgr2=0x5585cb1bcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d859a3700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1bcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d859a3700 1 -- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 msgr2=0x5585cb1b9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d859a3700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb1b9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d859a3700 1 -- 172.21.15.69:0/686484761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7800f1d0 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d859a3700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1bc660 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9d700cdc50 tx=0x7f9d7009cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67966a25e9cdd37c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d697fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d697fa700 1 -- 172.21.15.69:0/686484761 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700a12b0 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d697fa700 1 -- 172.21.15.69:0/686484761 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d700a5640 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585cb1a2330 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d697fa700 1 -- 172.21.15.69:0/686484761 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d7009b620 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 10 client.15480 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5585cb0c71f0 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d697fa700 1 -- 172.21.15.69:0/686484761 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5585cb1a2330 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d697fa700 1 -- 172.21.15.69:0/686484761 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9d7009c850 con 0x5585cb1af580 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 10 client.15480 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 20 client.15480 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.453+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb1c0bb0 0x5585cb1c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.454+0000 7f9d93d95b80 4 client.15480 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.454+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585cb0f9d60 con 0x5585cb1c0bb0 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.454+0000 7f9d851a2700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb1c0bb0 0x5585cb1c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.454+0000 7f9d697fa700 10 client.15480 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.454+0000 7f9d851a2700 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb1c0bb0 0x5585cb1c2fc0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6cd6771f36896c server_cookie=224719e2cacd096e in_seq=0 out_seq=0 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d697fa700 1 -- 172.21.15.69:0/686484761 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5585cb0f9d60 con 0x5585cb1c0bb0 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d697fa700 10 client.15480 handle_command_reply: tid=0 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 client.15480 shutdown 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 msgr2=0x5585cb1bc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1bc660 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9d700cdc50 tx=0x7f9d7009cbe0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 shutdown_connections 2023-12-14T18:25:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb1c0bb0 0x5585cb1c2fc0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb1b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1bc660 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d697fa700 0 client.15480 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/686484761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1bcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 >> 172.21.15.69:0/686484761 conn(0x5585cb1a4d20 msgr2=0x5585cb1a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 shutdown_connections 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 1 -- 172.21.15.69:0/686484761 wait complete. 2023-12-14T18:25:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.455+0000 7f9d93d95b80 20 client.15480 trim_cache size 0 max 16384 2023-12-14T18:25:21.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.472+0000 7f9d93d95b80 1 Processor -- start 2023-12-14T18:25:21.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.472+0000 7f9d93d95b80 1 -- start start 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1af580 0x5585cb1aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 0x5585cb1aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1b0d80 0x5585cb1bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb1b7980 con 0x5585cb1afed0 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb1b9700 con 0x5585cb1af580 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb1ab710 con 0x5585cb1b0d80 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 0x5585cb1aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 0x5585cb1aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35662/0 (socket says 172.21.15.69:35662) 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 -- 172.21.15.69:0/942553924 learned_addr learned my addr 172.21.15.69:0/942553924 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d859a3700 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1af580 0x5585cb1aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d861a4700 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1b0d80 0x5585cb1bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 -- 172.21.15.69:0/942553924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1b0d80 msgr2=0x5585cb1bc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1b0d80 0x5585cb1bc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 -- 172.21.15.69:0/942553924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1af580 msgr2=0x5585cb1aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1af580 0x5585cb1aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 -- 172.21.15.69:0/942553924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585cb1b1420 con 0x5585cb1afed0 2023-12-14T18:25:21.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.473+0000 7f9d851a2700 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 0x5585cb1aa6a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5585cb1c3890 tx=0x7f9d7c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734749fe4d7a5d8f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d74dac700 1 -- 172.21.15.69:0/942553924 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c027070 con 0x5585cb1afed0 2023-12-14T18:25:21.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d74dac700 1 -- 172.21.15.69:0/942553924 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d7c009ea0 con 0x5585cb1afed0 2023-12-14T18:25:21.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d74dac700 1 -- 172.21.15.69:0/942553924 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c028a50 con 0x5585cb1afed0 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 -- 172.21.15.69:0/942553924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 msgr2=0x5585cb1aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 0x5585cb1aa6a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5585cb1c3890 tx=0x7f9d7c014000 comp rx=0 tx=0).stop 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 -- 172.21.15.69:0/942553924 shutdown_connections 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1b0d80 0x5585cb1bc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1af580 0x5585cb1aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/942553924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1afed0 0x5585cb1aa6a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 -- 172.21.15.69:0/942553924 >> 172.21.15.69:0/942553924 conn(0x5585cb1a4d20 msgr2=0x5585cb1a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 -- 172.21.15.69:0/942553924 shutdown_connections 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.474+0000 7f9d93d95b80 1 -- 172.21.15.69:0/942553924 wait complete. 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 -- start start 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 Processor -- start 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1c6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb229bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb1c9680 con 0x5585cb1af580 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb1c97f0 con 0x5585cb1b0d80 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cb22a130 con 0x5585cb1afed0 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d93d95b80 10 client.0 _ll_register_callbacks cb 0x7f9d7009d050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d859a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d859a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35670/0 (socket says 172.21.15.69:35670) 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.475+0000 7f9d859a3700 1 -- 172.21.15.69:0/3499893619 learned_addr learned my addr 172.21.15.69:0/3499893619 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d861a4700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb229bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d851a2700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d859a3700 1 -- 172.21.15.69:0/3499893619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 msgr2=0x5585cb1c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d859a3700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d859a3700 1 -- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 msgr2=0x5585cb229bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d859a3700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb229bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d859a3700 1 -- 172.21.15.69:0/3499893619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c0041f0 con 0x5585cb1af580 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d859a3700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1c6120 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9d70088100 tx=0x7f9d700a5510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaa953371abf14d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d697fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d697fa700 1 -- 172.21.15.69:0/3499893619 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700a5320 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d697fa700 1 -- 172.21.15.69:0/3499893619 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d700bb020 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d78004d10 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d697fa700 1 -- 172.21.15.69:0/3499893619 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d700a5640 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d93d95b80 10 client.15486 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.476+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5585caf2ebe0 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d697fa700 1 -- 172.21.15.69:0/3499893619 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d78004d10 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d697fa700 1 -- 172.21.15.69:0/3499893619 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9d70067020 con 0x5585cb1af580 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d93d95b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d93d95b80 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d93d95b80 20 client.15486 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb22b630 0x5585cb22da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d93d95b80 4 client.15486 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T18:25:21.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5585cb0f9a80 con 0x5585cb22b630 2023-12-14T18:25:21.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d851a2700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb22b630 0x5585cb22da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d697fa700 10 client.15486 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.477+0000 7f9d851a2700 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb22b630 0x5585cb22da10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5fa6f51c15ef227 server_cookie=3f30cf313e22fced in_seq=0 out_seq=0 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.478+0000 7f9d697fa700 1 -- 172.21.15.69:0/3499893619 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5585cb0f9a80 con 0x5585cb22b630 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.478+0000 7f9d697fa700 10 client.15486 handle_command_reply: tid=0 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 client.15486 shutdown 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 msgr2=0x5585cb1c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1c6120 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9d70088100 tx=0x7f9d700a5510 comp rx=0 tx=0).stop 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 shutdown_connections 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5585cb22b630 0x5585cb22da10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5585cb1b0d80 0x5585cb229bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d697fa700 0 client.15486 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585cb1af580 0x5585cb1c6120 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 --2- 172.21.15.69:0/3499893619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585cb1afed0 0x5585cb1c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 >> 172.21.15.69:0/3499893619 conn(0x5585cb1a4d20 msgr2=0x5585cb1aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 shutdown_connections 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 1 -- 172.21.15.69:0/3499893619 wait complete. 2023-12-14T18:25:21.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.479+0000 7f9d93d95b80 20 client.15486 trim_cache size 0 max 16384 2023-12-14T18:25:21.484 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:25:21.484 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T18:25:21.484 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "88f8195a-69bf-424e-8d2a-1893249fab34", 2023-12-14T18:25:21.484 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T18:25:21.484 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d6c0a11a0 msgr2=0x7f9d6c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d6c0a11a0 0x7f9d6c0a3650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009cb0 tx=0x7f9d7c009260 comp rx=0 tx=0).stop 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 msgr2=0x7f9d80194df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d80194df0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9d70000c00 tx=0x7f9d70009580 comp rx=0 tx=0).stop 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 shutdown_connections 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d6c0a11a0 0x7f9d6c0a3650 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100ca0 0x7f9d8019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d800ff120 0x7f9d80194df0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 --2- 172.21.15.69:0/1965269390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100310 0x7f9d80195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 >> 172.21.15.69:0/1965269390 conn(0x7f9d800fa740 msgr2=0x7f9d801037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 shutdown_connections 2023-12-14T18:25:21.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.480+0000 7f9d87c07700 1 -- 172.21.15.69:0/1965269390 wait complete. 2023-12-14T18:25:21.494 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 -- 172.21.15.69:0/3991269783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 msgr2=0x7fe67c108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 --2- 172.21.15.69:0/3991269783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c108670 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b0a0 tx=0x7fe67400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 -- 172.21.15.69:0/3991269783 shutdown_connections 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 --2- 172.21.15.69:0/3991269783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c108670 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 --2- 172.21.15.69:0/3991269783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe67c100230 0x7fe67c100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 --2- 172.21.15.69:0/3991269783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe67c101420 0x7fe67c101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 -- 172.21.15.69:0/3991269783 >> 172.21.15.69:0/3991269783 conn(0x7fe67c0fb850 msgr2=0x7fe67c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 -- 172.21.15.69:0/3991269783 shutdown_connections 2023-12-14T18:25:21.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.660+0000 7fe6813a1700 1 -- 172.21.15.69:0/3991269783 wait complete. 2023-12-14T18:25:21.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 Processor -- start 2023-12-14T18:25:21.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 -- start start 2023-12-14T18:25:21.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe67c100230 0x7fe67c193dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe67c101420 0x7fe67c194300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c19b900 con 0x7fe67c101db0 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c19ba70 con 0x7fe67c100230 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe6813a1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c19bc30 con 0x7fe67c101420 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35694/0 (socket says 172.21.15.69:35694) 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.661+0000 7fe67b7fe700 1 -- 172.21.15.69:0/36368762 learned_addr learned my addr 172.21.15.69:0/36368762 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67a7fc700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe67c101420 0x7fe67c194300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67affd700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe67c100230 0x7fe67c193dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67b7fe700 1 -- 172.21.15.69:0/36368762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe67c101420 msgr2=0x7fe67c194300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe67c101420 0x7fe67c194300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67b7fe700 1 -- 172.21.15.69:0/36368762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe67c100230 msgr2=0x7fe67c193dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe67c100230 0x7fe67c193dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67b7fe700 1 -- 172.21.15.69:0/36368762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe674009d00 con 0x7fe67c101db0 2023-12-14T18:25:21.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c19b330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe6740062a0 tx=0x7fe674004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe663fff700 1 -- 172.21.15.69:0/36368762 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674007ea0 con 0x7fe67c101db0 2023-12-14T18:25:21.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67c1098b0 con 0x7fe67c101db0 2023-12-14T18:25:21.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe663fff700 1 -- 172.21.15.69:0/36368762 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe67400bee0 con 0x7fe67c101db0 2023-12-14T18:25:21.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe663fff700 1 -- 172.21.15.69:0/36368762 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740216a0 con 0x7fe67c101db0 2023-12-14T18:25:21.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.662+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c109720 con 0x7fe67c101db0 2023-12-14T18:25:21.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.665+0000 7fe663fff700 1 -- 172.21.15.69:0/36368762 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe6740074e0 con 0x7fe67c101db0 2023-12-14T18:25:21.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.665+0000 7fe663fff700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6640a1150 0x7fe6640a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.666+0000 7fe67affd700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6640a1150 0x7fe6640a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.666+0000 7fe663fff700 1 -- 172.21.15.69:0/36368762 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe6740d24a0 con 0x7fe67c101db0 2023-12-14T18:25:21.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.666+0000 7fe67affd700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6640a1150 0x7fe6640a3600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe67c195290 tx=0x7fe66c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 Processor -- start 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 -- start start 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37500 0x5557ace37910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace38770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace39170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acd205e0 con 0x5557ace38d00 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acd8f870 con 0x5557ace37e50 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acd88d00 con 0x5557ace37500 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace39170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace39170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35710/0 (socket says 172.21.15.69:35710) 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 -- 172.21.15.69:0/355362637 learned_addr learned my addr 172.21.15.69:0/355362637 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67affd700 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37500 0x5557ace37910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 -- 172.21.15.69:0/355362637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37500 msgr2=0x5557ace37910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37500 0x5557ace37910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 -- 172.21.15.69:0/355362637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 msgr2=0x5557ace38770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace38770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67b7fe700 1 -- 172.21.15.69:0/355362637 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557acc0a3b0 con 0x5557ace38d00 2023-12-14T18:25:21.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.667+0000 7fe67affd700 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37500 0x5557ace37910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:21.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.668+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace39170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe6740a77e0 tx=0x7fe67400c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48c379010fa19b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.668+0000 7fe6617fa700 1 -- 172.21.15.69:0/355362637 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67409f950 con 0x5557ace38d00 2023-12-14T18:25:21.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.668+0000 7fe6617fa700 1 -- 172.21.15.69:0/355362637 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6740a3980 con 0x5557ace38d00 2023-12-14T18:25:21.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.668+0000 7fe6617fa700 1 -- 172.21.15.69:0/355362637 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740a3e40 con 0x5557ace38d00 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 -- 172.21.15.69:0/355362637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 msgr2=0x5557ace39170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace39170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe6740a77e0 tx=0x7fe67400c050 comp rx=0 tx=0).stop 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 -- 172.21.15.69:0/355362637 shutdown_connections 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace39170 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37500 0x5557ace37910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/355362637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace38770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 -- 172.21.15.69:0/355362637 >> 172.21.15.69:0/355362637 conn(0x5557ace2cca0 msgr2=0x5557ace32430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 -- 172.21.15.69:0/355362637 shutdown_connections 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 -- 172.21.15.69:0/355362637 wait complete. 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 -- start start 2023-12-14T18:25:21.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.669+0000 7fe68d52fb80 1 Processor -- start 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace40f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace484f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acd24f90 con 0x5557ace38d00 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acd24c30 con 0x5557ace37500 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acc0c6a0 con 0x5557ace37e50 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe68d52fb80 10 client.0 _ll_register_callbacks cb 0x5557acd48910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35716/0 (socket says 172.21.15.69:35716) 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67b7fe700 1 -- 172.21.15.69:0/628847008 learned_addr learned my addr 172.21.15.69:0/628847008 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace40f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67a7fc700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 -- 172.21.15.69:0/628847008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 msgr2=0x5557ace414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 -- 172.21.15.69:0/628847008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 msgr2=0x5557ace484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 -- 172.21.15.69:0/628847008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c109720 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe67affd700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace40f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe67c101280 tx=0x7fe66c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10143d018111b914 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.670+0000 7fe65eff5700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe65eff5700 1 -- 172.21.15.69:0/628847008 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c027440 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe65eff5700 1 -- 172.21.15.69:0/628847008 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe66c0275a0 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557ace2a2b0 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe65eff5700 1 -- 172.21.15.69:0/628847008 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe66c027760 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 10 client.25076 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5557acd4f170 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe65eff5700 1 -- 172.21.15.69:0/628847008 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5557ace2a2b0 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe65eff5700 1 -- 172.21.15.69:0/628847008 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe66c030070 con 0x5557ace37500 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 10 client.25076 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 10 client.25076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 20 client.25076 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557ace4f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 4 client.25076 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:21.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.671+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557acd81ce0 con 0x5557ace4cd60 2023-12-14T18:25:21.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.672+0000 7fe67a7fc700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557ace4f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.672+0000 7fe65eff5700 10 client.25076 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.672+0000 7fe67a7fc700 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557ace4f170 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e065dff2ff2b3df server_cookie=d86e584b0717552c in_seq=0 out_seq=0 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe65eff5700 1 -- 172.21.15.69:0/628847008 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5557acd81ce0 con 0x5557ace4cd60 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe65eff5700 10 client.25076 handle_command_reply: tid=0 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 client.25076 shutdown 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 msgr2=0x5557ace40f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace40f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe67c101280 tx=0x7fe66c0047c0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 shutdown_connections 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557ace4f170 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe65eff5700 0 client.25076 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace40f70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/628847008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 >> 172.21.15.69:0/628847008 conn(0x5557ace2cca0 msgr2=0x5557ace30f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 shutdown_connections 2023-12-14T18:25:21.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 1 -- 172.21.15.69:0/628847008 wait complete. 2023-12-14T18:25:21.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.673+0000 7fe68d52fb80 20 client.25076 trim_cache size 0 max 16384 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 Processor -- start 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 -- start start 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 0x5557ace3f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace48480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace38d00 0x5557ace319d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ace38600 con 0x5557ace37500 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ace32a30 con 0x5557ace37e50 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.698+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ace4a1b0 con 0x5557ace38d00 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 0x5557ace3f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 0x5557ace3f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35728/0 (socket says 172.21.15.69:35728) 2023-12-14T18:25:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 -- 172.21.15.69:0/1149267582 learned_addr learned my addr 172.21.15.69:0/1149267582 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67a7fc700 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace48480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace38d00 0x5557ace319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 -- 172.21.15.69:0/1149267582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace38d00 msgr2=0x5557ace319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace38d00 0x5557ace319d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 -- 172.21.15.69:0/1149267582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 msgr2=0x5557ace48480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace48480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 -- 172.21.15.69:0/1149267582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557acd4eec0 con 0x5557ace37500 2023-12-14T18:25:21.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe67affd700 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 0x5557ace3f160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009720 tx=0x7fe66c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b554a7513c19d940 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe661ffb700 1 -- 172.21.15.69:0/1149267582 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c01dea0 con 0x5557ace37500 2023-12-14T18:25:21.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe661ffb700 1 -- 172.21.15.69:0/1149267582 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe66c02d070 con 0x5557ace37500 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.699+0000 7fe661ffb700 1 -- 172.21.15.69:0/1149267582 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c032b30 con 0x5557ace37500 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.700+0000 7fe68d52fb80 1 -- 172.21.15.69:0/1149267582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 msgr2=0x5557ace3f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.700+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 0x5557ace3f160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009720 tx=0x7fe66c009750 comp rx=0 tx=0).stop 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.700+0000 7fe68d52fb80 1 -- 172.21.15.69:0/1149267582 shutdown_connections 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace38d00 0x5557ace319d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace37500 0x5557ace3f160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/1149267582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37e50 0x5557ace48480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- 172.21.15.69:0/1149267582 >> 172.21.15.69:0/1149267582 conn(0x5557ace2cca0 msgr2=0x5557ace3fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- 172.21.15.69:0/1149267582 shutdown_connections 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- 172.21.15.69:0/1149267582 wait complete. 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- start start 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 Processor -- start 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace44a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace47a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ace47f60 con 0x5557ace38d00 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ace480d0 con 0x5557ace37500 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ace48290 con 0x5557ace37e50 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.701+0000 7fe68d52fb80 10 client.0 _ll_register_callbacks cb 0x7fe66c011eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67affd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace47a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace47a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35736/0 (socket says 172.21.15.69:35736) 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 -- 172.21.15.69:0/2162392040 learned_addr learned my addr 172.21.15.69:0/2162392040 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 -- 172.21.15.69:0/2162392040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 msgr2=0x5557ace44a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace44a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 -- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 msgr2=0x5557ace444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 -- 172.21.15.69:0/2162392040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557acd4f170 con 0x5557ace38d00 2023-12-14T18:25:21.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67affd700 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe67b7fe700 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace47a20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe67409be00 tx=0x7fe67401f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6fd82489f1829f server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe65eff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.702+0000 7fe65eff5700 1 -- 172.21.15.69:0/2162392040 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67409f040 con 0x5557ace38d00 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe65eff5700 1 -- 172.21.15.69:0/2162392040 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe6740b7030 con 0x5557ace38d00 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6740a3980 con 0x5557ace38d00 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe65eff5700 1 -- 172.21.15.69:0/2162392040 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6740a7d10 con 0x5557ace38d00 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 10 client.15504 fetch_fsmap learned FSMap version 22 2023-12-14T18:25:21.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5557acd359a0 con 0x5557ace38d00 2023-12-14T18:25:21.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe65eff5700 1 -- 172.21.15.69:0/2162392040 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe674069080 con 0x5557ace38d00 2023-12-14T18:25:21.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe65eff5700 1 -- 172.21.15.69:0/2162392040 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe67409b740 con 0x5557ace38d00 2023-12-14T18:25:21.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 10 client.15504 fetch_fsmap finished waiting for FSMap version 22 2023-12-14T18:25:21.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 20 client.15504 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557acea3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 4 client.15504 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.703+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5557acd81a00 con 0x5557ace4cd60 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe67affd700 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557acea3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe65eff5700 10 client.15504 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe67affd700 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557acea3ae0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37d6b8d704a82fb9 server_cookie=dd97f00bcdc4fb42 in_seq=0 out_seq=0 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe65eff5700 1 -- 172.21.15.69:0/2162392040 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5557acd81a00 con 0x5557ace4cd60 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe65eff5700 10 client.15504 handle_command_reply: tid=0 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe68d52fb80 1 client.15504 shutdown 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 msgr2=0x5557ace47a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.704+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace47a20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe67409be00 tx=0x7fe67401f480 comp rx=0 tx=0).stop 2023-12-14T18:25:21.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 shutdown_connections 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5557ace4cd60 0x5557acea3ae0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557ace38d00 0x5557ace47a20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5557ace37500 0x5557ace444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 --2- 172.21.15.69:0/2162392040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557ace37e50 0x5557ace44a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 >> 172.21.15.69:0/2162392040 conn(0x5557ace2cca0 msgr2=0x5557ace3f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe65eff5700 0 client.15504 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 shutdown_connections 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 1 -- 172.21.15.69:0/2162392040 wait complete. 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe68d52fb80 20 client.15504 trim_cache size 0 max 16384 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:25:21.709 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: "88f8195a-69bf-424e-8d2a-1893249fab34": { 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "88f8195a-69bf-424e-8d2a-1893249fab34", 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:25:21.710 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6640a1150 msgr2=0x7fe6640a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe6813a1700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6640a1150 0x7fe6640a3600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe67c195290 tx=0x7fe66c009260 comp rx=0 tx=0).stop 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 msgr2=0x7fe67c19b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.705+0000 7fe6813a1700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c19b330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe6740062a0 tx=0x7fe674004d00 comp rx=0 tx=0).stop 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 shutdown_connections 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fe6640a1150 0x7fe6640a3600 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe67c101db0 0x7fe67c19b330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe67c100230 0x7fe67c193dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 --2- 172.21.15.69:0/36368762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe67c101420 0x7fe67c194300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 >> 172.21.15.69:0/36368762 conn(0x7fe67c0fb850 msgr2=0x7fe67c1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 shutdown_connections 2023-12-14T18:25:21.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:21.706+0000 7fe6813a1700 1 -- 172.21.15.69:0/36368762 wait complete. 2023-12-14T18:25:21.720 INFO:tasks.cephfs.filesystem:scrub status for tag:88f8195a-69bf-424e-8d2a-1893249fab34 - {'path': '/', 'tag': '88f8195a-69bf-424e-8d2a-1893249fab34', 'options': 'recursive,force'} 2023-12-14T18:25:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:21 smithi069 ceph-mon[42047]: pgmap v278: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:25:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:21 smithi069 ceph-mon[42047]: scrub queued for path: / 2023-12-14T18:25:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:21 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:21 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:25:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:21 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:22.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:21 smithi119 ceph-mon[43973]: pgmap v278: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:25:22.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:21 smithi119 ceph-mon[43973]: scrub queued for path: / 2023-12-14T18:25:22.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:21 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:22.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:21 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:25:22.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:21 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:22.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:21 smithi091 ceph-mon[43601]: pgmap v278: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:25:22.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:21 smithi091 ceph-mon[43601]: scrub queued for path: / 2023-12-14T18:25:22.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:21 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:22.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:21 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:25:22.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:21 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:23.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:23 smithi069 ceph-mon[42047]: pgmap v279: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T18:25:23.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:23 smithi069 ceph-mon[42047]: scrub summary: idle 2023-12-14T18:25:24.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:23 smithi119 ceph-mon[43973]: pgmap v279: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T18:25:24.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:23 smithi119 ceph-mon[43973]: scrub summary: idle 2023-12-14T18:25:24.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:23 smithi091 ceph-mon[43601]: pgmap v279: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-14T18:25:24.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:23 smithi091 ceph-mon[43601]: scrub summary: idle 2023-12-14T18:25:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:25 smithi069 ceph-mon[42047]: pgmap v280: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T18:25:26.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:25 smithi119 ceph-mon[43973]: pgmap v280: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T18:25:26.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:25 smithi091 ceph-mon[43601]: pgmap v280: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-12-14T18:25:27.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:27 smithi069 ceph-mon[42047]: pgmap v281: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T18:25:28.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:27 smithi119 ceph-mon[43973]: pgmap v281: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T18:25:28.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:27 smithi091 ceph-mon[43601]: pgmap v281: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:Note: switching to 'bf026da9d69000f3d4a9d16360156095d6612a2d'. 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:state without impacting any branches by switching back to a branch. 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: git switch -c 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr:Or undo this operation with: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: git switch - 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-12-14T18:25:28.857 INFO:tasks.workunit.client.0.smithi069.stderr:HEAD is now at bf026da9d69 doc/cephfs: Update docs to match remove functionality and respective vxattrs 2023-12-14T18:25:28.859 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-14T18:25:28.900 INFO:tasks.workunit.client.0.smithi069.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-14T18:25:28.902 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-14T18:25:28.902 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-14T18:25:29.432 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-14T18:25:29.498 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-14T18:25:29.535 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-14T18:25:29.536 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-14T18:25:29.536 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-14T18:25:29.573 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-14T18:25:29.576 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:25:29.577 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-14T18:25:29.634 INFO:tasks.workunit:Running workunits matching fs/misc on client.0... 2023-12-14T18:25:29.635 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2023-12-14T18:25:29.636 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2023-12-14T18:25:29.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T18:25:29.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p testdir 2023-12-14T18:25:29.705 INFO:tasks.workunit.client.0.smithi069.stderr:+ cd testdir 2023-12-14T18:25:29.706 INFO:tasks.workunit.client.0.smithi069.stderr:+ set +e 2023-12-14T18:25:29.706 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfacl -d -m u:nobody:rw . 2023-12-14T18:25:29.734 INFO:tasks.workunit.client.0.smithi069.stderr:setfacl: .: Operation not supported 2023-12-14T18:25:29.735 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 1 '!=' 0 2023-12-14T18:25:29.735 INFO:tasks.workunit.client.0.smithi069.stdout:Filesystem does not support ACL 2023-12-14T18:25:29.736 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'Filesystem does not support ACL' 2023-12-14T18:25:29.736 INFO:tasks.workunit.client.0.smithi069.stderr:+ exit 0 2023-12-14T18:25:29.737 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:25:29.737 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:25:29.823 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2023-12-14T18:25:29.823 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2023-12-14T18:25:29.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T18:25:29.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.91014 2023-12-14T18:25:29.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo foo 2023-12-14T18:25:29.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T18:25:29.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ chmod 400 test_chmod.91014 2023-12-14T18:25:29.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T18:25:29.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ check_perms test_chmod.91014 -r-------- 2023-12-14T18:25:29.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.91014 2023-12-14T18:25:29.856 INFO:tasks.workunit.client.0.smithi069.stderr:++ ls -la test_chmod.91014 2023-12-14T18:25:29.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Dec 14 18:25 test_chmod.91014' 2023-12-14T18:25:29.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T18:25:29.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ perms=-r-------- 2023-12-14T18:25:29.859 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Dec 14 18:25 test_chmod.91014 2023-12-14T18:25:29.859 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T18:25:29.860 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -r-------- '!=' -r--------. 2023-12-14T18:25:29.860 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Dec 14 18:25 test_chmod.91014 2023-12-14T18:25:29.860 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T18:25:29.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -r--------. '!=' -r--------. 2023-12-14T18:25:29.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ set +e 2023-12-14T18:25:29.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo bar 2023-12-14T18:25:29.863 INFO:tasks.workunit.client.0.smithi069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.91014: Permission denied 2023-12-14T18:25:29.863 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 1 = 0 2023-12-14T18:25:29.863 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T18:25:29.863 INFO:tasks.workunit.client.0.smithi069.stderr:+ chmod 600 test_chmod.91014 2023-12-14T18:25:29.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo bar 2023-12-14T18:25:29.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T18:25:29.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ check_perms test_chmod.91014 -rw------- 2023-12-14T18:25:29.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.91014 2023-12-14T18:25:29.865 INFO:tasks.workunit.client.0.smithi069.stderr:++ ls -la test_chmod.91014 2023-12-14T18:25:29.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Dec 14 18:25 test_chmod.91014' 2023-12-14T18:25:29.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T18:25:29.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ perms=-rw------- 2023-12-14T18:25:29.868 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Dec 14 18:25 test_chmod.91014 2023-12-14T18:25:29.868 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T18:25:29.870 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -rw------- '!=' -rw-------. 2023-12-14T18:25:29.870 INFO:tasks.workunit.client.0.smithi069.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Dec 14 18:25 test_chmod.91014 2023-12-14T18:25:29.870 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1}' 2023-12-14T18:25:29.871 INFO:tasks.workunit.client.0.smithi069.stderr:+ test -rw-------. '!=' -rw-------. 2023-12-14T18:25:29.872 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo foo 2023-12-14T18:25:29.872 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 0 '!=' 0 2023-12-14T18:25:29.873 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:25:29.873 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:25:29.939 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:29 smithi069 ceph-mon[42047]: pgmap v282: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T18:25:29.939 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:29 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:25:29.964 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2023-12-14T18:25:29.964 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2023-12-14T18:25:30.031 INFO:tasks.workunit.client.0.smithi069.stderr:+ set -e 2023-12-14T18:25:30.031 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p testdir 2023-12-14T18:25:30.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ file=test_chmod.91156 2023-12-14T18:25:30.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo foo 2023-12-14T18:25:30.035 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo chmod 600 testdir 2023-12-14T18:25:30.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_failure cat testdir/test_chmod.91156 2023-12-14T18:25:30.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ cat testdir/test_chmod.91156 2023-12-14T18:25:30.054 INFO:tasks.workunit.client.0.smithi069.stderr:cat: testdir/test_chmod.91156: Permission denied 2023-12-14T18:25:30.054 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-12-14T18:25:30.054 INFO:tasks.workunit.client.0.smithi069.stderr:+ sudo cat testdir/test_chmod.91156 2023-12-14T18:25:30.064 INFO:tasks.workunit.client.0.smithi069.stdout:foo 2023-12-14T18:25:30.065 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:25:30.065 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:25:30.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:29 smithi119 ceph-mon[43973]: pgmap v282: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T18:25:30.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:29 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:25:30.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:29 smithi091 ceph-mon[43601]: pgmap v282: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-12-14T18:25:30.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:29 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:25:30.159 INFO:tasks.workunit:Running workunit fs/misc/direct_io.py... 2023-12-14T18:25:30.159 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/direct_io.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py 2023-12-14T18:25:30.338 INFO:tasks.workunit.client.0.smithi069.stdout:ok 2023-12-14T18:25:30.342 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:25:30.342 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:25:30.389 INFO:tasks.workunit:Running workunit fs/misc/dirfrag.sh... 2023-12-14T18:25:30.389 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/dirfrag.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh 2023-12-14T18:25:30.421 INFO:tasks.workunit.client.0.smithi069.stdout:creating folder hierarchy 2023-12-14T18:25:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: pgmap v283: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:25:31.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:31 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: pgmap v283: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T18:25:32.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:25:32.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:31 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: pgmap v283: 97 pgs: 97 active+clean; 653 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:25:32.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:31 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:25:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:32 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:25:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:32 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:25:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:32 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:25:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:32 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:25:33.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:32 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:25:33.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:32 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:25:33.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:32 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:25:33.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:32 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:25:33.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:32 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:25:33.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:32 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:25:33.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:32 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:25:33.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:32 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:25:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:33 smithi069 ceph-mon[42047]: pgmap v284: 97 pgs: 97 active+clean; 653 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-14T18:25:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:33 smithi119 ceph-mon[43973]: pgmap v284: 97 pgs: 97 active+clean; 653 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-14T18:25:34.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:33 smithi091 ceph-mon[43601]: pgmap v284: 97 pgs: 97 active+clean; 653 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-14T18:25:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:35 smithi069 ceph-mon[42047]: pgmap v285: 97 pgs: 97 active+clean; 727 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 9 op/s 2023-12-14T18:25:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:35 smithi119 ceph-mon[43973]: pgmap v285: 97 pgs: 97 active+clean; 727 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 9 op/s 2023-12-14T18:25:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:35 smithi091 ceph-mon[43601]: pgmap v285: 97 pgs: 97 active+clean; 727 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 9 op/s 2023-12-14T18:25:37.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:37 smithi069 ceph-mon[42047]: pgmap v286: 97 pgs: 97 active+clean; 727 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-12-14T18:25:38.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:37 smithi119 ceph-mon[43973]: pgmap v286: 97 pgs: 97 active+clean; 727 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-12-14T18:25:38.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:37 smithi091 ceph-mon[43601]: pgmap v286: 97 pgs: 97 active+clean; 727 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-12-14T18:25:39.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:38 smithi119 ceph-mon[43973]: pgmap v287: 97 pgs: 97 active+clean; 4.6 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 373 KiB/s wr, 18 op/s 2023-12-14T18:25:39.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:38 smithi091 ceph-mon[43601]: pgmap v287: 97 pgs: 97 active+clean; 4.6 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 373 KiB/s wr, 18 op/s 2023-12-14T18:25:39.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:38 smithi069 ceph-mon[42047]: pgmap v287: 97 pgs: 97 active+clean; 4.6 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 373 KiB/s wr, 18 op/s 2023-12-14T18:25:41.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:41 smithi069 ceph-mon[42047]: pgmap v288: 97 pgs: 97 active+clean; 8.6 MiB data, 109 MiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 773 KiB/s wr, 30 op/s 2023-12-14T18:25:41.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:41 smithi119 ceph-mon[43973]: pgmap v288: 97 pgs: 97 active+clean; 8.6 MiB data, 109 MiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 773 KiB/s wr, 30 op/s 2023-12-14T18:25:41.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:41 smithi091 ceph-mon[43601]: pgmap v288: 97 pgs: 97 active+clean; 8.6 MiB data, 109 MiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 773 KiB/s wr, 30 op/s 2023-12-14T18:25:43.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:43 smithi069 ceph-mon[42047]: pgmap v289: 97 pgs: 97 active+clean; 17 MiB data, 127 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 45 op/s 2023-12-14T18:25:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:43 smithi119 ceph-mon[43973]: pgmap v289: 97 pgs: 97 active+clean; 17 MiB data, 127 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 45 op/s 2023-12-14T18:25:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:43 smithi091 ceph-mon[43601]: pgmap v289: 97 pgs: 97 active+clean; 17 MiB data, 127 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 45 op/s 2023-12-14T18:25:45.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:45 smithi069 ceph-mon[42047]: pgmap v290: 97 pgs: 97 active+clean; 24 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 78 op/s 2023-12-14T18:25:45.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:45 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:25:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:45 smithi119 ceph-mon[43973]: pgmap v290: 97 pgs: 97 active+clean; 24 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 78 op/s 2023-12-14T18:25:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:45 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:25:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:45 smithi091 ceph-mon[43601]: pgmap v290: 97 pgs: 97 active+clean; 24 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 78 op/s 2023-12-14T18:25:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:45 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:25:47.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:47 smithi069 ceph-mon[42047]: pgmap v291: 97 pgs: 97 active+clean; 24 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 80 op/s 2023-12-14T18:25:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:47 smithi119 ceph-mon[43973]: pgmap v291: 97 pgs: 97 active+clean; 24 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 80 op/s 2023-12-14T18:25:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:47 smithi091 ceph-mon[43601]: pgmap v291: 97 pgs: 97 active+clean; 24 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 80 op/s 2023-12-14T18:25:49.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:49 smithi069 ceph-mon[42047]: pgmap v292: 97 pgs: 97 active+clean; 24 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 81 op/s 2023-12-14T18:25:49.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:49 smithi119 ceph-mon[43973]: pgmap v292: 97 pgs: 97 active+clean; 24 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 81 op/s 2023-12-14T18:25:49.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:49 smithi091 ceph-mon[43601]: pgmap v292: 97 pgs: 97 active+clean; 24 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 81 op/s 2023-12-14T18:25:51.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:51 smithi069 ceph-mon[42047]: pgmap v293: 97 pgs: 97 active+clean; 37 MiB data, 196 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 81 op/s 2023-12-14T18:25:51.721 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:25:51.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:51 smithi119 ceph-mon[43973]: pgmap v293: 97 pgs: 97 active+clean; 37 MiB data, 196 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 81 op/s 2023-12-14T18:25:51.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:51 smithi091 ceph-mon[43601]: pgmap v293: 97 pgs: 97 active+clean; 37 MiB data, 196 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 81 op/s 2023-12-14T18:25:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3214311024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100340 msgr2=0x7f2d901007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3214311024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100340 0x7f2d901007b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009990 tx=0x7f2d80009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3214311024 shutdown_connections 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3214311024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d90100cf0 0x7f2d90107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3214311024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d900ff630 0x7f2d900ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3214311024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100340 0x7f2d901007b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3214311024 >> 172.21.15.69:0/3214311024 conn(0x7f2d900f9ed0 msgr2=0x7f2d900fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3214311024 shutdown_connections 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.890+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3214311024 wait complete. 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 Processor -- start 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 -- start start 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d900ff630 0x7f2d9010ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d90100340 0x7f2d90109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 0x7f2d90109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90109e30 con 0x7f2d90100cf0 2023-12-14T18:25:51.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90109fa0 con 0x7f2d900ff630 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d97eb2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901a0000 con 0x7f2d90100340 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d9644f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 0x7f2d90109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d9644f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 0x7f2d90109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49714/0 (socket says 172.21.15.69:49714) 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d9644f700 1 -- 172.21.15.69:0/3463694932 learned_addr learned my addr 172.21.15.69:0/3463694932 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d900ff630 0x7f2d9010ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d9544d700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d90100340 0x7f2d90109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.891+0000 7f2d9644f700 1 -- 172.21.15.69:0/3463694932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d90100340 msgr2=0x7f2d90109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d9644f700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d90100340 0x7f2d90109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d9644f700 1 -- 172.21.15.69:0/3463694932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d900ff630 msgr2=0x7f2d9010ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d9644f700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d900ff630 0x7f2d9010ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d9644f700 1 -- 172.21.15.69:0/3463694932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88009c40 con 0x7f2d90100cf0 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d9644f700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 0x7f2d90109690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c370 tx=0x7f2d8800c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:51.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d86ffd700 1 -- 172.21.15.69:0/3463694932 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88017070 con 0x7f2d90100cf0 2023-12-14T18:25:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d86ffd700 1 -- 172.21.15.69:0/3463694932 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d8800f040 con 0x7f2d90100cf0 2023-12-14T18:25:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d800095f0 con 0x7f2d90100cf0 2023-12-14T18:25:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d86ffd700 1 -- 172.21.15.69:0/3463694932 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800e050 con 0x7f2d90100cf0 2023-12-14T18:25:51.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.892+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9010ba30 con 0x7f2d90100cf0 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.894+0000 7f2d86ffd700 1 -- 172.21.15.69:0/3463694932 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2d88003a00 con 0x7f2d90100cf0 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.895+0000 7f2d86ffd700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0a1150 0x7f2d7c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.895+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0a1150 0x7f2d7c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.895+0000 7f2d86ffd700 1 -- 172.21.15.69:0/3463694932 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2d880cc260 con 0x7f2d90100cf0 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.895+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0a1150 0x7f2d7c0a3600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d90067940 tx=0x7f2d8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 Processor -- start 2023-12-14T18:25:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 -- start start 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d490a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d490b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d47f35e0 con 0x5627d490ae50 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d4862870 con 0x5627d490bd00 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2da4040b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d485bd00 con 0x5627d490a500 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46586/0 (socket says 172.21.15.69:46586) 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 -- 172.21.15.69:0/2633394212 learned_addr learned my addr 172.21.15.69:0/2633394212 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d490a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9544d700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d490b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 -- 172.21.15.69:0/2633394212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 msgr2=0x5627d490a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d490a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 -- 172.21.15.69:0/2633394212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 msgr2=0x5627d490b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d490b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9644f700 1 -- 172.21.15.69:0/2633394212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d46dd3b0 con 0x5627d490bd00 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d9544d700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d490b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.896+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d490a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.897+0000 7f2d9644f700 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490c170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d88099610 tx=0x7f2d88099240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8c7b68a3c5da12 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.897+0000 7f2d7bfff700 1 -- 172.21.15.69:0/2633394212 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880959c0 con 0x5627d490bd00 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.897+0000 7f2d7bfff700 1 -- 172.21.15.69:0/2633394212 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d880090d0 con 0x5627d490bd00 2023-12-14T18:25:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.897+0000 7f2d7bfff700 1 -- 172.21.15.69:0/2633394212 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880998e0 con 0x5627d490bd00 2023-12-14T18:25:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 -- 172.21.15.69:0/2633394212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 msgr2=0x5627d490c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490c170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d88099610 tx=0x7f2d88099240 comp rx=0 tx=0).stop 2023-12-14T18:25:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 -- 172.21.15.69:0/2633394212 shutdown_connections 2023-12-14T18:25:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490c170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d490a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2633394212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d490b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 -- 172.21.15.69:0/2633394212 >> 172.21.15.69:0/2633394212 conn(0x5627d48ffca0 msgr2=0x5627d4905430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 -- 172.21.15.69:0/2633394212 shutdown_connections 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 -- 172.21.15.69:0/2633394212 wait complete. 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 -- start start 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.898+0000 7f2da4040b80 1 Processor -- start 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 0x5627d4914190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d49146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490bd00 0x5627d491b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d47f7f90 con 0x5627d490ae50 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d47f7c30 con 0x5627d490a500 2023-12-14T18:25:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d46df6a0 con 0x5627d490bd00 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2da4040b80 10 client.0 _ll_register_callbacks cb 0x5627d481b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 0x5627d4914190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 0x5627d4914190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46596/0 (socket says 172.21.15.69:46596) 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d9544d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d49146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 -- 172.21.15.69:0/1579599595 learned_addr learned my addr 172.21.15.69:0/1579599595 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d9644f700 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490bd00 0x5627d491b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 -- 172.21.15.69:0/1579599595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490bd00 msgr2=0x5627d491b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490bd00 0x5627d491b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 -- 172.21.15.69:0/1579599595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 msgr2=0x5627d49146d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d49146d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 -- 172.21.15.69:0/1579599595 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9010ba30 con 0x5627d490a500 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 0x5627d4914190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0097c0 tx=0x7f2d8c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98cc4458b240e4a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d797fa700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:51.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.899+0000 7f2d797fa700 1 -- 172.21.15.69:0/1579599595 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c004220 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d48fd2b0 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2d797fa700 1 -- 172.21.15.69:0/1579599595 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2d8c004380 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2d797fa700 1 -- 172.21.15.69:0/1579599595 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d8c02e030 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 10 client.25112 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5627d4822170 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2d797fa700 1 -- 172.21.15.69:0/1579599595 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627d48fd2b0 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2d797fa700 1 -- 172.21.15.69:0/1579599595 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2d8c00e8a0 con 0x5627d490a500 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 10 client.25112 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 10 client.25112 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 20 client.25112 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d491ffc0 0x5627d49223d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 4 client.25112 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:51.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627d4854ce0 con 0x5627d491ffc0 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.900+0000 7f2d9544d700 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d491ffc0 0x5627d49223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.901+0000 7f2d797fa700 10 client.25112 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.901+0000 7f2d9544d700 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d491ffc0 0x5627d49223d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33de593045ea5206 server_cookie=8eacd8e7b0f7874f in_seq=0 out_seq=0 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.901+0000 7f2d797fa700 1 -- 172.21.15.69:0/1579599595 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5627d4854ce0 con 0x5627d491ffc0 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.901+0000 7f2d797fa700 10 client.25112 handle_command_reply: tid=0 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.901+0000 7f2da4040b80 1 client.25112 shutdown 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 msgr2=0x5627d4914190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 0x5627d4914190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0097c0 tx=0x7f2d8c0047c0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 shutdown_connections 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d491ffc0 0x5627d49223d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490bd00 0x5627d491b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490a500 0x5627d4914190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 --2- 172.21.15.69:0/1579599595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d49146d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2d797fa700 0 client.25112 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 >> 172.21.15.69:0/1579599595 conn(0x5627d48ffca0 msgr2=0x5627d4903f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 shutdown_connections 2023-12-14T18:25:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 1 -- 172.21.15.69:0/1579599595 wait complete. 2023-12-14T18:25:51.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.902+0000 7f2da4040b80 20 client.25112 trim_cache size 0 max 16384 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 Processor -- start 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 -- start start 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 0x5627d490ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490ae50 0x5627d491b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d49136e0 con 0x5627d490a500 2023-12-14T18:25:51.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d490b350 con 0x5627d490bd00 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2da4040b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d490b980 con 0x5627d490ae50 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2d95c4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 0x5627d490ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2d95c4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 0x5627d490ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49748/0 (socket says 172.21.15.69:49748) 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.927+0000 7f2d95c4e700 1 -- 172.21.15.69:0/3490183823 learned_addr learned my addr 172.21.15.69:0/3490183823 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d9644f700 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d9544d700 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490ae50 0x5627d491b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d95c4e700 1 -- 172.21.15.69:0/3490183823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490ae50 msgr2=0x5627d491b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490ae50 0x5627d491b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d95c4e700 1 -- 172.21.15.69:0/3490183823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 msgr2=0x5627d490f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d95c4e700 1 -- 172.21.15.69:0/3490183823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d49131b0 con 0x5627d490a500 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 0x5627d490ec60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c016040 tx=0x7f2d8c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1434e15f669d5a7c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d84ff9700 1 -- 172.21.15.69:0/3490183823 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c02e040 con 0x5627d490a500 2023-12-14T18:25:51.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d84ff9700 1 -- 172.21.15.69:0/3490183823 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d8c01e220 con 0x5627d490a500 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.928+0000 7f2d84ff9700 1 -- 172.21.15.69:0/3490183823 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c01cb30 con 0x5627d490a500 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 -- 172.21.15.69:0/3490183823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 msgr2=0x5627d490ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 0x5627d490ec60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c016040 tx=0x7f2d8c011920 comp rx=0 tx=0).stop 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 -- 172.21.15.69:0/3490183823 shutdown_connections 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d490f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490a500 0x5627d490ec60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 --2- 172.21.15.69:0/3490183823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490ae50 0x5627d491b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 -- 172.21.15.69:0/3490183823 >> 172.21.15.69:0/3490183823 conn(0x5627d48ffca0 msgr2=0x5627d491c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 -- 172.21.15.69:0/3490183823 shutdown_connections 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 -- 172.21.15.69:0/3490183823 wait complete. 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 -- start start 2023-12-14T18:25:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.929+0000 7f2da4040b80 1 Processor -- start 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d491b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d4917e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d4918350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d4918890 con 0x5627d490ae50 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d4918a00 con 0x5627d490bd00 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d4973e30 con 0x5627d490a500 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 10 client.0 _ll_register_callbacks cb 0x5627d481b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d4917e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d4917e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49762/0 (socket says 172.21.15.69:49762) 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 -- 172.21.15.69:0/2164926948 learned_addr learned my addr 172.21.15.69:0/2164926948 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d491b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9644f700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d4918350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 -- 172.21.15.69:0/2164926948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 msgr2=0x5627d491b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d491b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 -- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 msgr2=0x5627d4918350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d4918350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 -- 172.21.15.69:0/2164926948 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627d4822170 con 0x5627d490ae50 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d491b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d9544d700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d4917e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009990 tx=0x7f2d80004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2e403d5c40c608 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d797fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d797fa700 1 -- 172.21.15.69:0/2164926948 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800041b0 con 0x5627d490ae50 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2d797fa700 1 -- 172.21.15.69:0/2164926948 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2d80028ac0 con 0x5627d490ae50 2023-12-14T18:25:51.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.930+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d880090d0 con 0x5627d490ae50 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2d797fa700 1 -- 172.21.15.69:0/2164926948 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d80028c80 con 0x5627d490ae50 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 10 client.15540 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5627d4689b60 con 0x5627d490ae50 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2d797fa700 1 -- 172.21.15.69:0/2164926948 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d880090d0 con 0x5627d490ae50 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2d797fa700 1 -- 172.21.15.69:0/2164926948 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2d8000b9e0 con 0x5627d490ae50 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 10 client.15540 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 20 client.15540 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d49757b0 0x5627d4977bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 4 client.15540 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5627d4854a00 con 0x5627d49757b0 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.931+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d49757b0 0x5627d4977bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2d797fa700 10 client.15540 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:51.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2d95c4e700 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d49757b0 0x5627d4977bc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10fbacdb32345b60 server_cookie=6e0d21a90806eefb in_seq=0 out_seq=0 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2d797fa700 1 -- 172.21.15.69:0/2164926948 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5627d4854a00 con 0x5627d49757b0 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2d797fa700 10 client.15540 handle_command_reply: tid=0 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2da4040b80 1 client.15540 shutdown 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 msgr2=0x5627d4917e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.932+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d4917e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009990 tx=0x7f2d80004080 comp rx=0 tx=0).stop 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 shutdown_connections 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5627d49757b0 0x5627d4977bc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627d490bd00 0x5627d4918350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d797fa700 0 client.15540 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627d490a500 0x5627d491b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 --2- 172.21.15.69:0/2164926948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627d490ae50 0x5627d4917e10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 >> 172.21.15.69:0/2164926948 conn(0x5627d48ffca0 msgr2=0x5627d490ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 shutdown_connections 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 1 -- 172.21.15.69:0/2164926948 wait complete. 2023-12-14T18:25:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2da4040b80 20 client.15540 trim_cache size 0 max 16384 2023-12-14T18:25:51.941 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:25:51.941 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T18:25:51.941 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T18:25:51.941 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0a1150 msgr2=0x7f2d7c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0a1150 0x7f2d7c0a3600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d90067940 tx=0x7f2d8c009260 comp rx=0 tx=0).stop 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 msgr2=0x7f2d90109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 0x7f2d90109690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c370 tx=0x7f2d8800c680 comp rx=0 tx=0).stop 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 shutdown_connections 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2d7c0a1150 0x7f2d7c0a3600 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d90100cf0 0x7f2d90109690 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d900ff630 0x7f2d9010ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 --2- 172.21.15.69:0/3463694932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d90100340 0x7f2d90109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 >> 172.21.15.69:0/3463694932 conn(0x7f2d900f9ed0 msgr2=0x7f2d90103570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.933+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 shutdown_connections 2023-12-14T18:25:51.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:51.934+0000 7f2d97eb2700 1 -- 172.21.15.69:0/3463694932 wait complete. 2023-12-14T18:25:51.947 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T18:25:51.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.085+0000 7f999bcb3700 1 -- 172.21.15.69:0/2941181582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994101440 msgr2=0x7f9994101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.085+0000 7f999bcb3700 1 --2- 172.21.15.69:0/2941181582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994101440 0x7f9994101890 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9984009990 tx=0x7f9984009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.085+0000 7f999bcb3700 1 -- 172.21.15.69:0/2941181582 shutdown_connections 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 --2- 172.21.15.69:0/2941181582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9994101dd0 0x7f9994108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 --2- 172.21.15.69:0/2941181582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9994100250 0x7f9994100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 --2- 172.21.15.69:0/2941181582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994101440 0x7f9994101890 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 -- 172.21.15.69:0/2941181582 >> 172.21.15.69:0/2941181582 conn(0x7f99940fb830 msgr2=0x7f99940fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 -- 172.21.15.69:0/2941181582 shutdown_connections 2023-12-14T18:25:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 -- 172.21.15.69:0/2941181582 wait complete. 2023-12-14T18:25:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 Processor -- start 2023-12-14T18:25:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 -- start start 2023-12-14T18:25:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 0x7f9994195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9994101440 0x7f9994196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.086+0000 7f999bcb3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9994101dd0 0x7f999419d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999bcb3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999419da80 con 0x7f9994100250 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999bcb3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999419dbc0 con 0x7f9994101440 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999bcb3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999419dd50 con 0x7f9994101dd0 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 0x7f9994195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 0x7f9994195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49774/0 (socket says 172.21.15.69:49774) 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 -- 172.21.15.69:0/1362345544 learned_addr learned my addr 172.21.15.69:0/1362345544 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999924e700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9994101440 0x7f9994196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999a250700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9994101dd0 0x7f999419d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 -- 172.21.15.69:0/1362345544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9994101dd0 msgr2=0x7f999419d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9994101dd0 0x7f999419d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 -- 172.21.15.69:0/1362345544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9994101440 msgr2=0x7f9994196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9994101440 0x7f9994196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 -- 172.21.15.69:0/1362345544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840095f0 con 0x7f9994100250 2023-12-14T18:25:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f9999a4f700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 0x7f9994195f00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f999000d980 tx=0x7f999000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990004020 con 0x7f9994100250 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9990009730 con 0x7f9994100250 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999410ba60 con 0x7f9994100250 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990003a00 con 0x7f9994100250 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.087+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999410b8d0 con 0x7f9994100250 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.088+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9994107830 con 0x7f9994100250 2023-12-14T18:25:52.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.090+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f99900098a0 con 0x7f9994100250 2023-12-14T18:25:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.090+0000 7f998affd700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f99800a11d0 0x7f99800a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.090+0000 7f999924e700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f99800a11d0 0x7f99800a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.090+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f99900cc890 con 0x7f9994100250 2023-12-14T18:25:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.091+0000 7f999924e700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f99800a11d0 0x7f99800a3680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f998400b2e0 tx=0x7f9984004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.094+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9990096070 con 0x7f9994100250 2023-12-14T18:25:52.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.341+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9994061940 con 0x7f9994100250 2023-12-14T18:25:52.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.342+0000 7f998affd700 1 -- 172.21.15.69:0/1362345544 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10795 (secure 0 0 0) 0x7f9990099690 con 0x7f9994100250 2023-12-14T18:25:52.344 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:25:52.344 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:25:44.404506+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:25:52.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f99800a11d0 msgr2=0x7f99800a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f99800a11d0 0x7f99800a3680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f998400b2e0 tx=0x7f9984004000 comp rx=0 tx=0).stop 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 msgr2=0x7f9994195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 0x7f9994195f00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f999000d980 tx=0x7f999000dc90 comp rx=0 tx=0).stop 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 shutdown_connections 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f99800a11d0 0x7f99800a3680 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9994101dd0 0x7f999419d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994100250 0x7f9994195f00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 --2- 172.21.15.69:0/1362345544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9994101440 0x7f9994196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 >> 172.21.15.69:0/1362345544 conn(0x7f99940fb830 msgr2=0x7f9994104970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 shutdown_connections 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.344+0000 7f999bcb3700 1 -- 172.21.15.69:0/1362345544 wait complete. 2023-12-14T18:25:52.347 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 23 2023-12-14T18:25:52.358 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T18:25:52.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2716139846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa01035d0 msgr2=0x7f7aa01059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2716139846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa01035d0 0x7f7aa01059b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009990 tx=0x7f7a94009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2716139846 shutdown_connections 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2716139846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa0105ef0 0x7f7aa0108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2716139846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2716139846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa01035d0 0x7f7aa01059b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2716139846 >> 172.21.15.69:0/2716139846 conn(0x7f7aa00fa750 msgr2=0x7f7aa00fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2716139846 shutdown_connections 2023-12-14T18:25:52.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.484+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2716139846 wait complete. 2023-12-14T18:25:52.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.485+0000 7f7aa5d29700 1 Processor -- start 2023-12-14T18:25:52.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.485+0000 7f7aa5d29700 1 -- start start 2023-12-14T18:25:52.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa01035d0 0x7f7aa01963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa0105ef0 0x7f7aa019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa019da30 con 0x7f7aa0100cb0 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa019db70 con 0x7f7aa0105ef0 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa019dd00 con 0x7f7aa01035d0 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49792/0 (socket says 172.21.15.69:49792) 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2570069714 learned_addr learned my addr 172.21.15.69:0/2570069714 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9effd700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa01035d0 0x7f7aa01963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa0105ef0 0x7f7aa019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2570069714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa01035d0 msgr2=0x7f7aa01963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa01035d0 0x7f7aa01963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2570069714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa0105ef0 msgr2=0x7f7aa019d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa0105ef0 0x7f7aa019d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2570069714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940095f0 con 0x7f7aa0100cb0 2023-12-14T18:25:52.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0195eb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000e9a0 tx=0x7f7a9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9cff9700 1 -- 172.21.15.69:0/2570069714 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90009790 con 0x7f7aa0100cb0 2023-12-14T18:25:52.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa010baa0 con 0x7f7aa0100cb0 2023-12-14T18:25:52.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9cff9700 1 -- 172.21.15.69:0/2570069714 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a90010430 con 0x7f7aa0100cb0 2023-12-14T18:25:52.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7a9cff9700 1 -- 172.21.15.69:0/2570069714 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000cea0 con 0x7f7aa0100cb0 2023-12-14T18:25:52.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.486+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa010b910 con 0x7f7aa0100cb0 2023-12-14T18:25:52.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.489+0000 7f7a9cff9700 1 -- 172.21.15.69:0/2570069714 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7a900105a0 con 0x7f7aa0100cb0 2023-12-14T18:25:52.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.489+0000 7f7a9cff9700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a880a1150 0x7f7a880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.489+0000 7f7a9effd700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a880a1150 0x7f7a880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7a9cff9700 1 -- 172.21.15.69:0/2570069714 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7a90014070 con 0x7f7aa0100cb0 2023-12-14T18:25:52.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7a9effd700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a880a1150 0x7f7a880a3600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a94006010 tx=0x7f7a94005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 Processor -- start 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 -- start start 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421a500 0x564cf421a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421ae50 0x564cf421b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf421c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf41035e0 con 0x564cf421bd00 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf4172870 con 0x564cf421ae50 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.490+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf416bd00 con 0x564cf421a500 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf421c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9effd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421ae50 0x564cf421b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf421c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49804/0 (socket says 172.21.15.69:49804) 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 -- 172.21.15.69:0/4173776012 learned_addr learned my addr 172.21.15.69:0/4173776012 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421a500 0x564cf421a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 -- 172.21.15.69:0/4173776012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421a500 msgr2=0x564cf421a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421a500 0x564cf421a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 -- 172.21.15.69:0/4173776012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421ae50 msgr2=0x564cf421b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421ae50 0x564cf421b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 -- 172.21.15.69:0/4173776012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cf3fed3b0 con 0x564cf421bd00 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9effd700 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421ae50 0x564cf421b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf421c170 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7a98011680 tx=0x7f7a98009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5ae5b9e9d755cd server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a85ffb700 1 -- 172.21.15.69:0/4173776012 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800e040 con 0x564cf421bd00 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a85ffb700 1 -- 172.21.15.69:0/4173776012 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a9800f040 con 0x564cf421bd00 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.491+0000 7f7a85ffb700 1 -- 172.21.15.69:0/4173776012 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98004770 con 0x564cf421bd00 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/4173776012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 msgr2=0x564cf421c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf421c170 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7a98011680 tx=0x7f7a98009920 comp rx=0 tx=0).stop 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/4173776012 shutdown_connections 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf421c170 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421a500 0x564cf421a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/4173776012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421ae50 0x564cf421b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/4173776012 >> 172.21.15.69:0/4173776012 conn(0x564cf420fca0 msgr2=0x564cf4215430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/4173776012 shutdown_connections 2023-12-14T18:25:52.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/4173776012 wait complete. 2023-12-14T18:25:52.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.492+0000 7f7ab1eb7b80 1 -- start start 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 Processor -- start 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421a500 0x564cf42240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4224620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf422b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf4107f90 con 0x564cf421bd00 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf4107c30 con 0x564cf421a500 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf3fef6a0 con 0x564cf421ae50 2023-12-14T18:25:52.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf422b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421a500 0x564cf42240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7ab1eb7b80 10 client.0 _ll_register_callbacks cb 0x564cf412b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf422b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49814/0 (socket says 172.21.15.69:49814) 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9ffff700 1 -- 172.21.15.69:0/2111150452 learned_addr learned my addr 172.21.15.69:0/2111150452 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9effd700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4224620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2111150452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 msgr2=0x564cf4224620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4224620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2111150452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 msgr2=0x564cf422b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf422b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/2111150452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a98011330 con 0x564cf421a500 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.493+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf422b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421a500 0x564cf42240e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c2d0 tx=0x7f7a9009a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f23a7fb7f7d2e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a7effd700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a7effd700 1 -- 172.21.15.69:0/2111150452 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900a20c0 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a7effd700 1 -- 172.21.15.69:0/2111150452 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7a9009df30 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cf420d2b0 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a7effd700 1 -- 172.21.15.69:0/2111150452 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a900a2350 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 10 client.25136 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564cf4132170 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a7effd700 1 -- 172.21.15.69:0/2111150452 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a900c8080 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a7effd700 1 -- 172.21.15.69:0/2111150452 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7a90095cf0 con 0x564cf421a500 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 10 client.25136 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 10 client.25136 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 20 client.25136 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf422fea0 0x564cf42322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 4 client.25136 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cf4164ce0 con 0x564cf422fea0 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.494+0000 7f7a9effd700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf422fea0 0x564cf42322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.495+0000 7f7a7effd700 10 client.25136 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.495+0000 7f7a9effd700 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf422fea0 0x564cf42322b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4622565dd8201e10 server_cookie=4c9265368c1d7a65 in_seq=0 out_seq=0 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.495+0000 7f7a7effd700 1 -- 172.21.15.69:0/2111150452 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564cf4164ce0 con 0x564cf422fea0 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.495+0000 7f7a7effd700 10 client.25136 handle_command_reply: tid=0 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.495+0000 7f7ab1eb7b80 1 client.25136 shutdown 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421a500 msgr2=0x564cf42240e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421a500 0x564cf42240e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c2d0 tx=0x7f7a9009a440 comp rx=0 tx=0).stop 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 shutdown_connections 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf422fea0 0x564cf42322b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421bd00 0x564cf422b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7a7effd700 0 client.25136 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421a500 0x564cf42240e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/2111150452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4224620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 >> 172.21.15.69:0/2111150452 conn(0x564cf420fca0 msgr2=0x564cf4213f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 shutdown_connections 2023-12-14T18:25:52.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/2111150452 wait complete. 2023-12-14T18:25:52.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.496+0000 7f7ab1eb7b80 20 client.25136 trim_cache size 0 max 16384 2023-12-14T18:25:52.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.508+0000 7f7ab1eb7b80 1 Processor -- start 2023-12-14T18:25:52.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 -- start start 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf42149d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4222000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4222540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf422ba10 con 0x564cf421a500 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf4221db0 con 0x564cf421bd00 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf421f6a0 con 0x564cf421ae50 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf42149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf42149d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49822/0 (socket says 172.21.15.69:49822) 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/469942582 learned_addr learned my addr 172.21.15.69:0/469942582 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4222540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9effd700 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4222000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/469942582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 msgr2=0x564cf4222000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4222000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/469942582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 msgr2=0x564cf4222540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4222540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/469942582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cf4131ec0 con 0x564cf421a500 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf42149d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7a90098250 tx=0x7f7a900984b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8665f9b90ae6d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a867fc700 1 -- 172.21.15.69:0/469942582 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900a2350 con 0x564cf421a500 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a867fc700 1 -- 172.21.15.69:0/469942582 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564cf420d2b0 con 0x564cf421a500 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.509+0000 7f7a867fc700 1 -- 172.21.15.69:0/469942582 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90094d70 con 0x564cf421a500 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/469942582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 msgr2=0x564cf42149d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf42149d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7a90098250 tx=0x7f7a900984b0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/469942582 shutdown_connections 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4222540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf42149d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/469942582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf4222000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/469942582 >> 172.21.15.69:0/469942582 conn(0x564cf420fca0 msgr2=0x564cf4236c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/469942582 shutdown_connections 2023-12-14T18:25:52.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/469942582 wait complete. 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.510+0000 7f7ab1eb7b80 1 -- start start 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 Processor -- start 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf427ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf42804e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4286dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf4287310 con 0x564cf421a500 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf4287450 con 0x564cf421bd00 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cf42875e0 con 0x564cf421ae50 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 10 client.0 _ll_register_callbacks cb 0x7f7a90099860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf427ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf427ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49832/0 (socket says 172.21.15.69:49832) 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/3923043383 learned_addr learned my addr 172.21.15.69:0/3923043383 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9effd700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf42804e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9ffff700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4286dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/3923043383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 msgr2=0x564cf42804e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf42804e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 msgr2=0x564cf4286dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4286dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 -- 172.21.15.69:0/3923043383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cf4132170 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a9f7fe700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf427ffa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7a90000c00 tx=0x7f7a90096370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0014bef4a3ee795 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a7effd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a7effd700 1 -- 172.21.15.69:0/3923043383 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900a1ec0 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7a7effd700 1 -- 172.21.15.69:0/3923043383 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7a900a2350 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.511+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a9800f040 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7a7effd700 1 -- 172.21.15.69:0/3923043383 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a900ca2c0 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 10 client.15564 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564cf41189a0 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7a7effd700 1 -- 172.21.15.69:0/3923043383 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a9007c080 con 0x564cf421a500 2023-12-14T18:25:52.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7a7effd700 1 -- 172.21.15.69:0/3923043383 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7a90098e60 con 0x564cf421a500 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 10 client.15564 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 10 client.15564 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 20 client.15564 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf4288ab0 0x564cf428ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 4 client.15564 mds_command: new command op to 24458 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564cf4164a00 con 0x564cf4288ab0 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7a9effd700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf4288ab0 0x564cf428ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7a7effd700 10 client.15564 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.512+0000 7f7a9effd700 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf4288ab0 0x564cf428ae90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=96468343058fa00e server_cookie=c958ef7c36450cdd in_seq=0 out_seq=0 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7a7effd700 1 -- 172.21.15.69:0/3923043383 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564cf4164a00 con 0x564cf4288ab0 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7a7effd700 10 client.15564 handle_command_reply: tid=0 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 client.15564 shutdown 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 msgr2=0x564cf427ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf427ffa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7a90000c00 tx=0x7f7a90096370 comp rx=0 tx=0).stop 2023-12-14T18:25:52.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 shutdown_connections 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x564cf4288ab0 0x564cf428ae90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564cf421bd00 0x564cf4286dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7a7effd700 0 client.15564 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564cf421a500 0x564cf427ffa0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 --2- 172.21.15.69:0/3923043383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564cf421ae50 0x564cf42804e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 >> 172.21.15.69:0/3923043383 conn(0x564cf420fca0 msgr2=0x564cf42149d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 shutdown_connections 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 1 -- 172.21.15.69:0/3923043383 wait complete. 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7ab1eb7b80 20 client.15564 trim_cache size 0 max 16384 2023-12-14T18:25:52.521 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:25:52.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a880a1150 msgr2=0x7f7a880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a880a1150 0x7f7a880a3600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a94006010 tx=0x7f7a94005960 comp rx=0 tx=0).stop 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 msgr2=0x7f7aa0195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0195eb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000e9a0 tx=0x7f7a9000ecb0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 shutdown_connections 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7a880a1150 0x7f7a880a3600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa0105ef0 0x7f7aa019d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7aa0100cb0 0x7f7aa0195eb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 --2- 172.21.15.69:0/2570069714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa01035d0 0x7f7aa01963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.513+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 >> 172.21.15.69:0/2570069714 conn(0x7f7aa00fa750 msgr2=0x7f7aa0102190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.514+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 shutdown_connections 2023-12-14T18:25:52.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.514+0000 7f7aa5d29700 1 -- 172.21.15.69:0/2570069714 wait complete. 2023-12-14T18:25:52.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 -- 172.21.15.69:0/511950614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100ce0 msgr2=0x7fb12c1075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 --2- 172.21.15.69:0/511950614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100ce0 0x7fb12c1075a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb124009f90 tx=0x7fb12400b330 comp rx=0 tx=0).stop 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 -- 172.21.15.69:0/511950614 shutdown_connections 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 --2- 172.21.15.69:0/511950614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100ce0 0x7fb12c1075a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 --2- 172.21.15.69:0/511950614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c0ff160 0x7fb12c0ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 --2- 172.21.15.69:0/511950614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c100350 0x7fb12c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.684+0000 7fb130cdf700 1 -- 172.21.15.69:0/511950614 >> 172.21.15.69:0/511950614 conn(0x7fb12c0fa780 msgr2=0x7fb12c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.685+0000 7fb130cdf700 1 -- 172.21.15.69:0/511950614 shutdown_connections 2023-12-14T18:25:52.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.685+0000 7fb130cdf700 1 -- 172.21.15.69:0/511950614 wait complete. 2023-12-14T18:25:52.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.685+0000 7fb130cdf700 1 Processor -- start 2023-12-14T18:25:52.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.685+0000 7fb130cdf700 1 -- start start 2023-12-14T18:25:52.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb130cdf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 0x7fb12c069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb130cdf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100350 0x7fb12c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb130cdf700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c100ce0 0x7fb12c19d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb130cdf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c19daa0 con 0x7fb12c100350 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb130cdf700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c19dc10 con 0x7fb12c100ce0 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb130cdf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c19ddd0 con 0x7fb12c0ff160 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 0x7fb12c069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 0x7fb12c069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:51500/0 (socket says 172.21.15.69:51500) 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 -- 172.21.15.69:0/1533178969 learned_addr learned my addr 172.21.15.69:0/1533178969 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c100ce0 0x7fb12c19d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100350 0x7fb12c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 -- 172.21.15.69:0/1533178969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c100ce0 msgr2=0x7fb12c19d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c100ce0 0x7fb12c19d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 -- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100350 msgr2=0x7fb12c19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100350 0x7fb12c19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.686+0000 7fb12a59c700 1 -- 172.21.15.69:0/1533178969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0095f0 con 0x7fb12c0ff160 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c100ce0 0x7fb12c19d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb12a59c700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 0x7fb12c069910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00ebf0 tx=0x7fb11c00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb11b7fe700 1 -- 172.21.15.69:0/1533178969 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c009a10 con 0x7fb12c0ff160 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb11b7fe700 1 -- 172.21.15.69:0/1533178969 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb11c00cc90 con 0x7fb12c0ff160 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb11b7fe700 1 -- 172.21.15.69:0/1533178969 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c018680 con 0x7fb12c0ff160 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124009c40 con 0x7fb12c0ff160 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.687+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c10a980 con 0x7fb12c0ff160 2023-12-14T18:25:52.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.689+0000 7fb11b7fe700 1 -- 172.21.15.69:0/1533178969 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb11c010430 con 0x7fb12c0ff160 2023-12-14T18:25:52.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.690+0000 7fb11b7fe700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1140a11d0 0x7fb1140a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.690+0000 7fb11b7fe700 1 -- 172.21.15.69:0/1533178969 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb11c014070 con 0x7fb12c0ff160 2023-12-14T18:25:52.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.690+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1140a11d0 0x7fb1140a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 Processor -- start 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1140a11d0 0x7fb1140a3680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb120005950 tx=0x7fb12000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 -- start start 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa1791910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa179af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa179b560 0x55baa179b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa167a5e0 con 0x55baa179b560 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa16e9870 con 0x55baa1791e50 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.691+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa16e2d00 con 0x55baa1791500 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa179af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa179af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46672/0 (socket says 172.21.15.69:46672) 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 -- 172.21.15.69:0/1963367015 learned_addr learned my addr 172.21.15.69:0/1963367015 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb12a59c700 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa1791910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa179b560 0x55baa179b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 -- 172.21.15.69:0/1963367015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 msgr2=0x55baa1791910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa1791910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 -- 172.21.15.69:0/1963367015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa179b560 msgr2=0x55baa179b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa179b560 0x55baa179b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 -- 172.21.15.69:0/1963367015 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baa15643b0 con 0x55baa1791e50 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa179af80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb120010fa0 tx=0x7fb120013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44581f58d9bedc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb118ff9700 1 -- 172.21.15.69:0/1963367015 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12001e620 con 0x55baa1791e50 2023-12-14T18:25:52.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb118ff9700 1 -- 172.21.15.69:0/1963367015 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb120015070 con 0x55baa1791e50 2023-12-14T18:25:52.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.692+0000 7fb118ff9700 1 -- 172.21.15.69:0/1963367015 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12001c910 con 0x55baa1791e50 2023-12-14T18:25:52.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1963367015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 msgr2=0x55baa179af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa179af80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb120010fa0 tx=0x7fb120013000 comp rx=0 tx=0).stop 2023-12-14T18:25:52.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1963367015 shutdown_connections 2023-12-14T18:25:52.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa179b560 0x55baa179b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa1791910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1963367015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa179af80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1963367015 >> 172.21.15.69:0/1963367015 conn(0x55baa1786ca0 msgr2=0x55baa178c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1963367015 shutdown_connections 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.693+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1963367015 wait complete. 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 -- start start 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 Processor -- start 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791500 0x55baa17a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa17a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa167ef90 con 0x55baa1791500 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa167ec30 con 0x55baa1791e50 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa15666a0 con 0x55baa179b560 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb13ce6db80 10 client.0 _ll_register_callbacks cb 0x55baa16a2910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa17a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa17a3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46680/0 (socket says 172.21.15.69:46680) 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb129d9b700 1 -- 172.21.15.69:0/3579722927 learned_addr learned my addr 172.21.15.69:0/3579722927 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.694+0000 7fb12a59c700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791500 0x55baa17a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb129d9b700 1 -- 172.21.15.69:0/3579722927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 msgr2=0x55baa17aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb129d9b700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb129d9b700 1 -- 172.21.15.69:0/3579722927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791500 msgr2=0x55baa17a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb129d9b700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791500 0x55baa17a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb129d9b700 1 -- 172.21.15.69:0/3579722927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb120010c50 con 0x55baa1791e50 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb12a59c700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791500 0x55baa17a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb129d9b700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa17a3e80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb120010f70 tx=0x7fb120005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8dab7eedb5b42e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb111ffb700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb111ffb700 1 -- 172.21.15.69:0/3579722927 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200056d0 con 0x55baa1791e50 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb111ffb700 1 -- 172.21.15.69:0/3579722927 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb120017070 con 0x55baa1791e50 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.695+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baa17842b0 con 0x55baa1791e50 2023-12-14T18:25:52.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb111ffb700 1 -- 172.21.15.69:0/3579722927 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb120004710 con 0x55baa1791e50 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 10 client.25154 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55baa16a9170 con 0x55baa1791e50 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb111ffb700 1 -- 172.21.15.69:0/3579722927 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55baa17842b0 con 0x55baa1791e50 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb111ffb700 1 -- 172.21.15.69:0/3579722927 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb12004a070 con 0x55baa1791e50 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 10 client.25154 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 10 client.25154 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 20 client.25154 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa17b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 4 client.25154 mds_command: new command op to 24482 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baa16dbce0 con 0x55baa17af500 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.696+0000 7fb12a59c700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa17b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb111ffb700 10 client.25154 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:52.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb12a59c700 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa17b1910 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=acca79948ec0e0db server_cookie=2cdab950640e7414 in_seq=0 out_seq=0 2023-12-14T18:25:52.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb111ffb700 1 -- 172.21.15.69:0/3579722927 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55baa16dbce0 con 0x55baa17af500 2023-12-14T18:25:52.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb111ffb700 10 client.25154 handle_command_reply: tid=0 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 client.25154 shutdown 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 msgr2=0x55baa17a3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa17a3e80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb120010f70 tx=0x7fb120005270 comp rx=0 tx=0).stop 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 shutdown_connections 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa17b1910 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791500 0x55baa17a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb111ffb700 0 client.25154 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/3579722927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791e50 0x55baa17a3e80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 >> 172.21.15.69:0/3579722927 conn(0x55baa1786ca0 msgr2=0x55baa178c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 shutdown_connections 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.697+0000 7fb13ce6db80 1 -- 172.21.15.69:0/3579722927 wait complete. 2023-12-14T18:25:52.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.698+0000 7fb13ce6db80 20 client.25154 trim_cache size 0 max 16384 2023-12-14T18:25:52.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:52 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1362345544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 Processor -- start 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 -- start start 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa179b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 0x55baa178b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa17af070 con 0x55baa1791e50 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa1786820 con 0x55baa179b560 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.715+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa17a45c0 con 0x55baa1791500 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 0x55baa178b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 0x55baa178b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46684/0 (socket says 172.21.15.69:46684) 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 -- 172.21.15.69:0/1149112616 learned_addr learned my addr 172.21.15.69:0/1149112616 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb129d9b700 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12a59c700 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa179b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 -- 172.21.15.69:0/1149112616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 msgr2=0x55baa179b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa179b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 -- 172.21.15.69:0/1149112616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 msgr2=0x55baa17aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 -- 172.21.15.69:0/1149112616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baa16a8ec0 con 0x55baa179b560 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 0x55baa178b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb124009f90 tx=0x7fb124009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a411a4627457187 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb1197fa700 1 -- 172.21.15.69:0/1149112616 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400e040 con 0x55baa179b560 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb1197fa700 1 -- 172.21.15.69:0/1149112616 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb124020070 con 0x55baa179b560 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.716+0000 7fb1197fa700 1 -- 172.21.15.69:0/1149112616 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124027480 con 0x55baa179b560 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1149112616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 msgr2=0x55baa178b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 0x55baa178b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb124009f90 tx=0x7fb124009470 comp rx=0 tx=0).stop 2023-12-14T18:25:52.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1149112616 shutdown_connections 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa179b560 0x55baa178b9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa1791500 0x55baa179b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/1149112616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.717+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1149112616 >> 172.21.15.69:0/1149112616 conn(0x55baa1786ca0 msgr2=0x55baa17a26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1149112616 shutdown_connections 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 -- 172.21.15.69:0/1149112616 wait complete. 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 -- start start 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 Processor -- start 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 0x55baa17a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17a7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa17aa5d0 con 0x55baa1791e50 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa17aa740 con 0x55baa1791500 2023-12-14T18:25:52.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa17aa900 con 0x55baa179b560 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb13ce6db80 10 client.0 _ll_register_callbacks cb 0x7fb120010e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 0x55baa17a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 0x55baa17a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46700/0 (socket says 172.21.15.69:46700) 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.718+0000 7fb12a59c700 1 -- 172.21.15.69:0/4021341349 learned_addr learned my addr 172.21.15.69:0/4021341349 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12ad9d700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12a59c700 1 -- 172.21.15.69:0/4021341349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 msgr2=0x55baa17aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12a59c700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12a59c700 1 -- 172.21.15.69:0/4021341349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 msgr2=0x55baa17a7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb129d9b700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12a59c700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17a7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12a59c700 1 -- 172.21.15.69:0/4021341349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c107ed0 con 0x55baa1791500 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb129d9b700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17a7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb12a59c700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 0x55baa17a7030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb11c096d20 tx=0x7fb11c085040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9723678d4e3bbdfa server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb111ffb700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb111ffb700 1 -- 172.21.15.69:0/4021341349 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c09e2e0 con 0x55baa1791500 2023-12-14T18:25:52.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb111ffb700 1 -- 172.21.15.69:0/4021341349 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb11c0a2700 con 0x55baa1791500 2023-12-14T18:25:52.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb120015070 con 0x55baa1791500 2023-12-14T18:25:52.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb111ffb700 1 -- 172.21.15.69:0/4021341349 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb11c0997a0 con 0x55baa1791500 2023-12-14T18:25:52.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb13ce6db80 10 client.25160 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:52.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.719+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55baa168f9a0 con 0x55baa1791500 2023-12-14T18:25:52.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb111ffb700 1 -- 172.21.15.69:0/4021341349 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb120015070 con 0x55baa1791500 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb111ffb700 1 -- 172.21.15.69:0/4021341349 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb11c0c4ae0 con 0x55baa1791500 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb13ce6db80 10 client.25160 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb13ce6db80 10 client.25160 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb13ce6db80 20 client.25160 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa18062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb13ce6db80 4 client.25160 mds_command: new command op to 24482 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55baa16dba00 con 0x55baa17af500 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.720+0000 7fb129d9b700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa18062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb111ffb700 10 client.25160 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb129d9b700 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa18062f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7b06245db4903d8 server_cookie=6510c056c9458c6a in_seq=0 out_seq=0 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb111ffb700 1 -- 172.21.15.69:0/4021341349 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55baa16dba00 con 0x55baa17af500 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb111ffb700 10 client.25160 handle_command_reply: tid=0 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 client.25160 shutdown 2023-12-14T18:25:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 msgr2=0x55baa17a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 0x55baa17a7030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb11c096d20 tx=0x7fb11c085040 comp rx=0 tx=0).stop 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 shutdown_connections 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x55baa17af500 0x55baa18062f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55baa179b560 0x55baa17aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55baa1791500 0x55baa17a7030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb111ffb700 0 client.25160 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 --2- 172.21.15.69:0/4021341349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55baa1791e50 0x55baa17a7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 >> 172.21.15.69:0/4021341349 conn(0x55baa1786ca0 msgr2=0x55baa17ab7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 shutdown_connections 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.721+0000 7fb13ce6db80 1 -- 172.21.15.69:0/4021341349 wait complete. 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb13ce6db80 20 client.25160 trim_cache size 0 max 16384 2023-12-14T18:25:52.727 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:25:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1140a11d0 msgr2=0x7fb1140a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1140a11d0 0x7fb1140a3680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb120005950 tx=0x7fb12000b410 comp rx=0 tx=0).stop 2023-12-14T18:25:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 msgr2=0x7fb12c069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 0x7fb12c069910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00ebf0 tx=0x7fb11c00ef00 comp rx=0 tx=0).stop 2023-12-14T18:25:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 shutdown_connections 2023-12-14T18:25:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fb1140a11d0 0x7fb1140a3680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb12c100ce0 0x7fb12c19d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb12c0ff160 0x7fb12c069910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.722+0000 7fb130cdf700 1 --2- 172.21.15.69:0/1533178969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12c100350 0x7fb12c19acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.723+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 >> 172.21.15.69:0/1533178969 conn(0x7fb12c0fa780 msgr2=0x7fb12c1037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.723+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 shutdown_connections 2023-12-14T18:25:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.723+0000 7fb130cdf700 1 -- 172.21.15.69:0/1533178969 wait complete. 2023-12-14T18:25:52.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T18:25:52.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:52 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1362345544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:25:52.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:52 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1362345544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 -- 172.21.15.69:0/4184084498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724103650 msgr2=0x7fd724105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/4184084498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724103650 0x7fd724105a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd714009990 tx=0x7fd714009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 -- 172.21.15.69:0/4184084498 shutdown_connections 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/4184084498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724105f70 0x7fd724108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/4184084498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 0x7fd724103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/4184084498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724103650 0x7fd724105a30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 -- 172.21.15.69:0/4184084498 >> 172.21.15.69:0/4184084498 conn(0x7fd7240fa770 msgr2=0x7fd7240fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 -- 172.21.15.69:0/4184084498 shutdown_connections 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.893+0000 7fd72b6b2700 1 -- 172.21.15.69:0/4184084498 wait complete. 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 Processor -- start 2023-12-14T18:25:52.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 -- start start 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 0x7fd7241006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724103650 0x7fd7240fece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724105f70 0x7fd7240ff220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240ff9c0 con 0x7fd724103650 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240ffb30 con 0x7fd724105f70 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.894+0000 7fd72b6b2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72419ff20 con 0x7fd724100d30 2023-12-14T18:25:52.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd72944e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 0x7fd7241006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724103650 0x7fd7240fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd72944e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 0x7fd7241006a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:51542/0 (socket says 172.21.15.69:51542) 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd72944e700 1 -- 172.21.15.69:0/2486123104 learned_addr learned my addr 172.21.15.69:0/2486123104 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724105f70 0x7fd7240ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 -- 172.21.15.69:0/2486123104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 msgr2=0x7fd7241006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 0x7fd7241006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 -- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724103650 msgr2=0x7fd7240fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724103650 0x7fd7240fece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 -- 172.21.15.69:0/2486123104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140095f0 con 0x7fd724105f70 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd728c4d700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724103650 0x7fd7240fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd729c4f700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724105f70 0x7fd7240ff220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00efc0 tx=0x7fd71c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.895+0000 7fd71a7fc700 1 -- 172.21.15.69:0/2486123104 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c018070 con 0x7fd724105f70 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.896+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72410bac0 con 0x7fd724105f70 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.896+0000 7fd71a7fc700 1 -- 172.21.15.69:0/2486123104 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd71c00f040 con 0x7fd724105f70 2023-12-14T18:25:52.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.896+0000 7fd71a7fc700 1 -- 172.21.15.69:0/2486123104 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c00cc50 con 0x7fd724105f70 2023-12-14T18:25:52.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.896+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72410b930 con 0x7fd724105f70 2023-12-14T18:25:52.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.898+0000 7fd71a7fc700 1 -- 172.21.15.69:0/2486123104 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd71c003a00 con 0x7fd724105f70 2023-12-14T18:25:52.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.899+0000 7fd71a7fc700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd7100a1150 0x7fd7100a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.899+0000 7fd72944e700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd7100a1150 0x7fd7100a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.899+0000 7fd71a7fc700 1 -- 172.21.15.69:0/2486123104 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd71c0cc4b0 con 0x7fd724105f70 2023-12-14T18:25:52.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd72944e700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd7100a1150 0x7fd7100a3600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd720005950 tx=0x7fd720004080 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 Processor -- start 2023-12-14T18:25:52.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 -- start start 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf979910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 0x5650bf97a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf97b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf8625e0 con 0x5650bf97ad00 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf8d1870 con 0x5650bf979500 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd737840b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf8cad00 con 0x5650bf979e50 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 0x5650bf97a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 0x5650bf97a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:51556/0 (socket says 172.21.15.69:51556) 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd729c4f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf97b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd728c4d700 1 -- 172.21.15.69:0/555022485 learned_addr learned my addr 172.21.15.69:0/555022485 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.900+0000 7fd72944e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf979910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd728c4d700 1 -- 172.21.15.69:0/555022485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 msgr2=0x5650bf979910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd728c4d700 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf979910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd728c4d700 1 -- 172.21.15.69:0/555022485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 msgr2=0x5650bf97b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd728c4d700 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf97b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd728c4d700 1 -- 172.21.15.69:0/555022485 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650bf74c3b0 con 0x5650bf979e50 2023-12-14T18:25:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd72944e700 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf979910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd729c4f700 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf97b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd728c4d700 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 0x5650bf97a770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd71400b2e0 tx=0x7fd714005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47df49a20974f70 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd70f7fe700 1 -- 172.21.15.69:0/555022485 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71401d050 con 0x5650bf979e50 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.901+0000 7fd70f7fe700 1 -- 172.21.15.69:0/555022485 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd71401e040 con 0x5650bf979e50 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd70f7fe700 1 -- 172.21.15.69:0/555022485 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714005290 con 0x5650bf979e50 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 -- 172.21.15.69:0/555022485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 msgr2=0x5650bf97a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 0x5650bf97a770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd71400b2e0 tx=0x7fd714005f00 comp rx=0 tx=0).stop 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 -- 172.21.15.69:0/555022485 shutdown_connections 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf97b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf979910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 --2- 172.21.15.69:0/555022485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf979e50 0x5650bf97a770 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd71400b2e0 tx=0x7fd714005f00 comp rx=0 tx=0).stop 2023-12-14T18:25:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.902+0000 7fd737840b80 1 -- 172.21.15.69:0/555022485 >> 172.21.15.69:0/555022485 conn(0x5650bf96eca0 msgr2=0x5650bf974430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.903+0000 7fd737840b80 1 -- 172.21.15.69:0/555022485 shutdown_connections 2023-12-14T18:25:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.903+0000 7fd737840b80 1 -- 172.21.15.69:0/555022485 wait complete. 2023-12-14T18:25:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.903+0000 7fd737840b80 1 -- start start 2023-12-14T18:25:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.903+0000 7fd737840b80 1 Processor -- start 2023-12-14T18:25:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 0x5650bf983350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 0x5650bf983890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf98aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf866f90 con 0x5650bf979500 2023-12-14T18:25:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf866c30 con 0x5650bf97ad00 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf74e6a0 con 0x5650bf9888c0 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd737840b80 10 client.0 _ll_register_callbacks cb 0x5650bf88a910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 0x5650bf983890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 0x5650bf983350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 0x5650bf983890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46738/0 (socket says 172.21.15.69:46738) 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd728c4d700 1 -- 172.21.15.69:0/2202112386 learned_addr learned my addr 172.21.15.69:0/2202112386 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 0x5650bf983350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49918/0 (socket says 172.21.15.69:49918) 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd729c4f700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf98aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 -- 172.21.15.69:0/2202112386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 msgr2=0x5650bf98aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf98aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 -- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 msgr2=0x5650bf983890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 0x5650bf983890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd72944e700 1 -- 172.21.15.69:0/2202112386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd724108f60 con 0x5650bf979500 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.904+0000 7fd728c4d700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 0x5650bf983890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd72944e700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 0x5650bf983350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd720004400 tx=0x7fd720004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a4e21b4f5dd196 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd70cff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd70cff9700 1 -- 172.21.15.69:0/2202112386 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72001f630 con 0x5650bf979500 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd70cff9700 1 -- 172.21.15.69:0/2202112386 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd720011e40 con 0x5650bf979500 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650bf96c2b0 con 0x5650bf979500 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd70cff9700 1 -- 172.21.15.69:0/2202112386 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7200036a0 con 0x5650bf979500 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd737840b80 10 client.15591 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.905+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5650bf891170 con 0x5650bf979500 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd70cff9700 1 -- 172.21.15.69:0/2202112386 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5650bf96c2b0 con 0x5650bf979500 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd70cff9700 1 -- 172.21.15.69:0/2202112386 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd720031070 con 0x5650bf979500 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd737840b80 10 client.15591 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd737840b80 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd737840b80 20 client.15591 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd737840b80 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf98f610 0x5650bf991a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd737840b80 4 client.15591 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650bf8c3ce0 con 0x5650bf98f610 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.906+0000 7fd728c4d700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf98f610 0x5650bf991a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.907+0000 7fd728c4d700 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf98f610 0x5650bf991a20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7fc94e64f3775fc server_cookie=31ea4799509105 in_seq=0 out_seq=0 2023-12-14T18:25:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.907+0000 7fd70cff9700 10 client.15591 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.909+0000 7fd70cff9700 1 -- 172.21.15.69:0/2202112386 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5650bf8c3ce0 con 0x5650bf98f610 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.909+0000 7fd70cff9700 10 client.15591 handle_command_reply: tid=0 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.909+0000 7fd737840b80 1 client.15591 shutdown 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 msgr2=0x5650bf983350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 0x5650bf983350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd720004400 tx=0x7fd720004750 comp rx=0 tx=0).stop 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 shutdown_connections 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf98f610 0x5650bf991a20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf98aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf979500 0x5650bf983350 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 --2- 172.21.15.69:0/2202112386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf97ad00 0x5650bf983890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 >> 172.21.15.69:0/2202112386 conn(0x5650bf96eca0 msgr2=0x5650bf9739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd70cff9700 0 client.15591 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 shutdown_connections 2023-12-14T18:25:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 1 -- 172.21.15.69:0/2202112386 wait complete. 2023-12-14T18:25:52.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.910+0000 7fd737840b80 20 client.15591 trim_cache size 0 max 16384 2023-12-14T18:25:52.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 Processor -- start 2023-12-14T18:25:52.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 -- start start 2023-12-14T18:25:52.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf97ad00 0x5650bf981220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf9888c0 0x5650bf97a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf975690 con 0x5650bf9888c0 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf980fd0 con 0x5650bf979500 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.925+0000 7fd737840b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf979100 con 0x5650bf97ad00 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46746/0 (socket says 172.21.15.69:46746) 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 -- 172.21.15.69:0/3530390374 learned_addr learned my addr 172.21.15.69:0/3530390374 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd728c4d700 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf97ad00 0x5650bf981220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd729c4f700 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf9888c0 0x5650bf97a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 -- 172.21.15.69:0/3530390374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf97ad00 msgr2=0x5650bf981220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf97ad00 0x5650bf981220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 -- 172.21.15.69:0/3530390374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf9888c0 msgr2=0x5650bf97a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf9888c0 0x5650bf97a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 -- 172.21.15.69:0/3530390374 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650bf890ec0 con 0x5650bf979500 2023-12-14T18:25:52.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.926+0000 7fd72944e700 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99f2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd720005bf0 tx=0x7fd72000ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c085389bd427bb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.927+0000 7fd70ffff700 1 -- 172.21.15.69:0/3530390374 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720028420 con 0x5650bf979500 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.927+0000 7fd70ffff700 1 -- 172.21.15.69:0/3530390374 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd72002e070 con 0x5650bf979500 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.927+0000 7fd70ffff700 1 -- 172.21.15.69:0/3530390374 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720033b00 con 0x5650bf979500 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 -- 172.21.15.69:0/3530390374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 msgr2=0x5650bf99f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99f2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd720005bf0 tx=0x7fd72000ff20 comp rx=0 tx=0).stop 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 -- 172.21.15.69:0/3530390374 shutdown_connections 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf9888c0 0x5650bf97a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99f2a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 --2- 172.21.15.69:0/3530390374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf97ad00 0x5650bf981220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 -- 172.21.15.69:0/3530390374 >> 172.21.15.69:0/3530390374 conn(0x5650bf96eca0 msgr2=0x5650bf996380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 -- 172.21.15.69:0/3530390374 shutdown_connections 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 -- 172.21.15.69:0/3530390374 wait complete. 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 -- start start 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.928+0000 7fd737840b80 1 Processor -- start 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf99ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf9e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf9e21b0 con 0x5650bf97ad00 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf9e2320 con 0x5650bf979500 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bf9e24e0 con 0x5650bf9888c0 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd737840b80 10 client.0 _ll_register_callbacks cb 0x7fd72000f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf99ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf9e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd728c4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf99ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49936/0 (socket says 172.21.15.69:49936) 2023-12-14T18:25:52.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd728c4d700 1 -- 172.21.15.69:0/3682194362 learned_addr learned my addr 172.21.15.69:0/3682194362 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd72944e700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 -- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 msgr2=0x5650bf99e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 -- 172.21.15.69:0/3682194362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 msgr2=0x5650bf99ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf99ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 -- 172.21.15.69:0/3682194362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650bf891170 con 0x5650bf9888c0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd72944e700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd729c4f700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf9e1c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00ef90 tx=0x7fd71c00ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=822e84066f038ccf server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.929+0000 7fd70cff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd70cff9700 1 -- 172.21.15.69:0/3682194362 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c099dc0 con 0x5650bf9888c0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd70cff9700 1 -- 172.21.15.69:0/3682194362 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd71c099960 con 0x5650bf9888c0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd71401e040 con 0x5650bf9888c0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd70cff9700 1 -- 172.21.15.69:0/3682194362 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd71c09d990 con 0x5650bf9888c0 2023-12-14T18:25:52.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 10 client.25108 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5650bf8779a0 con 0x5650bf9888c0 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd70cff9700 1 -- 172.21.15.69:0/3682194362 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd71401e040 con 0x5650bf9888c0 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd70cff9700 1 -- 172.21.15.69:0/3682194362 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd71c0b3020 con 0x5650bf9888c0 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 10 client.25108 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 10 client.25108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 20 client.25108 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf9e3dd0 0x5650bf9e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 4 client.25108 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5650bf8c3a00 con 0x5650bf9e3dd0 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.930+0000 7fd72944e700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf9e3dd0 0x5650bf9e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.931+0000 7fd70cff9700 10 client.25108 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:52.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.931+0000 7fd72944e700 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf9e3dd0 0x5650bf9e61e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33ee7afa0bde32d5 server_cookie=6d55ae5af2feafb3 in_seq=0 out_seq=0 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd70cff9700 1 -- 172.21.15.69:0/3682194362 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5650bf8c3a00 con 0x5650bf9e3dd0 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd70cff9700 10 client.25108 handle_command_reply: tid=0 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 client.25108 shutdown 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 msgr2=0x5650bf9e1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf9e1c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00ef90 tx=0x7fd71c00ce70 comp rx=0 tx=0).stop 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 shutdown_connections 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5650bf9e3dd0 0x5650bf9e61e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650bf9888c0 0x5650bf9e1c40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650bf979500 0x5650bf99e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd70cff9700 0 client.25108 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 --2- 172.21.15.69:0/3682194362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650bf97ad00 0x5650bf99ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 >> 172.21.15.69:0/3682194362 conn(0x5650bf96eca0 msgr2=0x5650bf981220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 shutdown_connections 2023-12-14T18:25:52.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 1 -- 172.21.15.69:0/3682194362 wait complete. 2023-12-14T18:25:52.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.934+0000 7fd737840b80 20 client.25108 trim_cache size 0 max 16384 2023-12-14T18:25:52.939 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd7100a1150 msgr2=0x7fd7100a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd7100a1150 0x7fd7100a3600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd720005950 tx=0x7fd720004080 comp rx=0 tx=0).stop 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724105f70 msgr2=0x7fd7240ff220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724105f70 0x7fd7240ff220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00efc0 tx=0x7fd71c00c3a0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 shutdown_connections 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fd7100a1150 0x7fd7100a3600 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd724105f70 0x7fd7240ff220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd724100d30 0x7fd7241006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 --2- 172.21.15.69:0/2486123104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd724103650 0x7fd7240fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 >> 172.21.15.69:0/2486123104 conn(0x7fd7240fa770 msgr2=0x7fd7241019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:52.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 shutdown_connections 2023-12-14T18:25:52.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:52.935+0000 7fd72b6b2700 1 -- 172.21.15.69:0/2486123104 wait complete. 2023-12-14T18:25:53.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:53 smithi069 ceph-mon[42047]: pgmap v294: 97 pgs: 97 active+clean; 41 MiB data, 204 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 69 op/s 2023-12-14T18:25:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:53 smithi119 ceph-mon[43973]: pgmap v294: 97 pgs: 97 active+clean; 41 MiB data, 204 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 69 op/s 2023-12-14T18:25:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:53 smithi091 ceph-mon[43601]: pgmap v294: 97 pgs: 97 active+clean; 41 MiB data, 204 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 69 op/s 2023-12-14T18:25:53.951 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T18:25:53.952 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 -- 172.21.15.69:0/1340676727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6928100340 msgr2=0x7f6928100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 --2- 172.21.15.69:0/1340676727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6928100340 0x7f6928100790 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6918009990 tx=0x7f6918009ca0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 -- 172.21.15.69:0/1340676727 shutdown_connections 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 --2- 172.21.15.69:0/1340676727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100cd0 0x7f6928107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 --2- 172.21.15.69:0/1340676727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69280ff150 0x7f69280ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 --2- 172.21.15.69:0/1340676727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6928100340 0x7f6928100790 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 -- 172.21.15.69:0/1340676727 >> 172.21.15.69:0/1340676727 conn(0x7f69280fa770 msgr2=0x7f69280fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 -- 172.21.15.69:0/1340676727 shutdown_connections 2023-12-14T18:25:54.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 -- 172.21.15.69:0/1340676727 wait complete. 2023-12-14T18:25:54.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 Processor -- start 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.084+0000 7f69300b2700 1 -- start start 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 0x7f6928198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100340 0x7f6928198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928100cd0 0x7f692819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692819fcc0 con 0x7f69280ff150 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692819fe00 con 0x7f6928100340 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692819ff90 con 0x7f6928100cd0 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 0x7f6928198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 0x7f6928198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49958/0 (socket says 172.21.15.69:49958) 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 -- 172.21.15.69:0/1672689214 learned_addr learned my addr 172.21.15.69:0/1672689214 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692d64d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100340 0x7f6928198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692e64f700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928100cd0 0x7f692819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 -- 172.21.15.69:0/1672689214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928100cd0 msgr2=0x7f692819f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928100cd0 0x7f692819f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 -- 172.21.15.69:0/1672689214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100340 msgr2=0x7f6928198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100340 0x7f6928198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 -- 172.21.15.69:0/1672689214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692000be50 con 0x7f69280ff150 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692d64d700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100340 0x7f6928198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f692de4e700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 0x7f6928198140 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f692400d980 tx=0x7f692400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f691effd700 1 -- 172.21.15.69:0/1672689214 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924004020 con 0x7f69280ff150 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f691effd700 1 -- 172.21.15.69:0/1672689214 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f692400f690 con 0x7f69280ff150 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69180095f0 con 0x7f69280ff150 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f691effd700 1 -- 172.21.15.69:0/1672689214 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240039e0 con 0x7f69280ff150 2023-12-14T18:25:54.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.085+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6928109980 con 0x7f69280ff150 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.088+0000 7f691effd700 1 -- 172.21.15.69:0/1672689214 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f692400f800 con 0x7f69280ff150 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.088+0000 7f691effd700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f69140a1150 0x7f69140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.089+0000 7f692d64d700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f69140a1150 0x7f69140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.089+0000 7f691effd700 1 -- 172.21.15.69:0/1672689214 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f69240cc4f0 con 0x7f69280ff150 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.089+0000 7f692d64d700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f69140a1150 0x7f69140a3600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6918006010 tx=0x7f691800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.089+0000 7f693c240b80 1 Processor -- start 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.089+0000 7f693c240b80 1 -- start start 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f693c240b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 0x55a9750ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f693c240b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eded0 0x55a9750ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f693c240b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eed80 0x55a9750ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f693c240b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a974fd6660 con 0x55a9750eded0 2023-12-14T18:25:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f693c240b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750458f0 con 0x55a9750ed580 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f693c240b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97503ed80 con 0x55a9750eed80 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692d64d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eded0 0x55a9750ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 0x55a9750ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 0x55a9750ed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46782/0 (socket says 172.21.15.69:46782) 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692d64d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eded0 0x55a9750ee7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49964/0 (socket says 172.21.15.69:49964) 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 -- 172.21.15.69:0/2429609298 learned_addr learned my addr 172.21.15.69:0/2429609298 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692e64f700 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eed80 0x55a9750ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 -- 172.21.15.69:0/2429609298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eed80 msgr2=0x55a9750ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eed80 0x55a9750ef1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 -- 172.21.15.69:0/2429609298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eded0 msgr2=0x55a9750ee7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eded0 0x55a9750ee7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 -- 172.21.15.69:0/2429609298 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a974ec0430 con 0x55a9750ed580 2023-12-14T18:25:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f692de4e700 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 0x55a9750ed990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6924095e10 tx=0x7f69240994a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=862371a2e9679741 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.090+0000 7f6913fff700 1 -- 172.21.15.69:0/2429609298 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400fb60 con 0x55a9750ed580 2023-12-14T18:25:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f6913fff700 1 -- 172.21.15.69:0/2429609298 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6924099910 con 0x55a9750ed580 2023-12-14T18:25:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f6913fff700 1 -- 172.21.15.69:0/2429609298 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924099b70 con 0x55a9750ed580 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 -- 172.21.15.69:0/2429609298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 msgr2=0x55a9750ed990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 0x55a9750ed990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6924095e10 tx=0x7f69240994a0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 -- 172.21.15.69:0/2429609298 shutdown_connections 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eed80 0x55a9750ef1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750ed580 0x55a9750ed990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 --2- 172.21.15.69:0/2429609298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eded0 0x55a9750ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.091+0000 7f693c240b80 1 -- 172.21.15.69:0/2429609298 >> 172.21.15.69:0/2429609298 conn(0x55a9750e2d20 msgr2=0x55a9750e84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 -- 172.21.15.69:0/2429609298 shutdown_connections 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 -- 172.21.15.69:0/2429609298 wait complete. 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 -- start start 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 Processor -- start 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 0x55a9750f7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eded0 0x55a9750f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eed80 0x55a9750fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a974fdb010 con 0x55a9750eed80 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a974fdacb0 con 0x55a9750eded0 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a974ec2720 con 0x55a9750ed580 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.092+0000 7f693c240b80 10 client.0 _ll_register_callbacks cb 0x55a974ffe990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 0x55a9750f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 0x55a9750f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:51630/0 (socket says 172.21.15.69:51630) 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 -- 172.21.15.69:0/189146256 learned_addr learned my addr 172.21.15.69:0/189146256 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692e64f700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eed80 0x55a9750fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692d64d700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eded0 0x55a9750f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 -- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eded0 msgr2=0x55a9750f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eded0 0x55a9750f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 -- 172.21.15.69:0/189146256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eed80 msgr2=0x55a9750fe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eed80 0x55a9750fe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 -- 172.21.15.69:0/189146256 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6924084040 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692d64d700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eded0 0x55a9750f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f692de4e700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 0x55a9750f7270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f692400d950 tx=0x7f6924097d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fa9ea8ada2b21a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f69117fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f69117fa700 1 -- 172.21.15.69:0/189146256 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240cc390 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f69117fa700 1 -- 172.21.15.69:0/189146256 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f69240a1d60 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.093+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9750e0330 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f69117fa700 1 -- 172.21.15.69:0/189146256 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6924099000 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 10 client.25120 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a9750051f0 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f69117fa700 1 -- 172.21.15.69:0/189146256 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a9750e0330 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f69117fa700 1 -- 172.21.15.69:0/189146256 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f69240239d0 con 0x55a9750ed580 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 10 client.25120 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 10 client.25120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 20 client.25120 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975102cc0 0x55a9751050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 4 client.25120 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a975037d60 con 0x55a975102cc0 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.094+0000 7f692d64d700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975102cc0 0x55a9751050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.095+0000 7f69117fa700 10 client.25120 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.095+0000 7f692d64d700 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975102cc0 0x55a9751050d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22fe96f6e4d86df2 server_cookie=b54cde23bde76991 in_seq=0 out_seq=0 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f69117fa700 1 -- 172.21.15.69:0/189146256 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a975037d60 con 0x55a975102cc0 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f69117fa700 10 client.25120 handle_command_reply: tid=0 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 client.25120 shutdown 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 msgr2=0x55a9750f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 0x55a9750f7270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f692400d950 tx=0x7f6924097d20 comp rx=0 tx=0).stop 2023-12-14T18:25:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 shutdown_connections 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975102cc0 0x55a9751050d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750eed80 0x55a9750fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750ed580 0x55a9750f7270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 --2- 172.21.15.69:0/189146256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eded0 0x55a9750f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f69117fa700 0 client.25120 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 >> 172.21.15.69:0/189146256 conn(0x55a9750e2d20 msgr2=0x55a9750e6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 shutdown_connections 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 1 -- 172.21.15.69:0/189146256 wait complete. 2023-12-14T18:25:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.096+0000 7f693c240b80 20 client.25120 trim_cache size 0 max 16384 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.117+0000 7f693c240b80 1 Processor -- start 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.117+0000 7f693c240b80 1 -- start start 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f693c240b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f693c240b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f693c240b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f693c240b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750e9590 con 0x55a9750ed580 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f693c240b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750f83f0 con 0x55a9750eed80 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f693c240b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750ff760 con 0x55a9750eded0 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692de4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692de4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49982/0 (socket says 172.21.15.69:49982) 2023-12-14T18:25:54.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692de4e700 1 -- 172.21.15.69:0/323864199 learned_addr learned my addr 172.21.15.69:0/323864199 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692e64f700 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 -- 172.21.15.69:0/323864199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 msgr2=0x55a9750f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 -- 172.21.15.69:0/323864199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 msgr2=0x55a9750f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 -- 172.21.15.69:0/323864199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9750ef420 con 0x55a9750eded0 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692de4e700 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.118+0000 7f692d64d700 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c00 tx=0x7f6918023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=340fa8b38fdb5716 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f691cff9700 1 -- 172.21.15.69:0/323864199 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691802d030 con 0x55a9750eded0 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f691cff9700 1 -- 172.21.15.69:0/323864199 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691802e040 con 0x55a9750eded0 2023-12-14T18:25:54.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f691cff9700 1 -- 172.21.15.69:0/323864199 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800f840 con 0x55a9750eded0 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 -- 172.21.15.69:0/323864199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 msgr2=0x55a9750fe7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c00 tx=0x7f6918023000 comp rx=0 tx=0).stop 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 -- 172.21.15.69:0/323864199 shutdown_connections 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 --2- 172.21.15.69:0/323864199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.119+0000 7f693c240b80 1 -- 172.21.15.69:0/323864199 >> 172.21.15.69:0/323864199 conn(0x55a9750e2d20 msgr2=0x55a9750e7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 -- 172.21.15.69:0/323864199 shutdown_connections 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 -- 172.21.15.69:0/323864199 wait complete. 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 -- start start 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 Processor -- start 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750fae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750fb4f0 con 0x55a9750ed580 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750fb660 con 0x55a9750eed80 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9750fb820 con 0x55a9750eded0 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f693c240b80 10 client.0 _ll_register_callbacks cb 0x7f6924099770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f692de4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f692e64f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f692de4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49994/0 (socket says 172.21.15.69:49994) 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f692de4e700 1 -- 172.21.15.69:0/3731242982 learned_addr learned my addr 172.21.15.69:0/3731242982 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.120+0000 7f692d64d700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692e64f700 1 -- 172.21.15.69:0/3731242982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 msgr2=0x55a9750fe7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692e64f700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692e64f700 1 -- 172.21.15.69:0/3731242982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 msgr2=0x55a9750fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692e64f700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692e64f700 1 -- 172.21.15.69:0/3731242982 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9750051f0 con 0x55a9750eed80 2023-12-14T18:25:54.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692de4e700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f692e64f700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750fae10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55a9750e9e00 tx=0x7f6920009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bad2e5bfec8c839 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f69117fa700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f69117fa700 1 -- 172.21.15.69:0/3731242982 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692001d070 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6924099910 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f69117fa700 1 -- 172.21.15.69:0/3731242982 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6920004bb0 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f69117fa700 1 -- 172.21.15.69:0/3731242982 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6920010040 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f693c240b80 10 client.25196 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.121+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f6928107ec0 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f69117fa700 1 -- 172.21.15.69:0/3731242982 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6924099910 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f69117fa700 1 -- 172.21.15.69:0/3731242982 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f69200219f0 con 0x55a9750eed80 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f693c240b80 10 client.25196 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f693c240b80 10 client.25196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f693c240b80 20 client.25196 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:54.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f693c240b80 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975158400 0x55a97515a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f693c240b80 4 client.25196 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T18:25:54.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a975037a80 con 0x55a975158400 2023-12-14T18:25:54.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f692de4e700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975158400 0x55a97515a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f692de4e700 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975158400 0x55a97515a810 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e71619351bd867 server_cookie=ab00ff39f0e7315d in_seq=0 out_seq=0 2023-12-14T18:25:54.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.122+0000 7f69117fa700 10 client.25196 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69117fa700 1 -- 172.21.15.69:0/3731242982 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a975037a80 con 0x55a975158400 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69117fa700 10 client.25196 handle_command_reply: tid=0 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 client.25196 shutdown 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 msgr2=0x55a9750fae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750fae10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55a9750e9e00 tx=0x7f6920009ec0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 shutdown_connections 2023-12-14T18:25:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55a975158400 0x55a97515a810 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55a9750eed80 0x55a9750fae10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a9750ed580 0x55a9750fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 --2- 172.21.15.69:0/3731242982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9750eded0 0x55a9750fe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69117fa700 0 client.25196 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 >> 172.21.15.69:0/3731242982 conn(0x55a9750e2d20 msgr2=0x55a9750f51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 shutdown_connections 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 1 -- 172.21.15.69:0/3731242982 wait complete. 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f693c240b80 20 client.25196 trim_cache size 0 max 16384 2023-12-14T18:25:54.433 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:25:54.434 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T18:25:54.434 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:25:54.434 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T18:25:54.434 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:25:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f69140a1150 msgr2=0x7f69140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f69140a1150 0x7f69140a3600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6918006010 tx=0x7f691800b260 comp rx=0 tx=0).stop 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 msgr2=0x7f6928198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 0x7f6928198140 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f692400d980 tx=0x7f692400dc90 comp rx=0 tx=0).stop 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 shutdown_connections 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f69140a1150 0x7f69140a3600 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6928100cd0 0x7f692819f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69280ff150 0x7f6928198140 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 --2- 172.21.15.69:0/1672689214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6928100340 0x7f6928198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 >> 172.21.15.69:0/1672689214 conn(0x7f69280fa770 msgr2=0x7f69280fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 shutdown_connections 2023-12-14T18:25:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.430+0000 7f69300b2700 1 -- 172.21.15.69:0/1672689214 wait complete. 2023-12-14T18:25:54.444 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:25:54.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 -- 172.21.15.69:0/70931362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8105f40 msgr2=0x7f77e8108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 --2- 172.21.15.69:0/70931362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8105f40 0x7f77e8108340 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f77e000b0a0 tx=0x7f77e000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 -- 172.21.15.69:0/70931362 shutdown_connections 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 --2- 172.21.15.69:0/70931362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8105f40 0x7f77e8108340 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 --2- 172.21.15.69:0/70931362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8100d00 0x7f77e81030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 --2- 172.21.15.69:0/70931362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77e8103620 0x7f77e8105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 -- 172.21.15.69:0/70931362 >> 172.21.15.69:0/70931362 conn(0x7f77e80fa740 msgr2=0x7f77e80fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 -- 172.21.15.69:0/70931362 shutdown_connections 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.574+0000 7f77efd25700 1 -- 172.21.15.69:0/70931362 wait complete. 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 Processor -- start 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 -- start start 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 0x7f77e8195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77e8103620 0x7f77e8196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8105f40 0x7f77e819d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e819db40 con 0x7f77e8100d00 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e819dc80 con 0x7f77e8105f40 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77efd25700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e819de10 con 0x7f77e8103620 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 0x7f77e8195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 0x7f77e8195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50018/0 (socket says 172.21.15.69:50018) 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 -- 172.21.15.69:0/600134156 learned_addr learned my addr 172.21.15.69:0/600134156 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8105f40 0x7f77e819d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77e8103620 0x7f77e8196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 -- 172.21.15.69:0/600134156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77e8103620 msgr2=0x7f77e8196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77e8103620 0x7f77e8196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 -- 172.21.15.69:0/600134156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8105f40 msgr2=0x7f77e819d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8105f40 0x7f77e819d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77edac1700 1 -- 172.21.15.69:0/600134156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0009d00 con 0x7f77e8100d00 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.575+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8105f40 0x7f77e819d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:54.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.576+0000 7f77edac1700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 0x7f77e8195fc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9a0 tx=0x7f77e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.576+0000 7f77deffd700 1 -- 172.21.15.69:0/600134156 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4009790 con 0x7f77e8100d00 2023-12-14T18:25:54.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.576+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e810ba40 con 0x7f77e8100d00 2023-12-14T18:25:54.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.576+0000 7f77deffd700 1 -- 172.21.15.69:0/600134156 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e4010430 con 0x7f77e8100d00 2023-12-14T18:25:54.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.576+0000 7f77deffd700 1 -- 172.21.15.69:0/600134156 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e400cea0 con 0x7f77e8100d00 2023-12-14T18:25:54.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.576+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e810b8b0 con 0x7f77e8100d00 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.578+0000 7f77deffd700 1 -- 172.21.15.69:0/600134156 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f77e40105a0 con 0x7f77e8100d00 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.579+0000 7f77deffd700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77d40a1150 0x7f77d40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.579+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77d40a1150 0x7f77d40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.579+0000 7f77deffd700 1 -- 172.21.15.69:0/600134156 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77e4014070 con 0x7f77e8100d00 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.579+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77d40a1150 0x7f77d40a3600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77d8005950 tx=0x7f77d800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.579+0000 7f77fbeb3b80 1 Processor -- start 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 -- start start 2023-12-14T18:25:54.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c202d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202de50 0x5603c202e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c202f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c1f165e0 con 0x5603c202d500 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c1f85870 con 0x5603c202de50 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c1f7ed00 con 0x5603c202ed00 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c202d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77ed2c0700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202de50 0x5603c202e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c202d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50024/0 (socket says 172.21.15.69:50024) 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 -- 172.21.15.69:0/1828640376 learned_addr learned my addr 172.21.15.69:0/1828640376 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c202f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 -- 172.21.15.69:0/1828640376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 msgr2=0x5603c202f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c202f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 -- 172.21.15.69:0/1828640376 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202de50 msgr2=0x5603c202e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202de50 0x5603c202e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 -- 172.21.15.69:0/1828640376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603c1e003b0 con 0x5603c202d500 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c202f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202de50 0x5603c202e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.580+0000 7f77edac1700 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c202d910 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f77e4096990 tx=0x7f77e4099900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fc61826edd0c05 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77d3fff700 1 -- 172.21.15.69:0/1828640376 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4099f20 con 0x5603c202d500 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77d3fff700 1 -- 172.21.15.69:0/1828640376 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e409df50 con 0x5603c202d500 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77d3fff700 1 -- 172.21.15.69:0/1828640376 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40a20e0 con 0x5603c202d500 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/1828640376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 msgr2=0x5603c202d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c202d910 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f77e4096990 tx=0x7f77e4099900 comp rx=0 tx=0).stop 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/1828640376 shutdown_connections 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c202f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c202d910 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/1828640376 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202de50 0x5603c202e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/1828640376 >> 172.21.15.69:0/1828640376 conn(0x5603c2022ca0 msgr2=0x5603c2028430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.581+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/1828640376 shutdown_connections 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/1828640376 wait complete. 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 -- start start 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 Processor -- start 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202d500 0x5603c2037160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c20376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c1f1af90 con 0x5603c202de50 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c1f1ac30 con 0x5603c202ed00 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c1e026a0 con 0x5603c202d500 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77fbeb3b80 10 client.0 _ll_register_callbacks cb 0x5603c1f3e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77ed2c0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c20376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77ed2c0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c20376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50034/0 (socket says 172.21.15.69:50034) 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77ed2c0700 1 -- 172.21.15.69:0/4193380108 learned_addr learned my addr 172.21.15.69:0/4193380108 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.582+0000 7f77edac1700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202d500 0x5603c2037160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ed2c0700 1 -- 172.21.15.69:0/4193380108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202d500 msgr2=0x5603c2037160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202d500 0x5603c2037160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ed2c0700 1 -- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 msgr2=0x5603c203e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ed2c0700 1 -- 172.21.15.69:0/4193380108 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e810b8b0 con 0x5603c202de50 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c20376a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f77d80116d0 tx=0x7f77d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5ce7b6a9711060 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77d17fa700 1 -- 172.21.15.69:0/4193380108 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8028470 con 0x5603c202de50 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77d17fa700 1 -- 172.21.15.69:0/4193380108 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77d8017070 con 0x5603c202de50 2023-12-14T18:25:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603c20202b0 con 0x5603c202de50 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77d17fa700 1 -- 172.21.15.69:0/4193380108 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77d802e030 con 0x5603c202de50 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77fbeb3b80 10 client.15627 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5603c1f45170 con 0x5603c202de50 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.583+0000 7f77d17fa700 1 -- 172.21.15.69:0/4193380108 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603c20202b0 con 0x5603c202de50 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77d17fa700 1 -- 172.21.15.69:0/4193380108 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f77d801e4c0 con 0x5603c202de50 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77fbeb3b80 10 client.15627 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77fbeb3b80 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77fbeb3b80 20 client.15627 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2043040 0x5603c2045450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77fbeb3b80 4 client.15627 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603c1f77ce0 con 0x5603c2043040 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77edac1700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2043040 0x5603c2045450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77d17fa700 10 client.15627 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.584+0000 7f77edac1700 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2043040 0x5603c2045450 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a4b27abcf1f977 server_cookie=15de2554ff51a1a7 in_seq=0 out_seq=0 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.586+0000 7f77d17fa700 1 -- 172.21.15.69:0/4193380108 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5603c1f77ce0 con 0x5603c2043040 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.586+0000 7f77d17fa700 10 client.15627 handle_command_reply: tid=0 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.586+0000 7f77fbeb3b80 1 client.15627 shutdown 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.586+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 msgr2=0x5603c20376a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.586+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c20376a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f77d80116d0 tx=0x7f77d80047c0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 shutdown_connections 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2043040 0x5603c2045450 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77d17fa700 0 client.15627 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202d500 0x5603c2037160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4193380108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c20376a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 >> 172.21.15.69:0/4193380108 conn(0x5603c2022ca0 msgr2=0x5603c2026f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 shutdown_connections 2023-12-14T18:25:54.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4193380108 wait complete. 2023-12-14T18:25:54.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.587+0000 7f77fbeb3b80 20 client.15627 trim_cache size 0 max 16384 2023-12-14T18:25:54.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 Processor -- start 2023-12-14T18:25:54.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 -- start start 2023-12-14T18:25:54.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202d500 0x5603c20279d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c203e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c203ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c2040350 con 0x5603c202de50 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c202e470 con 0x5603c202d500 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c2037de0 con 0x5603c202ed00 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c203e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c203e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50048/0 (socket says 172.21.15.69:50048) 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 -- 172.21.15.69:0/3225301569 learned_addr learned my addr 172.21.15.69:0/3225301569 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77edac1700 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202d500 0x5603c20279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c203ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 -- 172.21.15.69:0/3225301569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 msgr2=0x5603c203ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c203ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 -- 172.21.15.69:0/3225301569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202d500 msgr2=0x5603c20279d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202d500 0x5603c20279d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ed2c0700 1 -- 172.21.15.69:0/3225301569 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603c1f44ec0 con 0x5603c202de50 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.605+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c203ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c203e6a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f77d801e470 tx=0x7f77d8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24232726ef32acfe server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77dcff9700 1 -- 172.21.15.69:0/3225301569 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d802e070 con 0x5603c202de50 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77dcff9700 1 -- 172.21.15.69:0/3225301569 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77d8015070 con 0x5603c202de50 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77dcff9700 1 -- 172.21.15.69:0/3225301569 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8005020 con 0x5603c202de50 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/3225301569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 msgr2=0x5603c203e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c203e6a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f77d801e470 tx=0x7f77d8010f40 comp rx=0 tx=0).stop 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/3225301569 shutdown_connections 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202ed00 0x5603c203ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202d500 0x5603c20279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/3225301569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202de50 0x5603c203e6a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/3225301569 >> 172.21.15.69:0/3225301569 conn(0x5603c2022ca0 msgr2=0x5603c2035ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/3225301569 shutdown_connections 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.606+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/3225301569 wait complete. 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 -- start start 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 Processor -- start 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c203a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202de50 0x5603c203ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c203df60 con 0x5603c202d500 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c203e0d0 con 0x5603c202ed00 2023-12-14T18:25:54.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c203e290 con 0x5603c202de50 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77fbeb3b80 10 client.0 _ll_register_callbacks cb 0x7f77d800be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77edac1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c203a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77edac1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c203a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50050/0 (socket says 172.21.15.69:50050) 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77edac1700 1 -- 172.21.15.69:0/4098972163 learned_addr learned my addr 172.21.15.69:0/4098972163 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77ee2c2700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.607+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202de50 0x5603c203ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77edac1700 1 -- 172.21.15.69:0/4098972163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202de50 msgr2=0x5603c203ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77edac1700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202de50 0x5603c203ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77edac1700 1 -- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 msgr2=0x5603c203da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77edac1700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77edac1700 1 -- 172.21.15.69:0/4098972163 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603c1f45170 con 0x5603c202d500 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77edac1700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c203a8d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f77e4099b30 tx=0x7f77e409a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22726d30832fc84 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:25:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77d17fa700 1 -- 172.21.15.69:0/4098972163 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40ca310 con 0x5603c202d500 2023-12-14T18:25:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77d17fa700 1 -- 172.21.15.69:0/4098972163 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77e40ca470 con 0x5603c202d500 2023-12-14T18:25:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77e409df50 con 0x5603c202d500 2023-12-14T18:25:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77d17fa700 1 -- 172.21.15.69:0/4098972163 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77e4065030 con 0x5603c202d500 2023-12-14T18:25:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77fbeb3b80 10 client.15633 fetch_fsmap learned FSMap version 23 2023-12-14T18:25:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.608+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5603c1f2b9a0 con 0x5603c202d500 2023-12-14T18:25:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77d17fa700 1 -- 172.21.15.69:0/4098972163 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e407c070 con 0x5603c202d500 2023-12-14T18:25:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77d17fa700 1 -- 172.21.15.69:0/4098972163 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f77e4094b30 con 0x5603c202d500 2023-12-14T18:25:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77fbeb3b80 10 client.15633 fetch_fsmap finished waiting for FSMap version 23 2023-12-14T18:25:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77fbeb3b80 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:25:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77fbeb3b80 20 client.15633 populate_metadata read hostname 'smithi069' 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2097cd0 0x5603c209a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77fbeb3b80 4 client.15633 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5603c1f77a00 con 0x5603c2097cd0 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2097cd0 0x5603c209a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.609+0000 7f77d17fa700 10 client.15633 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.610+0000 7f77ed2c0700 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2097cd0 0x5603c209a0e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1f04ae766079aa server_cookie=4e831621c63922f6 in_seq=0 out_seq=0 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77d17fa700 1 -- 172.21.15.69:0/4098972163 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5603c1f77a00 con 0x5603c2097cd0 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77d17fa700 10 client.15633 handle_command_reply: tid=0 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 client.15633 shutdown 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 msgr2=0x5603c203a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c203a8d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f77e4099b30 tx=0x7f77e409a460 comp rx=0 tx=0).stop 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 shutdown_connections 2023-12-14T18:25:54.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x5603c2097cd0 0x5603c209a0e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5603c202ed00 0x5603c203da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5603c202d500 0x5603c203a8d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77d17fa700 0 client.15633 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 --2- 172.21.15.69:0/4098972163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603c202de50 0x5603c203ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 >> 172.21.15.69:0/4098972163 conn(0x5603c2022ca0 msgr2=0x5603c20279d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 shutdown_connections 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 1 -- 172.21.15.69:0/4098972163 wait complete. 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.612+0000 7f77fbeb3b80 20 client.15633 trim_cache size 0 max 16384 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (2 inodes in the stack)", 2023-12-14T18:25:54.619 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:25:54.620 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77d40a1150 msgr2=0x7f77d40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77d40a1150 0x7f77d40a3600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77d8005950 tx=0x7f77d800b410 comp rx=0 tx=0).stop 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 msgr2=0x7f77e8195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 0x7f77e8195fc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9a0 tx=0x7f77e400ecb0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 shutdown_connections 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f77d40a1150 0x7f77d40a3600 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77e8105f40 0x7f77e819d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77e8100d00 0x7f77e8195fc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 --2- 172.21.15.69:0/600134156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77e8103620 0x7f77e8196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:25:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 >> 172.21.15.69:0/600134156 conn(0x7f77e80fa740 msgr2=0x7f77e8102140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:25:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 shutdown_connections 2023-12-14T18:25:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:25:54.613+0000 7f77efd25700 1 -- 172.21.15.69:0/600134156 wait complete. 2023-12-14T18:25:54.629 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:25:55.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:55 smithi069 ceph-mon[42047]: pgmap v295: 97 pgs: 97 active+clean; 41 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 56 op/s 2023-12-14T18:25:55.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:55 smithi069 ceph-mon[42047]: scrub queued for path: / 2023-12-14T18:25:55.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:55 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:55.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:55 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:25:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:55 smithi119 ceph-mon[43973]: pgmap v295: 97 pgs: 97 active+clean; 41 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 56 op/s 2023-12-14T18:25:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:55 smithi119 ceph-mon[43973]: scrub queued for path: / 2023-12-14T18:25:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:55 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:55 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:25:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:55 smithi091 ceph-mon[43601]: pgmap v295: 97 pgs: 97 active+clean; 41 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 56 op/s 2023-12-14T18:25:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:55 smithi091 ceph-mon[43601]: scrub queued for path: / 2023-12-14T18:25:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:55 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:55 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:25:57.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:57 smithi069 ceph-mon[42047]: pgmap v296: 97 pgs: 97 active+clean; 48 MiB data, 234 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 25 op/s 2023-12-14T18:25:57.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:57 smithi119 ceph-mon[43973]: pgmap v296: 97 pgs: 97 active+clean; 48 MiB data, 234 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 25 op/s 2023-12-14T18:25:57.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:57 smithi091 ceph-mon[43601]: pgmap v296: 97 pgs: 97 active+clean; 48 MiB data, 234 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 25 op/s 2023-12-14T18:25:58.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:58 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:25:58.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:58 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:58.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:58 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:25:58.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:58 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:58.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:58 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:25:58.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:58 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:59 smithi069 ceph-mon[42047]: pgmap v297: 97 pgs: 97 active+clean; 52 MiB data, 248 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 31 op/s 2023-12-14T18:25:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:59 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:25:59.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:25:59 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:59 smithi119 ceph-mon[43973]: pgmap v297: 97 pgs: 97 active+clean; 52 MiB data, 248 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 31 op/s 2023-12-14T18:25:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:59 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:25:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:25:59 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:25:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:59 smithi091 ceph-mon[43601]: pgmap v297: 97 pgs: 97 active+clean; 52 MiB data, 248 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 31 op/s 2023-12-14T18:25:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:59 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:25:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:25:59 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:26:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:00 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:26:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:00 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:26:00.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:00 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:26:01.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:01 smithi069 ceph-mon[42047]: pgmap v298: 97 pgs: 97 active+clean; 60 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 29 op/s 2023-12-14T18:26:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:01 smithi119 ceph-mon[43973]: pgmap v298: 97 pgs: 97 active+clean; 60 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 29 op/s 2023-12-14T18:26:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:01 smithi091 ceph-mon[43601]: pgmap v298: 97 pgs: 97 active+clean; 60 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 29 op/s 2023-12-14T18:26:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:03 smithi069 ceph-mon[42047]: pgmap v299: 97 pgs: 97 active+clean; 62 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 27 op/s 2023-12-14T18:26:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:03 smithi119 ceph-mon[43973]: pgmap v299: 97 pgs: 97 active+clean; 62 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 27 op/s 2023-12-14T18:26:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:03 smithi091 ceph-mon[43601]: pgmap v299: 97 pgs: 97 active+clean; 62 MiB data, 286 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 27 op/s 2023-12-14T18:26:04.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:04 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:26:04.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:04 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:26:04.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:04 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:26:05.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:05 smithi069 ceph-mon[42047]: pgmap v300: 97 pgs: 97 active+clean; 64 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-12-14T18:26:05.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:05 smithi119 ceph-mon[43973]: pgmap v300: 97 pgs: 97 active+clean; 64 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-12-14T18:26:05.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:05 smithi091 ceph-mon[43601]: pgmap v300: 97 pgs: 97 active+clean; 64 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-12-14T18:26:07.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:07 smithi069 ceph-mon[42047]: pgmap v301: 97 pgs: 97 active+clean; 71 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 31 op/s 2023-12-14T18:26:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:07 smithi119 ceph-mon[43973]: pgmap v301: 97 pgs: 97 active+clean; 71 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 31 op/s 2023-12-14T18:26:07.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:07 smithi091 ceph-mon[43601]: pgmap v301: 97 pgs: 97 active+clean; 71 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 31 op/s 2023-12-14T18:26:09.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:09 smithi069 ceph-mon[42047]: pgmap v302: 97 pgs: 97 active+clean; 74 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-12-14T18:26:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:09 smithi119 ceph-mon[43973]: pgmap v302: 97 pgs: 97 active+clean; 74 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-12-14T18:26:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:09 smithi091 ceph-mon[43601]: pgmap v302: 97 pgs: 97 active+clean; 74 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-12-14T18:26:11.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:11 smithi069 ceph-mon[42047]: pgmap v303: 97 pgs: 97 active+clean; 80 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 25 op/s 2023-12-14T18:26:11.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:11 smithi119 ceph-mon[43973]: pgmap v303: 97 pgs: 97 active+clean; 80 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 25 op/s 2023-12-14T18:26:11.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:11 smithi091 ceph-mon[43601]: pgmap v303: 97 pgs: 97 active+clean; 80 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 25 op/s 2023-12-14T18:26:13.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:13 smithi069 ceph-mon[42047]: pgmap v304: 97 pgs: 97 active+clean; 80 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 21 op/s 2023-12-14T18:26:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:13 smithi119 ceph-mon[43973]: pgmap v304: 97 pgs: 97 active+clean; 80 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 21 op/s 2023-12-14T18:26:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:13 smithi091 ceph-mon[43601]: pgmap v304: 97 pgs: 97 active+clean; 80 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 21 op/s 2023-12-14T18:26:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:15 smithi119 ceph-mon[43973]: pgmap v305: 97 pgs: 97 active+clean; 86 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2023-12-14T18:26:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:15 smithi091 ceph-mon[43601]: pgmap v305: 97 pgs: 97 active+clean; 86 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2023-12-14T18:26:15.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:15 smithi069 ceph-mon[42047]: pgmap v305: 97 pgs: 97 active+clean; 86 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2023-12-14T18:26:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:17 smithi119 ceph-mon[43973]: pgmap v306: 97 pgs: 97 active+clean; 94 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 24 op/s 2023-12-14T18:26:17.889 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:17 smithi091 ceph-mon[43601]: pgmap v306: 97 pgs: 97 active+clean; 94 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 24 op/s 2023-12-14T18:26:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:17 smithi069 ceph-mon[42047]: pgmap v306: 97 pgs: 97 active+clean; 94 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 24 op/s 2023-12-14T18:26:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:19 smithi119 ceph-mon[43973]: pgmap v307: 97 pgs: 97 active+clean; 94 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-12-14T18:26:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:19 smithi091 ceph-mon[43601]: pgmap v307: 97 pgs: 97 active+clean; 94 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-12-14T18:26:19.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:19 smithi069 ceph-mon[42047]: pgmap v307: 97 pgs: 97 active+clean; 94 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-12-14T18:26:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:21 smithi119 ceph-mon[43973]: pgmap v308: 97 pgs: 97 active+clean; 105 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 54 op/s 2023-12-14T18:26:21.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:21 smithi091 ceph-mon[43601]: pgmap v308: 97 pgs: 97 active+clean; 105 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 54 op/s 2023-12-14T18:26:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:21 smithi069 ceph-mon[42047]: pgmap v308: 97 pgs: 97 active+clean; 105 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 54 op/s 2023-12-14T18:26:23.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:23 smithi119 ceph-mon[43973]: pgmap v309: 97 pgs: 97 active+clean; 105 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 62 op/s 2023-12-14T18:26:23.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:23 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:26:23.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:23 smithi091 ceph-mon[43601]: pgmap v309: 97 pgs: 97 active+clean; 105 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 62 op/s 2023-12-14T18:26:23.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:23 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:26:23.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:23 smithi069 ceph-mon[42047]: pgmap v309: 97 pgs: 97 active+clean; 105 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 62 op/s 2023-12-14T18:26:23.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:23 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:26:24.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:26:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.784+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1283959233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d81014a0 msgr2=0x7fa6d81018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.784+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1283959233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d81014a0 0x7fa6d81018f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009990 tx=0x7fa6cc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.784+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1283959233 shutdown_connections 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.784+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1283959233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6d8101e30 0x7fa6d81086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.784+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1283959233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 0x7fa6d80fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.784+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1283959233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d81014a0 0x7fa6d81018f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.785+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1283959233 >> 172.21.15.69:0/1283959233 conn(0x7fa6d80f9ed0 msgr2=0x7fa6d80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.785+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1283959233 shutdown_connections 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.785+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1283959233 wait complete. 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.785+0000 7fa6dddd3700 1 Processor -- start 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.785+0000 7fa6dddd3700 1 -- start start 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6dddd3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 0x7fa6d8195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6dddd3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6d81014a0 0x7fa6d81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6dddd3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 0x7fa6d819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6dddd3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d819db00 con 0x7fa6d8101e30 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6dddd3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d819dc40 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6dddd3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d819ddd0 con 0x7fa6d81014a0 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 0x7fa6d819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 0x7fa6d8195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 0x7fa6d819d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33892/0 (socket says 172.21.15.69:33892) 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d7fff700 1 -- 172.21.15.69:0/1687679562 learned_addr learned my addr 172.21.15.69:0/1687679562 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6d81014a0 0x7fa6d81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 -- 172.21.15.69:0/1687679562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6d81014a0 msgr2=0x7fa6d81964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6d81014a0 0x7fa6d81964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 -- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 msgr2=0x7fa6d819d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 0x7fa6d819d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 -- 172.21.15.69:0/1687679562 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0095f0 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d7fff700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 0x7fa6d819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.786+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 0x7fa6d8195f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800e9c0 tx=0x7fa6c800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.787+0000 7fa6d4ff9700 1 -- 172.21.15.69:0/1687679562 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8004220 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.787+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d810baf0 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.787+0000 7fa6d4ff9700 1 -- 172.21.15.69:0/1687679562 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6c8004380 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.787+0000 7fa6d4ff9700 1 -- 172.21.15.69:0/1687679562 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8003b40 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.787+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d810b960 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.789+0000 7fa6d4ff9700 1 -- 172.21.15.69:0/1687679562 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa6c8003ca0 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6d4ff9700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa6c00a1150 0x7fa6c00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 Processor -- start 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6d4ff9700 1 -- 172.21.15.69:0/1687679562 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa6c8014070 con 0x7fa6d80fe4d0 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 -- start start 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa6c00a1150 0x7fa6c00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4d5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4d69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b3b55e0 con 0x56243b4d6560 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b424870 con 0x56243b4cc500 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.790+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b41dd00 con 0x56243b4cce50 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:52162/0 (socket says 172.21.15.69:52162) 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 -- 172.21.15.69:0/2952686385 learned_addr learned my addr 172.21.15.69:0/2952686385 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4d5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 -- 172.21.15.69:0/2952686385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 msgr2=0x56243b4d5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4d5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 -- 172.21.15.69:0/2952686385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 msgr2=0x56243b4d69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4d69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 -- 172.21.15.69:0/2952686385 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56243b29f3b0 con 0x56243b4cc500 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa6c00a1150 0x7fa6c00a3600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc006010 tx=0x7fa6cc0051c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.791+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4cc910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8099ed0 tx=0x7fa6c8099b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f42b2e00b07039 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6bdffb700 1 -- 172.21.15.69:0/2952686385 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8016330 con 0x56243b4cc500 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6bdffb700 1 -- 172.21.15.69:0/2952686385 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6c8099f40 con 0x56243b4cc500 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6bdffb700 1 -- 172.21.15.69:0/2952686385 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c809a400 con 0x56243b4cc500 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2952686385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 msgr2=0x56243b4cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4cc910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8099ed0 tx=0x7fa6c8099b00 comp rx=0 tx=0).stop 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2952686385 shutdown_connections 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4d69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4cc910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2952686385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4d5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2952686385 >> 172.21.15.69:0/2952686385 conn(0x56243b4c1ca0 msgr2=0x56243b4c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:24.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2952686385 shutdown_connections 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.792+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2952686385 wait complete. 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 -- start start 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 Processor -- start 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cc500 0x56243b4de9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 0x56243b4deee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4d6560 0x56243b4e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b3b9f90 con 0x56243b4cce50 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b3b9c30 con 0x56243b4d6560 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b2a16a0 con 0x56243b4cc500 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6e9f61b80 10 client.0 _ll_register_callbacks cb 0x56243b3dd910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 0x56243b4deee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6d6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 0x56243b4deee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33918/0 (socket says 172.21.15.69:33918) 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.793+0000 7fa6d6ffd700 1 -- 172.21.15.69:0/1552114644 learned_addr learned my addr 172.21.15.69:0/1552114644 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d7fff700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4d6560 0x56243b4e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cc500 0x56243b4de9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d6ffd700 1 -- 172.21.15.69:0/1552114644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cc500 msgr2=0x56243b4de9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cc500 0x56243b4de9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d6ffd700 1 -- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4d6560 msgr2=0x56243b4e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4d6560 0x56243b4e5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d6ffd700 1 -- 172.21.15.69:0/1552114644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d810b960 con 0x56243b4cce50 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cc500 0x56243b4de9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 0x56243b4deee0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009990 tx=0x7fa6cc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827cbbb30c1d2c22 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:26:24.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/1552114644 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc005a00 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/1552114644 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa6cc004500 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56243b4bf2b0 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/1552114644 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6cc0046c0 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6e9f61b80 10 client.15642 fetch_fsmap learned FSMap version 24 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.794+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56243b3e4170 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/1552114644 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56243b4bf2b0 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/1552114644 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 24) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa6cc040070 con 0x56243b4cce50 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6e9f61b80 10 client.15642 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6e9f61b80 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6e9f61b80 20 client.15642 populate_metadata read hostname 'smithi069' 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b4ea720 0x56243b4ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6e9f61b80 4 client.15642 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:26:24.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.795+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56243b416ce0 con 0x56243b4ea720 2023-12-14T18:26:24.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.796+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b4ea720 0x56243b4ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.796+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b4ea720 0x56243b4ecb30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b116d29a5e60b300 server_cookie=ef0cee8737cfcf5d in_seq=0 out_seq=0 2023-12-14T18:26:24.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.796+0000 7fa6b6ffd700 10 client.15642 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:24.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.800+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/1552114644 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56243b416ce0 con 0x56243b4ea720 2023-12-14T18:26:24.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.800+0000 7fa6b6ffd700 10 client.15642 handle_command_reply: tid=0 2023-12-14T18:26:24.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.800+0000 7fa6e9f61b80 1 client.15642 shutdown 2023-12-14T18:26:24.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.800+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 msgr2=0x56243b4deee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.800+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 0x56243b4deee0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009990 tx=0x7fa6cc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 shutdown_connections 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b4ea720 0x56243b4ecb30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4d6560 0x56243b4e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cc500 0x56243b4de9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6b6ffd700 0 client.15642 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/1552114644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4cce50 0x56243b4deee0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 >> 172.21.15.69:0/1552114644 conn(0x56243b4c1ca0 msgr2=0x56243b4c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 shutdown_connections 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/1552114644 wait complete. 2023-12-14T18:26:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.801+0000 7fa6e9f61b80 20 client.15642 trim_cache size 0 max 16384 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.819+0000 7fa6e9f61b80 1 Processor -- start 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 -- start start 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4dc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b4d5d80 con 0x56243b4d6560 2023-12-14T18:26:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b4df620 con 0x56243b4cc500 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b4dc690 con 0x56243b4cce50 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4dc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4dc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33934/0 (socket says 172.21.15.69:33934) 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 -- 172.21.15.69:0/2473984179 learned_addr learned my addr 172.21.15.69:0/2473984179 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 -- 172.21.15.69:0/2473984179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 msgr2=0x56243b4e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 -- 172.21.15.69:0/2473984179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 msgr2=0x56243b4e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 -- 172.21.15.69:0/2473984179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56243b3e3ec0 con 0x56243b4d6560 2023-12-14T18:26:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.820+0000 7fa6d7fff700 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4dc8e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011600 tx=0x7fa6d0011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f6be5814bece0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.821+0000 7fa6be7fc700 1 -- 172.21.15.69:0/2473984179 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000e040 con 0x56243b4d6560 2023-12-14T18:26:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.821+0000 7fa6be7fc700 1 -- 172.21.15.69:0/2473984179 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6d000f040 con 0x56243b4d6560 2023-12-14T18:26:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.821+0000 7fa6be7fc700 1 -- 172.21.15.69:0/2473984179 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0014ad0 con 0x56243b4d6560 2023-12-14T18:26:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2473984179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 msgr2=0x56243b4dc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4dc8e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011600 tx=0x7fa6d0011910 comp rx=0 tx=0).stop 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2473984179 shutdown_connections 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4dc8e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/2473984179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2473984179 >> 172.21.15.69:0/2473984179 conn(0x56243b4c1ca0 msgr2=0x56243b4dd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2473984179 shutdown_connections 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/2473984179 wait complete. 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 -- start start 2023-12-14T18:26:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.822+0000 7fa6e9f61b80 1 Processor -- start 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b4e29d0 con 0x56243b4d6560 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b4e2b40 con 0x56243b4cc500 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243b4e2d00 con 0x56243b4cce50 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6e9f61b80 10 client.0 _ll_register_callbacks cb 0x7fa6cc003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:52196/0 (socket says 172.21.15.69:52196) 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 -- 172.21.15.69:0/215253557 learned_addr learned my addr 172.21.15.69:0/215253557 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:24.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 -- 172.21.15.69:0/215253557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 msgr2=0x56243b4e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 -- 172.21.15.69:0/215253557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 msgr2=0x56243b4e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4e22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 -- 172.21.15.69:0/215253557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d00112b0 con 0x56243b4cc500 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6d77fe700 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e5850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80ca680 tx=0x7fa6c800e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad63813089e1e890 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.823+0000 7fa6b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/215253557 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80b81e0 con 0x56243b4cc500 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/215253557 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa6c8099430 con 0x56243b4cc500 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6c8099f40 con 0x56243b4cc500 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/215253557 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6c80b8340 con 0x56243b4cc500 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 10 client.25232 fetch_fsmap learned FSMap version 24 2023-12-14T18:26:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56243b3ca9a0 con 0x56243b4cc500 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/215253557 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6c8099f40 con 0x56243b4cc500 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/215253557 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 24) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa6c809a2f0 con 0x56243b4cc500 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 10 client.25232 fetch_fsmap finished waiting for FSMap version 24 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 10 client.25232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 20 client.25232 populate_metadata read hostname 'smithi069' 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b53f9b0 0x56243b541d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 4 client.25232 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.824+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56243b416a00 con 0x56243b53f9b0 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.825+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b53f9b0 0x56243b541d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.825+0000 7fa6d6ffd700 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b53f9b0 0x56243b541d90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd9936ea35bc98 server_cookie=3d4cd54d895d1314 in_seq=0 out_seq=0 2023-12-14T18:26:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.825+0000 7fa6b6ffd700 10 client.25232 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6b6ffd700 1 -- 172.21.15.69:0/215253557 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56243b416a00 con 0x56243b53f9b0 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6b6ffd700 10 client.25232 handle_command_reply: tid=0 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 client.25232 shutdown 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 msgr2=0x56243b4e5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e5850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80ca680 tx=0x7fa6c800e940 comp rx=0 tx=0).stop 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 shutdown_connections 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x56243b53f9b0 0x56243b541d90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56243b4d6560 0x56243b4e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56243b4cc500 0x56243b4e5850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 --2- 172.21.15.69:0/215253557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56243b4cce50 0x56243b4e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 >> 172.21.15.69:0/215253557 conn(0x56243b4c1ca0 msgr2=0x56243b4e6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6b6ffd700 0 client.25232 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 shutdown_connections 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 1 -- 172.21.15.69:0/215253557 wait complete. 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.829+0000 7fa6e9f61b80 20 client.25232 trim_cache size 0 max 16384 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (2 inodes in the stack)", 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:26:24.835 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:26:24.836 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:26:24.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:26:24.836 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:26:24.836 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:26:24.836 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:26:24.836 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa6c00a1150 msgr2=0x7fa6c00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa6c00a1150 0x7fa6c00a3600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc006010 tx=0x7fa6cc0051c0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 msgr2=0x7fa6d8195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 0x7fa6d8195f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800e9c0 tx=0x7fa6c800ecd0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 shutdown_connections 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa6c00a1150 0x7fa6c00a3600 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d8101e30 0x7fa6d819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d80fe4d0 0x7fa6d8195f80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 --2- 172.21.15.69:0/1687679562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6d81014a0 0x7fa6d81964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 >> 172.21.15.69:0/1687679562 conn(0x7fa6d80f9ed0 msgr2=0x7fa6d80fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 shutdown_connections 2023-12-14T18:26:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:24.830+0000 7fa6dddd3700 1 -- 172.21.15.69:0/1687679562 wait complete. 2023-12-14T18:26:24.846 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:26:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:25 smithi119 ceph-mon[43973]: pgmap v310: 97 pgs: 97 active+clean; 112 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 117 op/s 2023-12-14T18:26:25.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:25 smithi091 ceph-mon[43601]: pgmap v310: 97 pgs: 97 active+clean; 112 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 117 op/s 2023-12-14T18:26:25.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:25 smithi069 ceph-mon[42047]: pgmap v310: 97 pgs: 97 active+clean; 112 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 117 op/s 2023-12-14T18:26:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:27 smithi119 ceph-mon[43973]: pgmap v311: 97 pgs: 97 active+clean; 115 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 151 op/s 2023-12-14T18:26:27.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:27 smithi091 ceph-mon[43601]: pgmap v311: 97 pgs: 97 active+clean; 115 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 151 op/s 2023-12-14T18:26:27.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:27 smithi069 ceph-mon[42047]: pgmap v311: 97 pgs: 97 active+clean; 115 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 151 op/s 2023-12-14T18:26:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:28 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:26:28.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:28 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:26:28.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:28 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:26:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:29 smithi119 ceph-mon[43973]: pgmap v312: 97 pgs: 97 active+clean; 121 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 197 op/s 2023-12-14T18:26:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:29 smithi091 ceph-mon[43601]: pgmap v312: 97 pgs: 97 active+clean; 121 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 197 op/s 2023-12-14T18:26:29.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:29 smithi069 ceph-mon[42047]: pgmap v312: 97 pgs: 97 active+clean; 121 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 197 op/s 2023-12-14T18:26:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:31 smithi119 ceph-mon[43973]: pgmap v313: 97 pgs: 97 active+clean; 130 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 252 op/s 2023-12-14T18:26:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:31 smithi091 ceph-mon[43601]: pgmap v313: 97 pgs: 97 active+clean; 130 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 252 op/s 2023-12-14T18:26:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:31 smithi069 ceph-mon[42047]: pgmap v313: 97 pgs: 97 active+clean; 130 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 252 op/s 2023-12-14T18:26:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:26:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:26:32.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:26:32.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:26:32.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:26:32.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:26:32.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:26:32.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:26:32.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:26:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:26:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:26:32.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:26:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:33 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:26:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:33 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:26:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:33 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:26:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:33 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:26:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:33 smithi119 ceph-mon[43973]: pgmap v314: 97 pgs: 97 active+clean; 133 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 239 op/s 2023-12-14T18:26:33.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:33 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:26:33.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:33 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:26:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:33 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:26:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:33 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:26:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:33 smithi091 ceph-mon[43601]: pgmap v314: 97 pgs: 97 active+clean; 133 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 239 op/s 2023-12-14T18:26:33.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:33 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:26:33.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:33 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:26:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:33 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:26:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:33 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:26:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:33 smithi069 ceph-mon[42047]: pgmap v314: 97 pgs: 97 active+clean; 133 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 239 op/s 2023-12-14T18:26:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:35 smithi119 ceph-mon[43973]: pgmap v315: 97 pgs: 97 active+clean; 142 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 277 op/s 2023-12-14T18:26:35.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:35 smithi091 ceph-mon[43601]: pgmap v315: 97 pgs: 97 active+clean; 142 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 277 op/s 2023-12-14T18:26:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:35 smithi069 ceph-mon[42047]: pgmap v315: 97 pgs: 97 active+clean; 142 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 277 op/s 2023-12-14T18:26:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:37 smithi119 ceph-mon[43973]: pgmap v316: 97 pgs: 97 active+clean; 143 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 247 op/s 2023-12-14T18:26:37.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:37 smithi091 ceph-mon[43601]: pgmap v316: 97 pgs: 97 active+clean; 143 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 247 op/s 2023-12-14T18:26:37.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:37 smithi069 ceph-mon[42047]: pgmap v316: 97 pgs: 97 active+clean; 143 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 247 op/s 2023-12-14T18:26:39.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:39 smithi119 ceph-mon[43973]: pgmap v317: 97 pgs: 97 active+clean; 147 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2023-12-14T18:26:39.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:39 smithi091 ceph-mon[43601]: pgmap v317: 97 pgs: 97 active+clean; 147 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2023-12-14T18:26:39.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:39 smithi069 ceph-mon[42047]: pgmap v317: 97 pgs: 97 active+clean; 147 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2023-12-14T18:26:41.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:41 smithi119 ceph-mon[43973]: pgmap v318: 97 pgs: 97 active+clean; 155 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2023-12-14T18:26:41.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:41 smithi091 ceph-mon[43601]: pgmap v318: 97 pgs: 97 active+clean; 155 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2023-12-14T18:26:41.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:41 smithi069 ceph-mon[42047]: pgmap v318: 97 pgs: 97 active+clean; 155 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2023-12-14T18:26:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:43 smithi119 ceph-mon[43973]: pgmap v319: 97 pgs: 97 active+clean; 158 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 172 op/s 2023-12-14T18:26:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:43 smithi091 ceph-mon[43601]: pgmap v319: 97 pgs: 97 active+clean; 158 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 172 op/s 2023-12-14T18:26:43.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:43 smithi069 ceph-mon[42047]: pgmap v319: 97 pgs: 97 active+clean; 158 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 172 op/s 2023-12-14T18:26:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:45 smithi119 ceph-mon[43973]: pgmap v320: 97 pgs: 97 active+clean; 169 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 190 op/s 2023-12-14T18:26:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:45 smithi091 ceph-mon[43601]: pgmap v320: 97 pgs: 97 active+clean; 169 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 190 op/s 2023-12-14T18:26:45.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:45 smithi069 ceph-mon[42047]: pgmap v320: 97 pgs: 97 active+clean; 169 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 190 op/s 2023-12-14T18:26:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:47 smithi119 ceph-mon[43973]: pgmap v321: 97 pgs: 97 active+clean; 170 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 153 op/s 2023-12-14T18:26:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:47 smithi091 ceph-mon[43601]: pgmap v321: 97 pgs: 97 active+clean; 170 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 153 op/s 2023-12-14T18:26:47.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:47 smithi069 ceph-mon[42047]: pgmap v321: 97 pgs: 97 active+clean; 170 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 153 op/s 2023-12-14T18:26:49.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:49 smithi119 ceph-mon[43973]: pgmap v322: 97 pgs: 97 active+clean; 176 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 144 op/s 2023-12-14T18:26:49.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:49 smithi091 ceph-mon[43601]: pgmap v322: 97 pgs: 97 active+clean; 176 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 144 op/s 2023-12-14T18:26:49.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:49 smithi069 ceph-mon[42047]: pgmap v322: 97 pgs: 97 active+clean; 176 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 144 op/s 2023-12-14T18:26:51.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:51 smithi119 ceph-mon[43973]: pgmap v323: 97 pgs: 97 active+clean; 186 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 131 op/s 2023-12-14T18:26:51.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:51 smithi091 ceph-mon[43601]: pgmap v323: 97 pgs: 97 active+clean; 186 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 131 op/s 2023-12-14T18:26:51.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:51 smithi069 ceph-mon[42047]: pgmap v323: 97 pgs: 97 active+clean; 186 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 131 op/s 2023-12-14T18:26:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:53 smithi119 ceph-mon[43973]: pgmap v324: 97 pgs: 97 active+clean; 189 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 100 op/s 2023-12-14T18:26:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:53 smithi091 ceph-mon[43601]: pgmap v324: 97 pgs: 97 active+clean; 189 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 100 op/s 2023-12-14T18:26:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:53 smithi069 ceph-mon[42047]: pgmap v324: 97 pgs: 97 active+clean; 189 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 100 op/s 2023-12-14T18:26:54.847 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:26:54.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 -- 172.21.15.69:0/3568292802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984100230 msgr2=0x7fc984100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 --2- 172.21.15.69:0/3568292802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984100230 0x7fc984100640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc974009990 tx=0x7fc974009ca0 comp rx=0 tx=0).stop 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 -- 172.21.15.69:0/3568292802 shutdown_connections 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 --2- 172.21.15.69:0/3568292802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc984101db0 0x7fc984108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 --2- 172.21.15.69:0/3568292802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984100230 0x7fc984100640 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 --2- 172.21.15.69:0/3568292802 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101420 0x7fc984101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 -- 172.21.15.69:0/3568292802 >> 172.21.15.69:0/3568292802 conn(0x7fc9840fb850 msgr2=0x7fc9840fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 -- 172.21.15.69:0/3568292802 shutdown_connections 2023-12-14T18:26:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 -- 172.21.15.69:0/3568292802 wait complete. 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 Processor -- start 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.988+0000 7fc989997700 1 -- start start 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc989997700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc984100230 0x7fc984195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc989997700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984101420 0x7fc9841964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc989997700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101db0 0x7fc98419d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc989997700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98419dae0 con 0x7fc984101420 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc989997700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98419dc20 con 0x7fc984101db0 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc989997700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98419ddb0 con 0x7fc984100230 2023-12-14T18:26:54.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984101420 0x7fc9841964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984101420 0x7fc9841964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49990/0 (socket says 172.21.15.69:49990) 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101db0 0x7fc98419d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9827fc700 1 -- 172.21.15.69:0/3586078382 learned_addr learned my addr 172.21.15.69:0/3586078382 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc982ffd700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc984100230 0x7fc984195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 -- 172.21.15.69:0/3586078382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc984100230 msgr2=0x7fc984195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc984100230 0x7fc984195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 -- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984101420 msgr2=0x7fc9841964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984101420 0x7fc9841964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 -- 172.21.15.69:0/3586078382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978009520 con 0x7fc984101db0 2023-12-14T18:26:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.989+0000 7fc9837fe700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101db0 0x7fc98419d510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007f10 tx=0x7fc97c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.990+0000 7fc988995700 1 -- 172.21.15.69:0/3586078382 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00ddd0 con 0x7fc984101db0 2023-12-14T18:26:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.990+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9740095f0 con 0x7fc984101db0 2023-12-14T18:26:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.990+0000 7fc988995700 1 -- 172.21.15.69:0/3586078382 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97c00f040 con 0x7fc984101db0 2023-12-14T18:26:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.990+0000 7fc988995700 1 -- 172.21.15.69:0/3586078382 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0059c0 con 0x7fc984101db0 2023-12-14T18:26:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.990+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98410ba50 con 0x7fc984101db0 2023-12-14T18:26:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.993+0000 7fc988995700 1 -- 172.21.15.69:0/3586078382 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc97c005020 con 0x7fc984101db0 2023-12-14T18:26:55.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 Processor -- start 2023-12-14T18:26:55.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc988995700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc96c0a1150 0x7fc96c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 -- start start 2023-12-14T18:26:55.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc988995700 1 -- 172.21.15.69:0/3586078382 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc97c0cc1a0 con 0x7fc984101db0 2023-12-14T18:26:55.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b2089018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b208902770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b208903150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2087ea5e0 con 0x55b2089014b0 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b208859870 con 0x55b208902d00 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc995b25b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b208852d00 con 0x55b208901e00 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b2089018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b2089018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50000/0 (socket says 172.21.15.69:50000) 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 -- 172.21.15.69:0/38682993 learned_addr learned my addr 172.21.15.69:0/38682993 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc9827fc700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc96c0a1150 0x7fc96c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc9837fe700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b208903150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc9827fc700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b208902770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 -- 172.21.15.69:0/38682993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 msgr2=0x55b208902770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b208902770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 -- 172.21.15.69:0/38682993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 msgr2=0x55b208903150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b208903150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc982ffd700 1 -- 172.21.15.69:0/38682993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2086d43b0 con 0x55b2089014b0 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc9837fe700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b208903150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.994+0000 7fc9827fc700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b208902770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.995+0000 7fc982ffd700 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b2089018c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc97400b2e0 tx=0x7fc974005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a46d716588d19cc server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.995+0000 7fc9827fc700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc96c0a1150 0x7fc96c0a3600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55b208902210 tx=0x7fc978009a80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.995+0000 7fc969ffb700 1 -- 172.21.15.69:0/38682993 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740052c0 con 0x55b2089014b0 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.995+0000 7fc969ffb700 1 -- 172.21.15.69:0/38682993 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97401e040 con 0x55b2089014b0 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.995+0000 7fc969ffb700 1 -- 172.21.15.69:0/38682993 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97400b8b0 con 0x55b2089014b0 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- 172.21.15.69:0/38682993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 msgr2=0x55b2089018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b2089018c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc97400b2e0 tx=0x7fc974005c00 comp rx=0 tx=0).stop 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- 172.21.15.69:0/38682993 shutdown_connections 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b208903150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b2089018c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- 172.21.15.69:0/38682993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b208902770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- 172.21.15.69:0/38682993 >> 172.21.15.69:0/38682993 conn(0x55b2088f6ca0 msgr2=0x55b2088fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:55.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- 172.21.15.69:0/38682993 shutdown_connections 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- 172.21.15.69:0/38682993 wait complete. 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- start start 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 Processor -- start 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b20890b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b20890b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b2089126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2087eef90 con 0x55b2089014b0 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2087eec30 con 0x55b208902d00 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.996+0000 7fc995b25b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2086d66a0 con 0x55b208901e00 2023-12-14T18:26:55.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc995b25b80 10 client.0 _ll_register_callbacks cb 0x55b208812910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b20890b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b20890b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50010/0 (socket says 172.21.15.69:50010) 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9827fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b20890b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b2089126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc982ffd700 1 -- 172.21.15.69:0/3936724060 learned_addr learned my addr 172.21.15.69:0/3936724060 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 -- 172.21.15.69:0/3936724060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 msgr2=0x55b20890b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b20890b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 -- 172.21.15.69:0/3936724060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 msgr2=0x55b20890b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b20890b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 -- 172.21.15.69:0/3936724060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984108fa0 con 0x55b208902d00 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc982ffd700 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b20890b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc9837fe700 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b2089126c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0c9cb0 tx=0x7fc97c099460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8df613bbf5cc1c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc962ffd700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc962ffd700 1 -- 172.21.15.69:0/3936724060 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0b90b0 con 0x55b208902d00 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc962ffd700 1 -- 172.21.15.69:0/3936724060 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc97c0052d0 con 0x55b208902d00 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2088f42b0 con 0x55b208902d00 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc962ffd700 1 -- 172.21.15.69:0/3936724060 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc97c009e20 con 0x55b208902d00 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc995b25b80 10 client.25244 fetch_fsmap learned FSMap version 25 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.997+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b208819170 con 0x55b208902d00 2023-12-14T18:26:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc962ffd700 1 -- 172.21.15.69:0/3936724060 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97c0c7080 con 0x55b208902d00 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc962ffd700 1 -- 172.21.15.69:0/3936724060 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc97c09d170 con 0x55b208902d00 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc995b25b80 10 client.25244 fetch_fsmap finished waiting for FSMap version 25 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc995b25b80 10 client.25244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc995b25b80 20 client.25244 populate_metadata read hostname 'smithi069' 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc995b25b80 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20892a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc995b25b80 4 client.25244 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b20884bce0 con 0x55b208927ed0 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc982ffd700 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20892a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc962ffd700 10 client.25244 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.998+0000 7fc982ffd700 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20892a2e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee7f25ca014146d server_cookie=aee0a42080eed377 in_seq=0 out_seq=0 2023-12-14T18:26:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc962ffd700 1 -- 172.21.15.69:0/3936724060 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b20884bce0 con 0x55b208927ed0 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc962ffd700 10 client.25244 handle_command_reply: tid=0 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 client.25244 shutdown 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 msgr2=0x55b2089126c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b2089126c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0c9cb0 tx=0x7fc97c099460 comp rx=0 tx=0).stop 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 shutdown_connections 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20892a2e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b208902d00 0x55b2089126c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc962ffd700 0 client.25244 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b2089014b0 0x55b20890b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 --2- 172.21.15.69:0/3936724060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208901e00 0x55b20890b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 >> 172.21.15.69:0/3936724060 conn(0x55b2088f6ca0 msgr2=0x55b2088faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:55.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 shutdown_connections 2023-12-14T18:26:55.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 1 -- 172.21.15.69:0/3936724060 wait complete. 2023-12-14T18:26:55.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:54.999+0000 7fc995b25b80 20 client.25244 trim_cache size 0 max 16384 2023-12-14T18:26:55.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 Processor -- start 2023-12-14T18:26:55.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 -- start start 2023-12-14T18:26:55.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20892a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b208912680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b20890ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2088fd550 con 0x55b208901e00 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2088f6870 con 0x55b2089014b0 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.018+0000 7fc995b25b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20890a690 con 0x55b208902d00 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20892a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc9827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b208912680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20892a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46792/0 (socket says 172.21.15.69:46792) 2023-12-14T18:26:55.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 -- 172.21.15.69:0/2795845472 learned_addr learned my addr 172.21.15.69:0/2795845472 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 -- 172.21.15.69:0/2795845472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 msgr2=0x55b20890ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b20890ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 -- 172.21.15.69:0/2795845472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 msgr2=0x55b208912680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b208912680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 -- 172.21.15.69:0/2795845472 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b208818ec0 con 0x55b2089014b0 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc982ffd700 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20892a2b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc974009990 tx=0x7fc9740053d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a9c7df625d7cd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc96a7fc700 1 -- 172.21.15.69:0/2795845472 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974032070 con 0x55b2089014b0 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc96a7fc700 1 -- 172.21.15.69:0/2795845472 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc974003680 con 0x55b2089014b0 2023-12-14T18:26:55.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.019+0000 7fc96a7fc700 1 -- 172.21.15.69:0/2795845472 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97400b8f0 con 0x55b2089014b0 2023-12-14T18:26:55.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 -- 172.21.15.69:0/2795845472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 msgr2=0x55b20892a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:55.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20892a2b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc974009990 tx=0x7fc9740053d0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 -- 172.21.15.69:0/2795845472 shutdown_connections 2023-12-14T18:26:55.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b20890ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20892a2b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 --2- 172.21.15.69:0/2795845472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b208912680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 -- 172.21.15.69:0/2795845472 >> 172.21.15.69:0/2795845472 conn(0x55b2088f6ca0 msgr2=0x55b20892ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 -- 172.21.15.69:0/2795845472 shutdown_connections 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 -- 172.21.15.69:0/2795845472 wait complete. 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.020+0000 7fc995b25b80 1 -- start start 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 Processor -- start 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20890dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b20890e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b2089111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b208911700 con 0x55b208901e00 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b208911870 con 0x55b2089014b0 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b208911a30 con 0x55b208902d00 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc995b25b80 10 client.0 _ll_register_callbacks cb 0x7fc97c095900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20890dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc9827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b20890e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20890dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:46804/0 (socket says 172.21.15.69:46804) 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc982ffd700 1 -- 172.21.15.69:0/738744937 learned_addr learned my addr 172.21.15.69:0/738744937 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.021+0000 7fc9837fe700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b2089111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc982ffd700 1 -- 172.21.15.69:0/738744937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 msgr2=0x55b2089111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc982ffd700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b2089111c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc982ffd700 1 -- 172.21.15.69:0/738744937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 msgr2=0x55b20890e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc982ffd700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b20890e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc982ffd700 1 -- 172.21.15.69:0/738744937 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2086d43b0 con 0x55b2089014b0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc9827fc700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b20890e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc982ffd700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20890dc60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9740098e0 tx=0x7fc9740056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1459a13bbf6aa5df server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc962ffd700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc962ffd700 1 -- 172.21.15.69:0/738744937 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974032040 con 0x55b2089014b0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc97401e040 con 0x55b2089014b0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc962ffd700 1 -- 172.21.15.69:0/738744937 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc974033460 con 0x55b2089014b0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc962ffd700 1 -- 172.21.15.69:0/738744937 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc974033780 con 0x55b2089014b0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc995b25b80 10 client.25250 fetch_fsmap learned FSMap version 25 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b2087ff9a0 con 0x55b2089014b0 2023-12-14T18:26:55.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc962ffd700 1 -- 172.21.15.69:0/738744937 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97401e040 con 0x55b2089014b0 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc962ffd700 1 -- 172.21.15.69:0/738744937 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc97403b070 con 0x55b2089014b0 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.022+0000 7fc995b25b80 10 client.25250 fetch_fsmap finished waiting for FSMap version 25 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc995b25b80 10 client.25250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc995b25b80 20 client.25250 populate_metadata read hostname 'smithi069' 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc995b25b80 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20897e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc995b25b80 4 client.25250 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b20884ba00 con 0x55b208927ed0 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc9827fc700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20897e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc962ffd700 10 client.25250 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.023+0000 7fc9827fc700 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20897e200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3418de45c92bd35 server_cookie=b4ee955863663bdd in_seq=0 out_seq=0 2023-12-14T18:26:55.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc962ffd700 1 -- 172.21.15.69:0/738744937 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b20884ba00 con 0x55b208927ed0 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc962ffd700 10 client.25250 handle_command_reply: tid=0 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 client.25250 shutdown 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 msgr2=0x55b20890dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20890dc60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9740098e0 tx=0x7fc9740056d0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 shutdown_connections 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55b208927ed0 0x55b20897e200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b208902d00 0x55b2089111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55b2089014b0 0x55b20890dc60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc962ffd700 0 client.25250 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 --2- 172.21.15.69:0/738744937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b208901e00 0x55b20890e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 >> 172.21.15.69:0/738744937 conn(0x55b2088f6ca0 msgr2=0x55b20890ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 shutdown_connections 2023-12-14T18:26:55.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 1 -- 172.21.15.69:0/738744937 wait complete. 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc995b25b80 20 client.25250 trim_cache size 0 max 16384 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (2 inodes in the stack)", 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:26:55.033 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:26:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:26:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:26:55.034 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:26:55.034 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc96c0a1150 msgr2=0x7fc96c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc96c0a1150 0x7fc96c0a3600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55b208902210 tx=0x7fc978009a80 comp rx=0 tx=0).stop 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101db0 msgr2=0x7fc98419d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101db0 0x7fc98419d510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007f10 tx=0x7fc97c00d3b0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 shutdown_connections 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc96c0a1150 0x7fc96c0a3600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc984101db0 0x7fc98419d510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc984100230 0x7fc984195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 --2- 172.21.15.69:0/3586078382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc984101420 0x7fc9841964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.025+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 >> 172.21.15.69:0/3586078382 conn(0x7fc9840fb850 msgr2=0x7fc9840fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:26:55.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.026+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 shutdown_connections 2023-12-14T18:26:55.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:26:55.026+0000 7fc989997700 1 -- 172.21.15.69:0/3586078382 wait complete. 2023-12-14T18:26:55.041 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:26:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:55 smithi119 ceph-mon[43973]: pgmap v325: 97 pgs: 97 active+clean; 199 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 103 op/s 2023-12-14T18:26:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:55 smithi091 ceph-mon[43601]: pgmap v325: 97 pgs: 97 active+clean; 199 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 103 op/s 2023-12-14T18:26:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:55 smithi069 ceph-mon[42047]: pgmap v325: 97 pgs: 97 active+clean; 199 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 103 op/s 2023-12-14T18:26:57.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:57 smithi119 ceph-mon[43973]: pgmap v326: 97 pgs: 97 active+clean; 199 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 76 op/s 2023-12-14T18:26:57.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:57 smithi091 ceph-mon[43601]: pgmap v326: 97 pgs: 97 active+clean; 199 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 76 op/s 2023-12-14T18:26:57.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:57 smithi069 ceph-mon[42047]: pgmap v326: 97 pgs: 97 active+clean; 199 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 76 op/s 2023-12-14T18:26:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:26:59 smithi119 ceph-mon[43973]: pgmap v327: 97 pgs: 97 active+clean; 203 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 71 op/s 2023-12-14T18:26:59.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:26:59 smithi091 ceph-mon[43601]: pgmap v327: 97 pgs: 97 active+clean; 203 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 71 op/s 2023-12-14T18:26:59.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:26:59 smithi069 ceph-mon[42047]: pgmap v327: 97 pgs: 97 active+clean; 203 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 71 op/s 2023-12-14T18:27:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:01 smithi119 ceph-mon[43973]: pgmap v328: 97 pgs: 97 active+clean; 208 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 61 op/s 2023-12-14T18:27:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:01 smithi091 ceph-mon[43601]: pgmap v328: 97 pgs: 97 active+clean; 208 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 61 op/s 2023-12-14T18:27:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:01 smithi069 ceph-mon[42047]: pgmap v328: 97 pgs: 97 active+clean; 208 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 61 op/s 2023-12-14T18:27:02.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:02 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:27:02.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:02 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:27:02.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:02 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:27:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:03 smithi119 ceph-mon[43973]: pgmap v329: 97 pgs: 97 active+clean; 213 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 48 op/s 2023-12-14T18:27:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:03 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:03 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:03 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:03.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:03 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:03 smithi091 ceph-mon[43601]: pgmap v329: 97 pgs: 97 active+clean; 213 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 48 op/s 2023-12-14T18:27:03.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:03 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:03 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:03 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:03 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:03.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:03 smithi069 ceph-mon[42047]: pgmap v329: 97 pgs: 97 active+clean; 213 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 48 op/s 2023-12-14T18:27:03.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:03 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:03 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:03 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:03.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:03 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:05.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:05 smithi119 ceph-mon[43973]: pgmap v330: 97 pgs: 97 active+clean; 216 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 55 op/s 2023-12-14T18:27:05.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:05 smithi091 ceph-mon[43601]: pgmap v330: 97 pgs: 97 active+clean; 216 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 55 op/s 2023-12-14T18:27:05.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:05 smithi069 ceph-mon[42047]: pgmap v330: 97 pgs: 97 active+clean; 216 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 55 op/s 2023-12-14T18:27:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:07 smithi119 ceph-mon[43973]: pgmap v331: 97 pgs: 97 active+clean; 219 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 48 op/s 2023-12-14T18:27:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:07 smithi119 ceph-mon[43973]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:27:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:07 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:07 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:07.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:07 smithi091 ceph-mon[43601]: pgmap v331: 97 pgs: 97 active+clean; 219 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 48 op/s 2023-12-14T18:27:07.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:07 smithi091 ceph-mon[43601]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:27:07.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:07 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:07.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:07 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:07.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:07 smithi069 ceph-mon[42047]: pgmap v331: 97 pgs: 97 active+clean; 219 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 48 op/s 2023-12-14T18:27:07.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:07 smithi069 ceph-mon[42047]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2023-12-14T18:27:07.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:07 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:07.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:07 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:08 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:08 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:08 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:08.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:08 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:08.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:08 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:08.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:08 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:08.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:08 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:08.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:08 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:08.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:08 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:08.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:08 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:08.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:08 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:08.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:08 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:09 smithi119 ceph-mon[43973]: pgmap v332: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 57 op/s 2023-12-14T18:27:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:09 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:09 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:09.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:09 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:09 smithi091 ceph-mon[43601]: pgmap v332: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 57 op/s 2023-12-14T18:27:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:09 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:09 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:09.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:09 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:09.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:09 smithi069 ceph-mon[42047]: pgmap v332: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 57 op/s 2023-12-14T18:27:09.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:09 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:09.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:09 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:09 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:10.743 INFO:tasks.workunit.client.0.smithi069.stdout:created hierarchy, now cleaning up 2023-12-14T18:27:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:10 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:10.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:10 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:10 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:10 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:10 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:10 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:10.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:10 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:10 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:10.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:10 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:10 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:10 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:10.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:10 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:10 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:10 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:10.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:10 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:11.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:11 smithi119 ceph-mon[43973]: pgmap v333: 97 pgs: 97 active+clean; 230 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 79 op/s 2023-12-14T18:27:11.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:11 smithi091 ceph-mon[43601]: pgmap v333: 97 pgs: 97 active+clean; 230 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 79 op/s 2023-12-14T18:27:11.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:11 smithi069 ceph-mon[42047]: pgmap v333: 97 pgs: 97 active+clean; 230 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 79 op/s 2023-12-14T18:27:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:13 smithi119 ceph-mon[43973]: pgmap v334: 97 pgs: 97 active+clean; 234 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 91 op/s 2023-12-14T18:27:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:13 smithi091 ceph-mon[43601]: pgmap v334: 97 pgs: 97 active+clean; 234 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 91 op/s 2023-12-14T18:27:13.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:13 smithi069 ceph-mon[42047]: pgmap v334: 97 pgs: 97 active+clean; 234 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 91 op/s 2023-12-14T18:27:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:15 smithi119 ceph-mon[43973]: pgmap v335: 97 pgs: 97 active+clean; 237 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 101 op/s 2023-12-14T18:27:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:15 smithi091 ceph-mon[43601]: pgmap v335: 97 pgs: 97 active+clean; 237 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 101 op/s 2023-12-14T18:27:15.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:15 smithi069 ceph-mon[42047]: pgmap v335: 97 pgs: 97 active+clean; 237 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 101 op/s 2023-12-14T18:27:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:17 smithi119 ceph-mon[43973]: pgmap v336: 97 pgs: 97 active+clean; 238 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2023-12-14T18:27:17.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:17 smithi091 ceph-mon[43601]: pgmap v336: 97 pgs: 97 active+clean; 238 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2023-12-14T18:27:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:17 smithi069 ceph-mon[42047]: pgmap v336: 97 pgs: 97 active+clean; 238 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2023-12-14T18:27:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:19 smithi119 ceph-mon[43973]: pgmap v337: 97 pgs: 97 active+clean; 240 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 84 op/s 2023-12-14T18:27:19.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:19 smithi091 ceph-mon[43601]: pgmap v337: 97 pgs: 97 active+clean; 240 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 84 op/s 2023-12-14T18:27:19.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:19 smithi069 ceph-mon[42047]: pgmap v337: 97 pgs: 97 active+clean; 240 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 84 op/s 2023-12-14T18:27:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:21 smithi119 ceph-mon[43973]: pgmap v338: 97 pgs: 97 active+clean; 241 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 70 op/s 2023-12-14T18:27:21.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:21 smithi091 ceph-mon[43601]: pgmap v338: 97 pgs: 97 active+clean; 241 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 70 op/s 2023-12-14T18:27:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:21 smithi069 ceph-mon[42047]: pgmap v338: 97 pgs: 97 active+clean; 241 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 70 op/s 2023-12-14T18:27:23.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:23 smithi119 ceph-mon[43973]: pgmap v339: 97 pgs: 97 active+clean; 241 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 997 KiB/s wr, 41 op/s 2023-12-14T18:27:23.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:23 smithi091 ceph-mon[43601]: pgmap v339: 97 pgs: 97 active+clean; 241 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 997 KiB/s wr, 41 op/s 2023-12-14T18:27:23.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:23 smithi069 ceph-mon[42047]: pgmap v339: 97 pgs: 97 active+clean; 241 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 997 KiB/s wr, 41 op/s 2023-12-14T18:27:25.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:27:25.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 -- 172.21.15.69:0/3890477360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b68100340 msgr2=0x7f7b68100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/3890477360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b68100340 0x7f7b68100790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009990 tx=0x7f7b58009ca0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 -- 172.21.15.69:0/3890477360 shutdown_connections 2023-12-14T18:27:25.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/3890477360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b68100cd0 0x7f7b68107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/3890477360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b680ff150 0x7f7b680ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/3890477360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b68100340 0x7f7b68100790 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 -- 172.21.15.69:0/3890477360 >> 172.21.15.69:0/3890477360 conn(0x7f7b680fa770 msgr2=0x7f7b680fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 -- 172.21.15.69:0/3890477360 shutdown_connections 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.199+0000 7f7b6fda8700 1 -- 172.21.15.69:0/3890477360 wait complete. 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 Processor -- start 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 -- start start 2023-12-14T18:27:25.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 0x7f7b68195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b68100340 0x7f7b68196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b68100cd0 0x7f7b6819d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6819da60 con 0x7f7b680ff150 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6819dba0 con 0x7f7b68100cd0 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6fda8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6819dd30 con 0x7f7b68100340 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 0x7f7b68195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 0x7f7b68195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33366/0 (socket says 172.21.15.69:33366) 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.200+0000 7f7b6db44700 1 -- 172.21.15.69:0/108318435 learned_addr learned my addr 172.21.15.69:0/108318435 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:25.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6e345700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b68100cd0 0x7f7b6819d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6d343700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b68100340 0x7f7b68196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6db44700 1 -- 172.21.15.69:0/108318435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b68100340 msgr2=0x7f7b68196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6db44700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b68100340 0x7f7b68196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6db44700 1 -- 172.21.15.69:0/108318435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b68100cd0 msgr2=0x7f7b6819d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6db44700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b68100cd0 0x7f7b6819d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6db44700 1 -- 172.21.15.69:0/108318435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580095f0 con 0x7f7b680ff150 2023-12-14T18:27:25.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6db44700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 0x7f7b68195ee0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400e970 tx=0x7f7b6400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:25.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b5effd700 1 -- 172.21.15.69:0/108318435 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64009790 con 0x7f7b680ff150 2023-12-14T18:27:25.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b5effd700 1 -- 172.21.15.69:0/108318435 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b6400c7e0 con 0x7f7b680ff150 2023-12-14T18:27:25.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6810a960 con 0x7f7b680ff150 2023-12-14T18:27:25.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b5effd700 1 -- 172.21.15.69:0/108318435 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64003bd0 con 0x7f7b680ff150 2023-12-14T18:27:25.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.201+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6810a7d0 con 0x7f7b680ff150 2023-12-14T18:27:25.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.204+0000 7f7b5effd700 1 -- 172.21.15.69:0/108318435 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7b6400c950 con 0x7f7b680ff150 2023-12-14T18:27:25.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.205+0000 7f7b5effd700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7b540a11d0 0x7f7b540a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.205+0000 7f7b5effd700 1 -- 172.21.15.69:0/108318435 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7b64014070 con 0x7f7b680ff150 2023-12-14T18:27:25.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.205+0000 7f7b6d343700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7b540a11d0 0x7f7b540a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.205+0000 7f7b6d343700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7b540a11d0 0x7f7b540a3680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800b2e0 tx=0x7f7b58004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 Processor -- start 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 -- start start 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80ea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80eb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f7fd35e0 con 0x55f5f80eae50 2023-12-14T18:27:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f8042870 con 0x55f5f80ea500 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f803bd00 con 0x55f5f80ebd00 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b6d343700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b6d343700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80eb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33372/0 (socket says 172.21.15.69:33372) 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b6d343700 1 -- 172.21.15.69:0/3978378809 learned_addr learned my addr 172.21.15.69:0/3978378809 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.206+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80ea910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:53596/0 (socket says 172.21.15.69:53596) 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6e345700 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6d343700 1 -- 172.21.15.69:0/3978378809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 msgr2=0x55f5f80ec170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6d343700 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80ec170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6d343700 1 -- 172.21.15.69:0/3978378809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 msgr2=0x55f5f80ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6d343700 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80ea910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6d343700 1 -- 172.21.15.69:0/3978378809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5f7ebd3b0 con 0x55f5f80eae50 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6e345700 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6db44700 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80ea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b6d343700 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80eb770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7b58005cd0 tx=0x7f7b58020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88d2427324fc67a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b53fff700 1 -- 172.21.15.69:0/3978378809 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58003ce0 con 0x55f5f80eae50 2023-12-14T18:27:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b53fff700 1 -- 172.21.15.69:0/3978378809 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5801e040 con 0x55f5f80eae50 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.207+0000 7f7b53fff700 1 -- 172.21.15.69:0/3978378809 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580048b0 con 0x55f5f80eae50 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3978378809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 msgr2=0x55f5f80eb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80eb770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7b58005cd0 tx=0x7f7b58020000 comp rx=0 tx=0).stop 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3978378809 shutdown_connections 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80ea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3978378809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80eb770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3978378809 >> 172.21.15.69:0/3978378809 conn(0x55f5f80dfca0 msgr2=0x55f5f80e5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3978378809 shutdown_connections 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3978378809 wait complete. 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.208+0000 7f7b7bf36b80 1 -- start start 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 Processor -- start 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80eae50 0x55f5f80f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f7fd7f90 con 0x55f5f80ea500 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f7fd7c30 con 0x55f5f80eae50 2023-12-14T18:27:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f7ebf6a0 con 0x55f5f80ebd00 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b7bf36b80 10 client.0 _ll_register_callbacks cb 0x55f5f7ffb910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33376/0 (socket says 172.21.15.69:33376) 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b6db44700 1 -- 172.21.15.69:0/1023660386 learned_addr learned my addr 172.21.15.69:0/1023660386 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b6d343700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80eae50 0x55f5f80f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.209+0000 7f7b6e345700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b6db44700 1 -- 172.21.15.69:0/1023660386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 msgr2=0x55f5f80fb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b6db44700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b6db44700 1 -- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80eae50 msgr2=0x55f5f80f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b6db44700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80eae50 0x55f5f80f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b6db44700 1 -- 172.21.15.69:0/1023660386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68107ec0 con 0x55f5f80ea500 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b6db44700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f4160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7b640ca550 tx=0x7f7b640163b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a02034dac464b4a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b517fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b517fa700 1 -- 172.21.15.69:0/1023660386 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6409a270 con 0x55f5f80ea500 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b517fa700 1 -- 172.21.15.69:0/1023660386 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7b640b1070 con 0x55f5f80ea500 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5f80dd2b0 con 0x55f5f80ea500 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b517fa700 1 -- 172.21.15.69:0/1023660386 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b6409de40 con 0x55f5f80ea500 2023-12-14T18:27:25.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 10 client.15678 fetch_fsmap learned FSMap version 27 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f5f8002170 con 0x55f5f80ea500 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b517fa700 1 -- 172.21.15.69:0/1023660386 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b6407c080 con 0x55f5f80ea500 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b517fa700 1 -- 172.21.15.69:0/1023660386 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7b64099370 con 0x55f5f80ea500 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 10 client.15678 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 20 client.15678 populate_metadata read hostname 'smithi069' 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.210+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f80ffef0 0x55f5f8102300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.211+0000 7f7b7bf36b80 4 client.15678 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.211+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5f8034ce0 con 0x55f5f80ffef0 2023-12-14T18:27:25.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.211+0000 7f7b6d343700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f80ffef0 0x55f5f8102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.211+0000 7f7b517fa700 10 client.15678 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.211+0000 7f7b6d343700 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f80ffef0 0x55f5f8102300 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86eedd053c27c865 server_cookie=a86cd2d65f5b6f75 in_seq=0 out_seq=0 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b517fa700 1 -- 172.21.15.69:0/1023660386 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f5f8034ce0 con 0x55f5f80ffef0 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b517fa700 10 client.15678 handle_command_reply: tid=0 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 client.15678 shutdown 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 msgr2=0x55f5f80f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f4160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7b640ca550 tx=0x7f7b640163b0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 shutdown_connections 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f80ffef0 0x55f5f8102300 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f4160 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b517fa700 0 client.15678 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/1023660386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80eae50 0x55f5f80f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 >> 172.21.15.69:0/1023660386 conn(0x55f5f80dfca0 msgr2=0x55f5f80e3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 shutdown_connections 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/1023660386 wait complete. 2023-12-14T18:27:25.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.214+0000 7f7b7bf36b80 20 client.15678 trim_cache size 0 max 16384 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 Processor -- start 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 -- start start 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f80f1e90 con 0x55f5f80eae50 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f80ef780 con 0x55f5f80ea500 2023-12-14T18:27:25.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f80eb550 con 0x55f5f80ebd00 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33392/0 (socket says 172.21.15.69:33392) 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 -- 172.21.15.69:0/2789995895 learned_addr learned my addr 172.21.15.69:0/2789995895 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6db44700 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6e345700 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 -- 172.21.15.69:0/2789995895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 msgr2=0x55f5f80fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 -- 172.21.15.69:0/2789995895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 msgr2=0x55f5f80f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.233+0000 7f7b6d343700 1 -- 172.21.15.69:0/2789995895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5f8001ec0 con 0x55f5f80eae50 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.234+0000 7f7b6db44700 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.234+0000 7f7b6d343700 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80fb6a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009990 tx=0x7f7b58023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9465cd92fff1a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.234+0000 7f7b5cff9700 1 -- 172.21.15.69:0/2789995895 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5803dd20 con 0x55f5f80eae50 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.234+0000 7f7b5cff9700 1 -- 172.21.15.69:0/2789995895 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5803d4e0 con 0x55f5f80eae50 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.234+0000 7f7b5cff9700 1 -- 172.21.15.69:0/2789995895 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800bd50 con 0x55f5f80eae50 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/2789995895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 msgr2=0x55f5f80fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80fb6a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009990 tx=0x7f7b58023000 comp rx=0 tx=0).stop 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/2789995895 shutdown_connections 2023-12-14T18:27:25.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80ebd00 0x55f5f80fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ea500 0x55f5f80f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/2789995895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80eae50 0x55f5f80fb6a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/2789995895 >> 172.21.15.69:0/2789995895 conn(0x55f5f80dfca0 msgr2=0x55f5f80e5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/2789995895 shutdown_connections 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/2789995895 wait complete. 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 -- start start 2023-12-14T18:27:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 Processor -- start 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.235+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80eae50 0x55f5f80f7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b7bf36b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ebd00 0x55f5f80fa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f80facc0 con 0x55f5f80ea500 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f80fae30 con 0x55f5f80ebd00 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b7bf36b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5f80faff0 con 0x55f5f80eae50 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b7bf36b80 10 client.0 _ll_register_callbacks cb 0x7f7b64099950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:27:25.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ebd00 0x55f5f80fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6db44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33402/0 (socket says 172.21.15.69:33402) 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6db44700 1 -- 172.21.15.69:0/3964612917 learned_addr learned my addr 172.21.15.69:0/3964612917 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6d343700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80eae50 0x55f5f80f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 -- 172.21.15.69:0/3964612917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80eae50 msgr2=0x55f5f80f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80eae50 0x55f5f80f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 -- 172.21.15.69:0/3964612917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 msgr2=0x55f5f80f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:25.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 -- 172.21.15.69:0/3964612917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5f8002170 con 0x55f5f80ebd00 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6d343700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80eae50 0x55f5f80f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b6e345700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ebd00 0x55f5f80fa780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55f5f80f3810 tx=0x7f7b60018b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa596bc42036d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b517fa700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.236+0000 7f7b517fa700 1 -- 172.21.15.69:0/3964612917 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60004db0 con 0x55f5f80ebd00 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b517fa700 1 -- 172.21.15.69:0/3964612917 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7b60007710 con 0x55f5f80ebd00 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b5801e040 con 0x55f5f80ebd00 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b517fa700 1 -- 172.21.15.69:0/3964612917 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b60007910 con 0x55f5f80ebd00 2023-12-14T18:27:25.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 10 client.25268 fetch_fsmap learned FSMap version 27 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f5f7ebd3b0 con 0x55f5f80ebd00 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b517fa700 1 -- 172.21.15.69:0/3964612917 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5801e040 con 0x55f5f80ebd00 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b517fa700 1 -- 172.21.15.69:0/3964612917 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7b60020bb0 con 0x55f5f80ebd00 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 10 client.25268 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 10 client.25268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 20 client.25268 populate_metadata read hostname 'smithi069' 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f8154cd0 0x55f5f81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 4 client.25268 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:27:25.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f5f8034a00 con 0x55f5f8154cd0 2023-12-14T18:27:25.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.237+0000 7f7b6db44700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f8154cd0 0x55f5f81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:25.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.238+0000 7f7b517fa700 10 client.25268 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:25.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.238+0000 7f7b6db44700 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f8154cd0 0x55f5f81570e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc2ef091eab01504 server_cookie=918aff94b2f93f42 in_seq=0 out_seq=0 2023-12-14T18:27:25.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b517fa700 1 -- 172.21.15.69:0/3964612917 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f5f8034a00 con 0x55f5f8154cd0 2023-12-14T18:27:25.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b517fa700 10 client.25268 handle_command_reply: tid=0 2023-12-14T18:27:25.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 client.25268 shutdown 2023-12-14T18:27:25.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ebd00 msgr2=0x55f5f80fa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ebd00 0x55f5f80fa780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55f5f80f3810 tx=0x7f7b60018b30 comp rx=0 tx=0).stop 2023-12-14T18:27:25.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 shutdown_connections 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f5f8154cd0 0x55f5f81570e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f5f80ebd00 0x55f5f80fa780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f5f80ea500 0x55f5f80f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 --2- 172.21.15.69:0/3964612917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f5f80eae50 0x55f5f80f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 >> 172.21.15.69:0/3964612917 conn(0x55f5f80dfca0 msgr2=0x55f5f80fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b517fa700 0 client.25268 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 shutdown_connections 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 1 -- 172.21.15.69:0/3964612917 wait complete. 2023-12-14T18:27:25.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.241+0000 7f7b7bf36b80 20 client.25268 trim_cache size 0 max 16384 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (2 inodes in the stack)", 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:27:25.251 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:27:25.252 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:27:25.252 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7b540a11d0 msgr2=0x7f7b540a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7b540a11d0 0x7f7b540a3680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800b2e0 tx=0x7f7b58004000 comp rx=0 tx=0).stop 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 msgr2=0x7f7b68195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 0x7f7b68195ee0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400e970 tx=0x7f7b6400ec80 comp rx=0 tx=0).stop 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 shutdown_connections 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7b540a11d0 0x7f7b540a3680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b68100cd0 0x7f7b6819d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b680ff150 0x7f7b68195ee0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 --2- 172.21.15.69:0/108318435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b68100340 0x7f7b68196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:25.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 >> 172.21.15.69:0/108318435 conn(0x7f7b680fa770 msgr2=0x7f7b680fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:25.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 shutdown_connections 2023-12-14T18:27:25.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:25.242+0000 7f7b6fda8700 1 -- 172.21.15.69:0/108318435 wait complete. 2023-12-14T18:27:25.256 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:27:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:25 smithi119 ceph-mon[43973]: pgmap v340: 97 pgs: 97 active+clean; 247 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 36 op/s 2023-12-14T18:27:25.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:25 smithi091 ceph-mon[43601]: pgmap v340: 97 pgs: 97 active+clean; 247 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 36 op/s 2023-12-14T18:27:25.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:25 smithi069 ceph-mon[42047]: pgmap v340: 97 pgs: 97 active+clean; 247 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 36 op/s 2023-12-14T18:27:27.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:27 smithi119 ceph-mon[43973]: pgmap v341: 97 pgs: 97 active+clean; 250 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-12-14T18:27:27.889 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:27 smithi091 ceph-mon[43601]: pgmap v341: 97 pgs: 97 active+clean; 250 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-12-14T18:27:27.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:27 smithi069 ceph-mon[42047]: pgmap v341: 97 pgs: 97 active+clean; 250 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-12-14T18:27:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:28 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:28.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:28 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:28.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:28 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:28.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:28 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:28.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:28 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:28.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:28 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:28.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:28 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:28.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:28 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:28.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:28 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:28.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:28 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:28.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:28 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:28.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:28 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:29.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:29 smithi119 ceph-mon[43973]: pgmap v342: 97 pgs: 97 active+clean; 256 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 38 op/s 2023-12-14T18:27:29.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:29 smithi091 ceph-mon[43601]: pgmap v342: 97 pgs: 97 active+clean; 256 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 38 op/s 2023-12-14T18:27:29.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:29 smithi069 ceph-mon[42047]: pgmap v342: 97 pgs: 97 active+clean; 256 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 38 op/s 2023-12-14T18:27:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:31 smithi119 ceph-mon[43973]: pgmap v343: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 49 op/s 2023-12-14T18:27:31.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:31 smithi091 ceph-mon[43601]: pgmap v343: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 49 op/s 2023-12-14T18:27:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:31 smithi069 ceph-mon[42047]: pgmap v343: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 49 op/s 2023-12-14T18:27:32.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:32 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:27:32.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:32 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:27:32.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:32 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:27:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:33 smithi119 ceph-mon[43973]: pgmap v344: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 64 op/s 2023-12-14T18:27:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:27:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:27:33.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:27:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:33 smithi091 ceph-mon[43601]: pgmap v344: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 64 op/s 2023-12-14T18:27:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:27:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:27:33.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:27:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:33 smithi069 ceph-mon[42047]: pgmap v344: 97 pgs: 97 active+clean; 264 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 64 op/s 2023-12-14T18:27:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:27:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:27:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:27:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:34 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:27:34.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:34 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:27:34.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:34 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:27:34.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:34 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:27:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:34 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:27:34.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:34 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:27:34.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:34 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:27:34.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:34 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:27:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:34 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:27:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:34 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:27:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:34 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:27:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:34 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:27:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:35 smithi119 ceph-mon[43973]: pgmap v345: 97 pgs: 97 active+clean; 271 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 78 op/s 2023-12-14T18:27:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:35 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:35 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:35 smithi091 ceph-mon[43601]: pgmap v345: 97 pgs: 97 active+clean; 271 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 78 op/s 2023-12-14T18:27:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:35 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:35 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:35 smithi069 ceph-mon[42047]: pgmap v345: 97 pgs: 97 active+clean; 271 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 78 op/s 2023-12-14T18:27:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:35 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:35 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:37 smithi119 ceph-mon[43973]: pgmap v346: 97 pgs: 97 active+clean; 277 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 81 op/s 2023-12-14T18:27:37.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:37 smithi091 ceph-mon[43601]: pgmap v346: 97 pgs: 97 active+clean; 277 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 81 op/s 2023-12-14T18:27:37.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:37 smithi069 ceph-mon[42047]: pgmap v346: 97 pgs: 97 active+clean; 277 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 81 op/s 2023-12-14T18:27:39.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:39 smithi119 ceph-mon[43973]: pgmap v347: 97 pgs: 97 active+clean; 283 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 102 op/s 2023-12-14T18:27:39.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:39 smithi091 ceph-mon[43601]: pgmap v347: 97 pgs: 97 active+clean; 283 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 102 op/s 2023-12-14T18:27:39.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:39 smithi069 ceph-mon[42047]: pgmap v347: 97 pgs: 97 active+clean; 283 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 102 op/s 2023-12-14T18:27:41.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:41 smithi119 ceph-mon[43973]: pgmap v348: 97 pgs: 97 active+clean; 299 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 170 op/s 2023-12-14T18:27:41.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:41 smithi091 ceph-mon[43601]: pgmap v348: 97 pgs: 97 active+clean; 299 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 170 op/s 2023-12-14T18:27:41.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:41 smithi069 ceph-mon[42047]: pgmap v348: 97 pgs: 97 active+clean; 299 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 170 op/s 2023-12-14T18:27:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:43 smithi119 ceph-mon[43973]: pgmap v349: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 173 op/s 2023-12-14T18:27:43.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:43 smithi091 ceph-mon[43601]: pgmap v349: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 173 op/s 2023-12-14T18:27:43.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:43 smithi069 ceph-mon[42047]: pgmap v349: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 173 op/s 2023-12-14T18:27:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:45 smithi119 ceph-mon[43973]: pgmap v350: 97 pgs: 97 active+clean; 310 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 170 op/s 2023-12-14T18:27:45.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:45 smithi091 ceph-mon[43601]: pgmap v350: 97 pgs: 97 active+clean; 310 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 170 op/s 2023-12-14T18:27:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:45 smithi069 ceph-mon[42047]: pgmap v350: 97 pgs: 97 active+clean; 310 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 170 op/s 2023-12-14T18:27:47.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:47 smithi119 ceph-mon[43973]: pgmap v351: 97 pgs: 97 active+clean; 314 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 163 op/s 2023-12-14T18:27:47.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:47 smithi091 ceph-mon[43601]: pgmap v351: 97 pgs: 97 active+clean; 314 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 163 op/s 2023-12-14T18:27:47.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:47 smithi069 ceph-mon[42047]: pgmap v351: 97 pgs: 97 active+clean; 314 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 163 op/s 2023-12-14T18:27:49.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:49 smithi091 ceph-mon[43601]: pgmap v352: 97 pgs: 97 active+clean; 323 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 169 op/s 2023-12-14T18:27:49.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:49 smithi069 ceph-mon[42047]: pgmap v352: 97 pgs: 97 active+clean; 323 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 169 op/s 2023-12-14T18:27:50.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:49 smithi119 ceph-mon[43973]: pgmap v352: 97 pgs: 97 active+clean; 323 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 169 op/s 2023-12-14T18:27:50.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:50 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:50.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:50 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:50.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:50 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:50.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:50 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:51.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:50 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:51.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:50 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:51.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:51 smithi091 ceph-mon[43601]: pgmap v353: 97 pgs: 97 active+clean; 335 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 169 op/s 2023-12-14T18:27:51.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:51 smithi069 ceph-mon[42047]: pgmap v353: 97 pgs: 97 active+clean; 335 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 169 op/s 2023-12-14T18:27:52.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:51 smithi119 ceph-mon[43973]: pgmap v353: 97 pgs: 97 active+clean; 335 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 169 op/s 2023-12-14T18:27:53.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:53 smithi091 ceph-mon[43601]: pgmap v354: 97 pgs: 97 active+clean; 337 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 99 op/s 2023-12-14T18:27:53.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:53 smithi069 ceph-mon[42047]: pgmap v354: 97 pgs: 97 active+clean; 337 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 99 op/s 2023-12-14T18:27:54.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:53 smithi119 ceph-mon[43973]: pgmap v354: 97 pgs: 97 active+clean; 337 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 99 op/s 2023-12-14T18:27:55.257 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:27:55.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 -- 172.21.15.69:0/2705655512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 msgr2=0x7fec1c1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 --2- 172.21.15.69:0/2705655512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 0x7fec1c1086f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec14009f90 tx=0x7fec1400b330 comp rx=0 tx=0).stop 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 -- 172.21.15.69:0/2705655512 shutdown_connections 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 --2- 172.21.15.69:0/2705655512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 0x7fec1c1086f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 --2- 172.21.15.69:0/2705655512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 0x7fec1c0fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 --2- 172.21.15.69:0/2705655512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 0x7fec1c1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 -- 172.21.15.69:0/2705655512 >> 172.21.15.69:0/2705655512 conn(0x7fec1c0f9ed0 msgr2=0x7fec1c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 -- 172.21.15.69:0/2705655512 shutdown_connections 2023-12-14T18:27:55.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.405+0000 7fec213bb700 1 -- 172.21.15.69:0/2705655512 wait complete. 2023-12-14T18:27:55.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 Processor -- start 2023-12-14T18:27:55.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 -- start start 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 0x7fec1c100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 0x7fec1c0ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 0x7fec1c0ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c100130 con 0x7fec1c1014a0 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1002a0 con 0x7fec1c101e30 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec213bb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1a0030 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 0x7fec1c0ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 0x7fec1c0ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33736/0 (socket says 172.21.15.69:33736) 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec1a7fc700 1 -- 172.21.15.69:0/772870039 learned_addr learned my addr 172.21.15.69:0/772870039 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:55.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec1affd700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 0x7fec1c100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.406+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 0x7fec1c0ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec1affd700 1 -- 172.21.15.69:0/772870039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 msgr2=0x7fec1c0ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec1affd700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 0x7fec1c0ff990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec1affd700 1 -- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 msgr2=0x7fec1c0ff450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec1affd700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 0x7fec1c0ff450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec1affd700 1 -- 172.21.15.69:0/772870039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100095f0 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec1affd700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 0x7fec1c100e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e9c0 tx=0x7fec0c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec03fff700 1 -- 172.21.15.69:0/772870039 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c004220 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec14009c40 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec03fff700 1 -- 172.21.15.69:0/772870039 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c004380 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec03fff700 1 -- 172.21.15.69:0/772870039 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c003b40 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.407+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c10ba30 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.410+0000 7fec03fff700 1 -- 172.21.15.69:0/772870039 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fec0c003ca0 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.410+0000 7fec03fff700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fec040a1150 0x7fec040a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.410+0000 7fec03fff700 1 -- 172.21.15.69:0/772870039 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fec0c014070 con 0x7fec1c0fe4d0 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.410+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fec040a1150 0x7fec040a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 Processor -- start 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fec040a1150 0x7fec040a3600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec10005d10 tx=0x7fec10009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 -- start start 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce70910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce71d00 0x55f29ce72170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29cd595e0 con 0x55f29ce71d00 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29cdc8870 con 0x55f29ce70500 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec2d549b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29cdc1d00 con 0x55f29ce70e50 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec1affd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce70910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec1b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce71d00 0x55f29ce72170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec1affd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce70910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:53278/0 (socket says 172.21.15.69:53278) 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.411+0000 7fec1affd700 1 -- 172.21.15.69:0/2458668539 learned_addr learned my addr 172.21.15.69:0/2458668539 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1affd700 1 -- 172.21.15.69:0/2458668539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 msgr2=0x55f29ce71770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1affd700 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce71770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1affd700 1 -- 172.21.15.69:0/2458668539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce71d00 msgr2=0x55f29ce72170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1affd700 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce71d00 0x55f29ce72170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1affd700 1 -- 172.21.15.69:0/2458668539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f29cc433b0 con 0x55f29ce70500 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce71d00 0x55f29ce72170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce71770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec1affd700 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce70910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec0c099ed0 tx=0x7fec0c099b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b96193b384cc57bb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec017fa700 1 -- 172.21.15.69:0/2458668539 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0b1070 con 0x55f29ce70500 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec017fa700 1 -- 172.21.15.69:0/2458668539 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c016330 con 0x55f29ce70500 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.412+0000 7fec017fa700 1 -- 172.21.15.69:0/2458668539 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c09a1a0 con 0x55f29ce70500 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 -- 172.21.15.69:0/2458668539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 msgr2=0x55f29ce70910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce70910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec0c099ed0 tx=0x7fec0c099b00 comp rx=0 tx=0).stop 2023-12-14T18:27:55.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 -- 172.21.15.69:0/2458668539 shutdown_connections 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce71d00 0x55f29ce72170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce70910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2458668539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce71770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 -- 172.21.15.69:0/2458668539 >> 172.21.15.69:0/2458668539 conn(0x55f29ce65ca0 msgr2=0x55f29ce6b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 -- 172.21.15.69:0/2458668539 shutdown_connections 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.413+0000 7fec2d549b80 1 -- 172.21.15.69:0/2458668539 wait complete. 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 -- start start 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 Processor -- start 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce7a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce71d00 0x55f29ce816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29cd5df90 con 0x55f29ce70e50 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29cd5dc30 con 0x55f29ce70500 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29cc456a0 con 0x55f29ce71d00 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec2d549b80 10 client.0 _ll_register_callbacks cb 0x55f29cd81910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec1affd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce7a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33754/0 (socket says 172.21.15.69:33754) 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.414+0000 7fec1a7fc700 1 -- 172.21.15.69:0/2824092728 learned_addr learned my addr 172.21.15.69:0/2824092728 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce71d00 0x55f29ce816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1affd700 1 -- 172.21.15.69:0/2824092728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce71d00 msgr2=0x55f29ce816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1affd700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce71d00 0x55f29ce816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1affd700 1 -- 172.21.15.69:0/2824092728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 msgr2=0x55f29ce7a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1affd700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1affd700 1 -- 172.21.15.69:0/2824092728 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c10ba30 con 0x55f29ce70500 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce71d00 0x55f29ce816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec1affd700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce7a120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec0c099ed0 tx=0x7fec0c098180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce9f01a117d5679 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7febfeff5700 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7febfeff5700 1 -- 172.21.15.69:0/2824092728 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0b8070 con 0x55f29ce70500 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7febfeff5700 1 -- 172.21.15.69:0/2824092728 <== mon.2 v2:172.21.15.91:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fec0c09a3b0 con 0x55f29ce70500 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f29ce632b0 con 0x55f29ce70500 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7febfeff5700 1 -- 172.21.15.69:0/2824092728 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec0c0b1070 con 0x55f29ce70500 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec2d549b80 10 client.25280 fetch_fsmap learned FSMap version 27 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.415+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f29cd88170 con 0x55f29ce70500 2023-12-14T18:27:55.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7febfeff5700 1 -- 172.21.15.69:0/2824092728 <== mon.2 v2:172.21.15.91:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c063020 con 0x55f29ce70500 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7febfeff5700 1 -- 172.21.15.69:0/2824092728 <== mon.2 v2:172.21.15.91:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fec0c0a1f00 con 0x55f29ce70500 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec2d549b80 10 client.25280 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec2d549b80 10 client.25280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec2d549b80 20 client.25280 populate_metadata read hostname 'smithi069' 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ce85a60 0x55f29ce87e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec2d549b80 4 client.25280 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f29cdbace0 con 0x55f29ce85a60 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ce85a60 0x55f29ce87e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7febfeff5700 10 client.25280 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.416+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ce85a60 0x55f29ce87e70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=985951ad3e9fcc78 server_cookie=5eedd2d4a3a3588b in_seq=0 out_seq=0 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7febfeff5700 1 -- 172.21.15.69:0/2824092728 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f29cdbace0 con 0x55f29ce85a60 2023-12-14T18:27:55.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7febfeff5700 10 client.25280 handle_command_reply: tid=0 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 client.25280 shutdown 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 msgr2=0x55f29ce7a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce7a120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec0c099ed0 tx=0x7fec0c098180 comp rx=0 tx=0).stop 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 shutdown_connections 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ce85a60 0x55f29ce87e70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce71d00 0x55f29ce816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7febfeff5700 0 client.25280 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce70500 0x55f29ce7a120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 --2- 172.21.15.69:0/2824092728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 >> 172.21.15.69:0/2824092728 conn(0x55f29ce65ca0 msgr2=0x55f29ce69f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.418+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 shutdown_connections 2023-12-14T18:27:55.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.419+0000 7fec2d549b80 1 -- 172.21.15.69:0/2824092728 wait complete. 2023-12-14T18:27:55.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.419+0000 7fec2d549b80 20 client.25280 trim_cache size 0 max 16384 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 Processor -- start 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 -- start start 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 0x55f29ce81f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce81660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce74c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29ce77ea0 con 0x55f29ce70500 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29ce757b0 con 0x55f29ce71d00 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec2d549b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29ce857b0 con 0x55f29ce70e50 2023-12-14T18:27:55.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec1affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 0x55f29ce81f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec1affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 0x55f29ce81f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33756/0 (socket says 172.21.15.69:33756) 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.440+0000 7fec1affd700 1 -- 172.21.15.69:0/199795688 learned_addr learned my addr 172.21.15.69:0/199795688 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce81660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce74c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1affd700 1 -- 172.21.15.69:0/199795688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 msgr2=0x55f29ce81660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1affd700 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce81660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1affd700 1 -- 172.21.15.69:0/199795688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 msgr2=0x55f29ce74c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1affd700 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce74c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1affd700 1 -- 172.21.15.69:0/199795688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f29ce725f0 con 0x55f29ce70500 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce74c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec1affd700 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 0x55f29ce81f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0963f0 tx=0x7fec0c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8314bfbd82462e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:55.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec01ffb700 1 -- 172.21.15.69:0/199795688 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0b8040 con 0x55f29ce70500 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec01ffb700 1 -- 172.21.15.69:0/199795688 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f29ce632b0 con 0x55f29ce70500 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.441+0000 7fec01ffb700 1 -- 172.21.15.69:0/199795688 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0ca1e0 con 0x55f29ce70500 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 -- 172.21.15.69:0/199795688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 msgr2=0x55f29ce81f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 0x55f29ce81f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0963f0 tx=0x7fec0c003f50 comp rx=0 tx=0).stop 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 -- 172.21.15.69:0/199795688 shutdown_connections 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce74c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70500 0x55f29ce81f90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 --2- 172.21.15.69:0/199795688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70e50 0x55f29ce81660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 -- 172.21.15.69:0/199795688 >> 172.21.15.69:0/199795688 conn(0x55f29ce65ca0 msgr2=0x55f29ce78ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 -- 172.21.15.69:0/199795688 shutdown_connections 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 -- 172.21.15.69:0/199795688 wait complete. 2023-12-14T18:27:55.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 -- start start 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.442+0000 7fec2d549b80 1 Processor -- start 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70500 0x55f29ce7d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce80740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29ce80c80 con 0x55f29ce70e50 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29ce80df0 con 0x55f29ce71d00 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29ce80fb0 con 0x55f29ce70500 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 10 client.0 _ll_register_callbacks cb 0x7fec100091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33766/0 (socket says 172.21.15.69:33766) 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70500 0x55f29ce7d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 -- 172.21.15.69:0/1392353488 learned_addr learned my addr 172.21.15.69:0/1392353488 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:27:55.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce80740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 -- 172.21.15.69:0/1392353488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70500 msgr2=0x55f29ce7d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70500 0x55f29ce7d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 -- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 msgr2=0x55f29ce80740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce80740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 -- 172.21.15.69:0/1392353488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f29cd88170 con 0x55f29ce70e50 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec1a7fc700 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7ddd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fec10013010 tx=0x7fec10013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2caf5216a45324 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7febfeff5700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7febfeff5700 1 -- 172.21.15.69:0/1392353488 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10022040 con 0x55f29ce70e50 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec0c016330 con 0x55f29ce70e50 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.443+0000 7febfeff5700 1 -- 172.21.15.69:0/1392353488 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fec10004020 con 0x55f29ce70e50 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7febfeff5700 1 -- 172.21.15.69:0/1392353488 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec100041e0 con 0x55f29ce70e50 2023-12-14T18:27:55.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 10 client.15702 fetch_fsmap learned FSMap version 27 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f29cbefb60 con 0x55f29ce70e50 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7febfeff5700 1 -- 172.21.15.69:0/1392353488 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c016330 con 0x55f29ce70e50 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7febfeff5700 1 -- 172.21.15.69:0/1392353488 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fec1003a070 con 0x55f29ce70e50 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 10 client.15702 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 20 client.15702 populate_metadata read hostname 'smithi069' 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ceda7f0 0x55f29cedcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 4 client.15702 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f29cdbaa00 con 0x55f29ceda7f0 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.444+0000 7fec1affd700 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ceda7f0 0x55f29cedcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec1affd700 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ceda7f0 0x55f29cedcc00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00bbd00051ef77b server_cookie=e036f94cf179edbc in_seq=0 out_seq=0 2023-12-14T18:27:55.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7febfeff5700 10 client.15702 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7febfeff5700 1 -- 172.21.15.69:0/1392353488 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f29cdbaa00 con 0x55f29ceda7f0 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7febfeff5700 10 client.15702 handle_command_reply: tid=0 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 client.15702 shutdown 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 msgr2=0x55f29ce7ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7ddd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fec10013010 tx=0x7fec10013040 comp rx=0 tx=0).stop 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 shutdown_connections 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55f29ceda7f0 0x55f29cedcc00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f29ce71d00 0x55f29ce80740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f29ce70500 0x55f29ce7d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 --2- 172.21.15.69:0/1392353488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f29ce70e50 0x55f29ce7ddd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 >> 172.21.15.69:0/1392353488 conn(0x55f29ce65ca0 msgr2=0x55f29ce81f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7febfeff5700 0 client.15702 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:27:55.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 shutdown_connections 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 1 -- 172.21.15.69:0/1392353488 wait complete. 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.445+0000 7fec2d549b80 20 client.15702 trim_cache size 0 max 16384 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (2 inodes in the stack)", 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:27:55.455 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:27:55.456 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:27:55.456 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:27:55.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fec040a1150 msgr2=0x7fec040a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fec040a1150 0x7fec040a3600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec10005d10 tx=0x7fec10009310 comp rx=0 tx=0).stop 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 msgr2=0x7fec1c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 0x7fec1c100e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e9c0 tx=0x7fec0c00ecd0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 shutdown_connections 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fec040a1150 0x7fec040a3600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec1c101e30 0x7fec1c0ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec1c0fe4d0 0x7fec1c100e10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 --2- 172.21.15.69:0/772870039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c1014a0 0x7fec1c0ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:27:55.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 >> 172.21.15.69:0/772870039 conn(0x7fec1c0f9ed0 msgr2=0x7fec1c0fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:27:55.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 shutdown_connections 2023-12-14T18:27:55.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:27:55.446+0000 7fec213bb700 1 -- 172.21.15.69:0/772870039 wait complete. 2023-12-14T18:27:55.462 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:27:55.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:55 smithi091 ceph-mon[43601]: pgmap v355: 97 pgs: 97 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 98 op/s 2023-12-14T18:27:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:55 smithi069 ceph-mon[42047]: pgmap v355: 97 pgs: 97 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 98 op/s 2023-12-14T18:27:56.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:55 smithi119 ceph-mon[43973]: pgmap v355: 97 pgs: 97 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 98 op/s 2023-12-14T18:27:57.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:57 smithi069 ceph-mon[42047]: pgmap v356: 97 pgs: 97 active+clean; 350 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 101 op/s 2023-12-14T18:27:58.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:57 smithi119 ceph-mon[43973]: pgmap v356: 97 pgs: 97 active+clean; 350 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 101 op/s 2023-12-14T18:27:58.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:57 smithi091 ceph-mon[43601]: pgmap v356: 97 pgs: 97 active+clean; 350 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 101 op/s 2023-12-14T18:27:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:58 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:27:58.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:58 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:59.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:58 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:27:59.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:58 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:59.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:58 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:27:59.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:58 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:27:59.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:27:59 smithi069 ceph-mon[42047]: pgmap v357: 97 pgs: 97 active+clean; 353 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 110 op/s 2023-12-14T18:28:00.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:27:59 smithi119 ceph-mon[43973]: pgmap v357: 97 pgs: 97 active+clean; 353 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 110 op/s 2023-12-14T18:28:00.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:27:59 smithi091 ceph-mon[43601]: pgmap v357: 97 pgs: 97 active+clean; 353 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 110 op/s 2023-12-14T18:28:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:01 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:28:01.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:01 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:28:01.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:01 smithi069 ceph-mon[42047]: pgmap v358: 97 pgs: 97 active+clean; 361 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 105 op/s 2023-12-14T18:28:02.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:01 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:28:02.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:01 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:28:02.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:01 smithi119 ceph-mon[43973]: pgmap v358: 97 pgs: 97 active+clean; 361 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 105 op/s 2023-12-14T18:28:02.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:01 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:28:02.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:01 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:28:02.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:01 smithi091 ceph-mon[43601]: pgmap v358: 97 pgs: 97 active+clean; 361 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 105 op/s 2023-12-14T18:28:03.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:03 smithi069 ceph-mon[42047]: pgmap v359: 97 pgs: 97 active+clean; 371 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 98 op/s 2023-12-14T18:28:04.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:03 smithi119 ceph-mon[43973]: pgmap v359: 97 pgs: 97 active+clean; 371 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 98 op/s 2023-12-14T18:28:04.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:03 smithi091 ceph-mon[43601]: pgmap v359: 97 pgs: 97 active+clean; 371 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 98 op/s 2023-12-14T18:28:05.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:05 smithi069 ceph-mon[42047]: pgmap v360: 97 pgs: 97 active+clean; 373 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 97 op/s 2023-12-14T18:28:06.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:05 smithi119 ceph-mon[43973]: pgmap v360: 97 pgs: 97 active+clean; 373 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 97 op/s 2023-12-14T18:28:06.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:05 smithi091 ceph-mon[43601]: pgmap v360: 97 pgs: 97 active+clean; 373 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 97 op/s 2023-12-14T18:28:07.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:07 smithi069 ceph-mon[42047]: pgmap v361: 97 pgs: 97 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 96 op/s 2023-12-14T18:28:08.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:07 smithi119 ceph-mon[43973]: pgmap v361: 97 pgs: 97 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 96 op/s 2023-12-14T18:28:08.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:07 smithi091 ceph-mon[43601]: pgmap v361: 97 pgs: 97 active+clean; 381 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.3 MiB/s wr, 96 op/s 2023-12-14T18:28:09.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:09 smithi069 ceph-mon[42047]: pgmap v362: 97 pgs: 97 active+clean; 385 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 93 op/s 2023-12-14T18:28:10.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:09 smithi119 ceph-mon[43973]: pgmap v362: 97 pgs: 97 active+clean; 385 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 93 op/s 2023-12-14T18:28:10.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:09 smithi091 ceph-mon[43601]: pgmap v362: 97 pgs: 97 active+clean; 385 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 93 op/s 2023-12-14T18:28:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:11 smithi069 ceph-mon[42047]: pgmap v363: 97 pgs: 97 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 85 op/s 2023-12-14T18:28:12.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:11 smithi119 ceph-mon[43973]: pgmap v363: 97 pgs: 97 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 85 op/s 2023-12-14T18:28:12.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:11 smithi091 ceph-mon[43601]: pgmap v363: 97 pgs: 97 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 85 op/s 2023-12-14T18:28:13.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:13 smithi069 ceph-mon[42047]: pgmap v364: 97 pgs: 97 active+clean; 397 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 85 op/s 2023-12-14T18:28:14.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:13 smithi119 ceph-mon[43973]: pgmap v364: 97 pgs: 97 active+clean; 397 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 85 op/s 2023-12-14T18:28:14.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:13 smithi091 ceph-mon[43601]: pgmap v364: 97 pgs: 97 active+clean; 397 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 85 op/s 2023-12-14T18:28:15.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:15 smithi069 ceph-mon[42047]: pgmap v365: 97 pgs: 97 active+clean; 398 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 77 op/s 2023-12-14T18:28:16.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:15 smithi119 ceph-mon[43973]: pgmap v365: 97 pgs: 97 active+clean; 398 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 77 op/s 2023-12-14T18:28:16.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:15 smithi091 ceph-mon[43601]: pgmap v365: 97 pgs: 97 active+clean; 398 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 77 op/s 2023-12-14T18:28:17.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:17 smithi069 ceph-mon[42047]: pgmap v366: 97 pgs: 97 active+clean; 405 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 83 op/s 2023-12-14T18:28:18.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:17 smithi119 ceph-mon[43973]: pgmap v366: 97 pgs: 97 active+clean; 405 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 83 op/s 2023-12-14T18:28:18.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:17 smithi091 ceph-mon[43601]: pgmap v366: 97 pgs: 97 active+clean; 405 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 83 op/s 2023-12-14T18:28:19.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:19 smithi069 ceph-mon[42047]: pgmap v367: 97 pgs: 97 active+clean; 410 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 81 op/s 2023-12-14T18:28:20.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:19 smithi119 ceph-mon[43973]: pgmap v367: 97 pgs: 97 active+clean; 410 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 81 op/s 2023-12-14T18:28:20.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:19 smithi091 ceph-mon[43601]: pgmap v367: 97 pgs: 97 active+clean; 410 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 81 op/s 2023-12-14T18:28:21.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:21 smithi069 ceph-mon[42047]: pgmap v368: 97 pgs: 97 active+clean; 414 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 77 op/s 2023-12-14T18:28:22.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:21 smithi119 ceph-mon[43973]: pgmap v368: 97 pgs: 97 active+clean; 414 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 77 op/s 2023-12-14T18:28:22.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:21 smithi091 ceph-mon[43601]: pgmap v368: 97 pgs: 97 active+clean; 414 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 77 op/s 2023-12-14T18:28:23.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:23 smithi069 ceph-mon[42047]: pgmap v369: 97 pgs: 97 active+clean; 420 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 84 op/s 2023-12-14T18:28:24.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:23 smithi119 ceph-mon[43973]: pgmap v369: 97 pgs: 97 active+clean; 420 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 84 op/s 2023-12-14T18:28:24.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:23 smithi091 ceph-mon[43601]: pgmap v369: 97 pgs: 97 active+clean; 420 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 84 op/s 2023-12-14T18:28:25.463 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:28:25.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 -- 172.21.15.69:0/2716758991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100310 msgr2=0x7fa7dc100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 --2- 172.21.15.69:0/2716758991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100310 0x7fa7dc100760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40098f0 tx=0x7fa7c4009c00 comp rx=0 tx=0).stop 2023-12-14T18:28:25.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 -- 172.21.15.69:0/2716758991 shutdown_connections 2023-12-14T18:28:25.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 --2- 172.21.15.69:0/2716758991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc100ca0 0x7fa7dc107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 --2- 172.21.15.69:0/2716758991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 --2- 172.21.15.69:0/2716758991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100310 0x7fa7dc100760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 -- 172.21.15.69:0/2716758991 >> 172.21.15.69:0/2716758991 conn(0x7fa7dc0fa740 msgr2=0x7fa7dc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 -- 172.21.15.69:0/2716758991 shutdown_connections 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.611+0000 7fa7e256d700 1 -- 172.21.15.69:0/2716758991 wait complete. 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.612+0000 7fa7e256d700 1 Processor -- start 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.612+0000 7fa7e256d700 1 -- start start 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.612+0000 7fa7e256d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.612+0000 7fa7e256d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc100310 0x7fa7dc196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7e256d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100ca0 0x7fa7dc19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7e256d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc19dab0 con 0x7fa7dc100310 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7e256d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc19dbf0 con 0x7fa7dc100ca0 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7e256d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc19dd80 con 0x7fa7dc0ff120 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc100310 0x7fa7dc196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:47890/0 (socket says 172.21.15.69:47890) 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7e0b0a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100ca0 0x7fa7dc19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7dbfff700 1 -- 172.21.15.69:0/926791936 learned_addr learned my addr 172.21.15.69:0/926791936 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 -- 172.21.15.69:0/926791936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 msgr2=0x7fa7dc195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 -- 172.21.15.69:0/926791936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100ca0 msgr2=0x7fa7dc19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100ca0 0x7fa7dc19d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 -- 172.21.15.69:0/926791936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c4009520 con 0x7fa7dc100310 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc100310 0x7fa7dc196470 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4000c00 tx=0x7fa7c400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:25.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.613+0000 7fa7d97fa700 1 -- 172.21.15.69:0/926791936 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c401c070 con 0x7fa7dc100310 2023-12-14T18:28:25.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.614+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7dc10a930 con 0x7fa7dc100310 2023-12-14T18:28:25.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.614+0000 7fa7d97fa700 1 -- 172.21.15.69:0/926791936 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7c400ba90 con 0x7fa7dc100310 2023-12-14T18:28:25.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.614+0000 7fa7d97fa700 1 -- 172.21.15.69:0/926791936 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40038e0 con 0x7fa7dc100310 2023-12-14T18:28:25.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.614+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc10a7a0 con 0x7fa7dc100310 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.616+0000 7fa7d97fa700 1 -- 172.21.15.69:0/926791936 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa7c4020030 con 0x7fa7dc100310 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.616+0000 7fa7d97fa700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7c80a1150 0x7fa7c80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.617+0000 7fa7d97fa700 1 -- 172.21.15.69:0/926791936 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa7c40cd7e0 con 0x7fa7dc100310 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.617+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7c80a1150 0x7fa7c80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.617+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7c80a1150 0x7fa7c80a3600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009fd0 tx=0x7fa7cc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.617+0000 7fa7ee6fbb80 1 Processor -- start 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 -- start start 2023-12-14T18:28:25.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04ec910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04ed770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04ee170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f03d55e0 con 0x55c4f04ec500 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f0444870 con 0x55c4f04ece50 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f043dd00 con 0x55c4f04edd00 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04ec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04ec910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58938/0 (socket says 172.21.15.69:58938) 2023-12-14T18:28:25.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7dbfff700 1 -- 172.21.15.69:0/3075950534 learned_addr learned my addr 172.21.15.69:0/3075950534 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7e0b0a700 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 -- 172.21.15.69:0/3075950534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 msgr2=0x55c4f04ee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04ee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 -- 172.21.15.69:0/3075950534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 msgr2=0x55c4f04ec910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04ec910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 -- 172.21.15.69:0/3075950534 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f02bf3b0 con 0x55c4f04ece50 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.618+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04ed770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40cb2f0 tx=0x7fa7c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0af5a0e2dd2260 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.619+0000 7fa7d27fc700 1 -- 172.21.15.69:0/3075950534 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40a3050 con 0x55c4f04ece50 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.619+0000 7fa7d27fc700 1 -- 172.21.15.69:0/3075950534 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7c4099030 con 0x55c4f04ece50 2023-12-14T18:28:25.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.619+0000 7fa7d27fc700 1 -- 172.21.15.69:0/3075950534 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c409a180 con 0x55c4f04ece50 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.619+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/3075950534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 msgr2=0x55c4f04ed770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.619+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04ed770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40cb2f0 tx=0x7fa7c4009c00 comp rx=0 tx=0).stop 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/3075950534 shutdown_connections 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04ee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04ec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/3075950534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04ed770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/3075950534 >> 172.21.15.69:0/3075950534 conn(0x55c4f04e1ca0 msgr2=0x55c4f04e7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/3075950534 shutdown_connections 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/3075950534 wait complete. 2023-12-14T18:28:25.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- start start 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 Processor -- start 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f03d9f90 con 0x55c4f04ec500 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f03d9c30 con 0x55c4f04ece50 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f02c16a0 con 0x55c4f04edd00 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.620+0000 7fa7ee6fbb80 10 client.0 _ll_register_callbacks cb 0x55c4f03fd910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58940/0 (socket says 172.21.15.69:58940) 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1595583125 learned_addr learned my addr 172.21.15.69:0/1595583125 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7e0b0a700 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1595583125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 msgr2=0x55c4f04fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 msgr2=0x55c4f04f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1595583125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc10a7a0 con 0x55c4f04ec500 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f5d60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc003b60 tx=0x7fa7cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e7d5f383801b04 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:28:25.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1595583125 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc01fca0 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1595583125 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa7cc01fe00 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.621+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4f04df2b0 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1595583125 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7cc003e70 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 10 client.15714 fetch_fsmap learned FSMap version 27 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c4f0404170 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1595583125 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c4f04df2b0 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1595583125 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa7cc032590 con 0x55c4f04ec500 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 10 client.15714 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 20 client.15714 populate_metadata read hostname 'smithi069' 2023-12-14T18:28:25.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f0501b90 0x55c4f0503fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 4 client.15714 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4f0436ce0 con 0x55c4f0501b90 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.622+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f0501b90 0x55c4f0503fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.623+0000 7fa7bb7fe700 10 client.15714 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.623+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f0501b90 0x55c4f0503fa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6d3a1e24506cdc3 server_cookie=e12566d83873fb84 in_seq=0 out_seq=0 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.623+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1595583125 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c4f0436ce0 con 0x55c4f0501b90 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.623+0000 7fa7bb7fe700 10 client.15714 handle_command_reply: tid=0 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.623+0000 7fa7ee6fbb80 1 client.15714 shutdown 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 msgr2=0x55c4f04f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f5d60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc003b60 tx=0x7fa7cc0047c0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 shutdown_connections 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f0501b90 0x55c4f0503fa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f5d60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1595583125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 >> 172.21.15.69:0/1595583125 conn(0x55c4f04e1ca0 msgr2=0x55c4f04e5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7bb7fe700 0 client.15714 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 shutdown_connections 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1595583125 wait complete. 2023-12-14T18:28:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.624+0000 7fa7ee6fbb80 20 client.15714 trim_cache size 0 max 16384 2023-12-14T18:28:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 Processor -- start 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 -- start start 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ec500 0x55c4f0503ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 0x55c4f04fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04f4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04fef50 con 0x55c4f04ece50 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04e70e0 con 0x55c4f04ec500 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04ec100 con 0x55c4f04edd00 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 0x55c4f04fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 0x55c4f04fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58956/0 (socket says 172.21.15.69:58956) 2023-12-14T18:28:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7db7fe700 1 -- 172.21.15.69:0/1976765454 learned_addr learned my addr 172.21.15.69:0/1976765454 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ec500 0x55c4f0503ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.644+0000 7fa7e0b0a700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7db7fe700 1 -- 172.21.15.69:0/1976765454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 msgr2=0x55c4f04f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7db7fe700 1 -- 172.21.15.69:0/1976765454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ec500 msgr2=0x55c4f0503ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ec500 0x55c4f0503ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7db7fe700 1 -- 172.21.15.69:0/1976765454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f04ee5f0 con 0x55c4f04ece50 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ec500 0x55c4f0503ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7e0b0a700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:28:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 0x55c4f04fd2a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa7c409ee80 tx=0x7fa7c400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82823a4e5d806b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7d2ffd700 1 -- 172.21.15.69:0/1976765454 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c409a7d0 con 0x55c4f04ece50 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7d2ffd700 1 -- 172.21.15.69:0/1976765454 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7c40a3050 con 0x55c4f04ece50 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.645+0000 7fa7d2ffd700 1 -- 172.21.15.69:0/1976765454 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4097530 con 0x55c4f04ece50 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1976765454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 msgr2=0x55c4f04fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 0x55c4f04fd2a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa7c409ee80 tx=0x7fa7c400bc00 comp rx=0 tx=0).stop 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1976765454 shutdown_connections 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ec500 0x55c4f0503ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1976765454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ece50 0x55c4f04fd2a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1976765454 >> 172.21.15.69:0/1976765454 conn(0x55c4f04e1ca0 msgr2=0x55c4f04e69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1976765454 shutdown_connections 2023-12-14T18:28:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1976765454 wait complete. 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 -- start start 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.646+0000 7fa7ee6fbb80 1 Processor -- start 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04fc640 con 0x55c4f04ec500 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04fc7b0 con 0x55c4f04ece50 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04fc970 con 0x55c4f04edd00 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 10 client.0 _ll_register_callbacks cb 0x7fa7cc003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:28:25.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7e0b0a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58968/0 (socket says 172.21.15.69:58968) 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1040335310 learned_addr learned my addr 172.21.15.69:0/1040335310 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7e0b0a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.69:47928/0 (socket says 172.21.15.69:47928) 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1040335310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 msgr2=0x55c4f04fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 msgr2=0x55c4f04f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 -- 172.21.15.69:0/1040335310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4f0404170 con 0x55c4f04ec500 2023-12-14T18:28:25.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7dbfff700 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f8ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009be0 tx=0x7fa7cc027460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ccb89a83a7880 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1040335310 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc032600 con 0x55c4f04ec500 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1040335310 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa7cc01faa0 con 0x55c4f04ec500 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.647+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7c4099030 con 0x55c4f04ec500 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1040335310 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7cc01fc60 con 0x55c4f04ec500 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 10 client.15720 fetch_fsmap learned FSMap version 27 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c4f02bf3b0 con 0x55c4f04ec500 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1040335310 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7c4099030 con 0x55c4f04ec500 2023-12-14T18:28:25.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1040335310 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa7cc0050d0 con 0x55c4f04ec500 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 10 client.15720 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 20 client.15720 populate_metadata read hostname 'smithi069' 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f05565b0 0x55c4f05589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 4 client.15720 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4f0436a00 con 0x55c4f05565b0 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f05565b0 0x55c4f05589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7bb7fe700 10 client.15720 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.648+0000 7fa7db7fe700 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f05565b0 0x55c4f05589c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf60ffe574ff3a56 server_cookie=bc46a464128dc0de in_seq=0 out_seq=0 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7bb7fe700 1 -- 172.21.15.69:0/1040335310 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c4f0436a00 con 0x55c4f05565b0 2023-12-14T18:28:25.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7bb7fe700 10 client.15720 handle_command_reply: tid=0 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 client.15720 shutdown 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 msgr2=0x55c4f04f8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f8ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009be0 tx=0x7fa7cc027460 comp rx=0 tx=0).stop 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 shutdown_connections 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55c4f05565b0 0x55c4f05589c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c4f04edd00 0x55c4f04fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7bb7fe700 0 client.15720 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c4f04ec500 0x55c4f04f8ba0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 --2- 172.21.15.69:0/1040335310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c4f04ece50 0x55c4f04f90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 >> 172.21.15.69:0/1040335310 conn(0x55c4f04e1ca0 msgr2=0x55c4f0503ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:25.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 shutdown_connections 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 1 -- 172.21.15.69:0/1040335310 wait complete. 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.649+0000 7fa7ee6fbb80 20 client.15720 trim_cache size 0 max 16384 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:28:25.660 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:28:25.661 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:28:25.661 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:28:25.661 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:28:25.661 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7c80a1150 msgr2=0x7fa7c80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7c80a1150 0x7fa7c80a3600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009fd0 tx=0x7fa7cc009310 comp rx=0 tx=0).stop 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc100310 msgr2=0x7fa7dc196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc100310 0x7fa7dc196470 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4000c00 tx=0x7fa7c400bf60 comp rx=0 tx=0).stop 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 shutdown_connections 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa7c80a1150 0x7fa7c80a3600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7dc100ca0 0x7fa7dc19d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0ff120 0x7fa7dc195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 --2- 172.21.15.69:0/926791936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7dc100310 0x7fa7dc196470 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:25.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 >> 172.21.15.69:0/926791936 conn(0x7fa7dc0fa740 msgr2=0x7fa7dc0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:25.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 shutdown_connections 2023-12-14T18:28:25.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:25.650+0000 7fa7e256d700 1 -- 172.21.15.69:0/926791936 wait complete. 2023-12-14T18:28:25.664 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:28:25.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:25 smithi069 ceph-mon[42047]: pgmap v370: 97 pgs: 97 active+clean; 424 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 79 op/s 2023-12-14T18:28:26.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:25 smithi119 ceph-mon[43973]: pgmap v370: 97 pgs: 97 active+clean; 424 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 79 op/s 2023-12-14T18:28:26.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:25 smithi091 ceph-mon[43601]: pgmap v370: 97 pgs: 97 active+clean; 424 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 79 op/s 2023-12-14T18:28:27.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:27 smithi069 ceph-mon[42047]: pgmap v371: 97 pgs: 97 active+clean; 428 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 87 op/s 2023-12-14T18:28:28.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:27 smithi119 ceph-mon[43973]: pgmap v371: 97 pgs: 97 active+clean; 428 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 87 op/s 2023-12-14T18:28:28.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:27 smithi091 ceph-mon[43601]: pgmap v371: 97 pgs: 97 active+clean; 428 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 87 op/s 2023-12-14T18:28:29.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:29 smithi069 ceph-mon[42047]: pgmap v372: 97 pgs: 97 active+clean; 435 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 95 op/s 2023-12-14T18:28:30.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:29 smithi119 ceph-mon[43973]: pgmap v372: 97 pgs: 97 active+clean; 435 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 95 op/s 2023-12-14T18:28:30.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:29 smithi091 ceph-mon[43601]: pgmap v372: 97 pgs: 97 active+clean; 435 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 95 op/s 2023-12-14T18:28:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:31 smithi069 ceph-mon[42047]: pgmap v373: 97 pgs: 97 active+clean; 440 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 93 op/s 2023-12-14T18:28:32.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:31 smithi119 ceph-mon[43973]: pgmap v373: 97 pgs: 97 active+clean; 440 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 93 op/s 2023-12-14T18:28:32.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:31 smithi091 ceph-mon[43601]: pgmap v373: 97 pgs: 97 active+clean; 440 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 93 op/s 2023-12-14T18:28:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:33 smithi069 ceph-mon[42047]: pgmap v374: 97 pgs: 97 active+clean; 441 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 92 op/s 2023-12-14T18:28:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:33 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:28:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:33 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:28:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:28:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:33 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:33 smithi119 ceph-mon[43973]: pgmap v374: 97 pgs: 97 active+clean; 441 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 92 op/s 2023-12-14T18:28:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:33 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:28:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:33 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:28:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:28:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:34.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:33 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:34.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:33 smithi091 ceph-mon[43601]: pgmap v374: 97 pgs: 97 active+clean; 441 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 92 op/s 2023-12-14T18:28:34.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:33 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:28:34.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:33 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:28:34.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:28:34.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:34.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:33 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:28:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:28:34.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:34 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:28:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:28:35.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:34 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:35.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:28:35.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:28:35.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:34 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:28:35.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:35 smithi069 ceph-mon[42047]: pgmap v375: 97 pgs: 97 active+clean; 447 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 85 op/s 2023-12-14T18:28:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:35 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:28:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:35 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:28:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:35 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:28:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:35 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:28:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:35 smithi119 ceph-mon[43973]: pgmap v375: 97 pgs: 97 active+clean; 447 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 85 op/s 2023-12-14T18:28:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:35 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:28:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:35 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:28:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:35 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:28:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:35 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:28:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:35 smithi091 ceph-mon[43601]: pgmap v375: 97 pgs: 97 active+clean; 447 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 85 op/s 2023-12-14T18:28:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:35 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:28:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:35 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:28:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:35 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:28:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:35 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:28:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:37 smithi069 ceph-mon[42047]: pgmap v376: 97 pgs: 97 active+clean; 451 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 87 op/s 2023-12-14T18:28:38.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:37 smithi119 ceph-mon[43973]: pgmap v376: 97 pgs: 97 active+clean; 451 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 87 op/s 2023-12-14T18:28:38.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:37 smithi091 ceph-mon[43601]: pgmap v376: 97 pgs: 97 active+clean; 451 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 87 op/s 2023-12-14T18:28:39.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:39 smithi069 ceph-mon[42047]: pgmap v377: 97 pgs: 97 active+clean; 461 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 86 op/s 2023-12-14T18:28:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:39 smithi119 ceph-mon[43973]: pgmap v377: 97 pgs: 97 active+clean; 461 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 86 op/s 2023-12-14T18:28:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:39 smithi091 ceph-mon[43601]: pgmap v377: 97 pgs: 97 active+clean; 461 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 86 op/s 2023-12-14T18:28:42.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:41 smithi119 ceph-mon[43973]: pgmap v378: 97 pgs: 97 active+clean; 461 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 70 op/s 2023-12-14T18:28:42.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:41 smithi091 ceph-mon[43601]: pgmap v378: 97 pgs: 97 active+clean; 461 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 70 op/s 2023-12-14T18:28:42.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:41 smithi069 ceph-mon[42047]: pgmap v378: 97 pgs: 97 active+clean; 461 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 70 op/s 2023-12-14T18:28:44.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:43 smithi119 ceph-mon[43973]: pgmap v379: 97 pgs: 97 active+clean; 462 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 74 op/s 2023-12-14T18:28:44.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:43 smithi091 ceph-mon[43601]: pgmap v379: 97 pgs: 97 active+clean; 462 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 74 op/s 2023-12-14T18:28:44.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:43 smithi069 ceph-mon[42047]: pgmap v379: 97 pgs: 97 active+clean; 462 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 74 op/s 2023-12-14T18:28:46.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:45 smithi119 ceph-mon[43973]: pgmap v380: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 98 op/s 2023-12-14T18:28:46.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:45 smithi091 ceph-mon[43601]: pgmap v380: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 98 op/s 2023-12-14T18:28:46.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:45 smithi069 ceph-mon[42047]: pgmap v380: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 98 op/s 2023-12-14T18:28:48.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:47 smithi119 ceph-mon[43973]: pgmap v381: 97 pgs: 97 active+clean; 475 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-14T18:28:48.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:47 smithi091 ceph-mon[43601]: pgmap v381: 97 pgs: 97 active+clean; 475 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-14T18:28:48.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:47 smithi069 ceph-mon[42047]: pgmap v381: 97 pgs: 97 active+clean; 475 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-14T18:28:50.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:49 smithi119 ceph-mon[43973]: pgmap v382: 97 pgs: 97 active+clean; 479 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-14T18:28:50.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:49 smithi091 ceph-mon[43601]: pgmap v382: 97 pgs: 97 active+clean; 479 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-14T18:28:50.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:49 smithi069 ceph-mon[42047]: pgmap v382: 97 pgs: 97 active+clean; 479 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-14T18:28:52.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:51 smithi119 ceph-mon[43973]: pgmap v383: 97 pgs: 97 active+clean; 480 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 88 op/s 2023-12-14T18:28:52.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:51 smithi091 ceph-mon[43601]: pgmap v383: 97 pgs: 97 active+clean; 480 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 88 op/s 2023-12-14T18:28:52.208 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:51 smithi069 ceph-mon[42047]: pgmap v383: 97 pgs: 97 active+clean; 480 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 88 op/s 2023-12-14T18:28:54.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:53 smithi119 ceph-mon[43973]: pgmap v384: 97 pgs: 97 active+clean; 489 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 102 op/s 2023-12-14T18:28:54.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:53 smithi091 ceph-mon[43601]: pgmap v384: 97 pgs: 97 active+clean; 489 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 102 op/s 2023-12-14T18:28:54.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:53 smithi069 ceph-mon[42047]: pgmap v384: 97 pgs: 97 active+clean; 489 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 102 op/s 2023-12-14T18:28:55.665 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:28:55.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:55 smithi069 ceph-mon[42047]: pgmap v385: 97 pgs: 97 active+clean; 490 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 100 op/s 2023-12-14T18:28:55.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 -- 172.21.15.69:0/2049604566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c0fe590 msgr2=0x7f449c0fe9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 --2- 172.21.15.69:0/2049604566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c0fe590 0x7f449c0fe9a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f448c009990 tx=0x7f448c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 -- 172.21.15.69:0/2049604566 shutdown_connections 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 --2- 172.21.15.69:0/2049604566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f449c101f90 0x7f449c108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 --2- 172.21.15.69:0/2049604566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c0fe590 0x7f449c0fe9a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 --2- 172.21.15.69:0/2049604566 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 0x7f449c101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 -- 172.21.15.69:0/2049604566 >> 172.21.15.69:0/2049604566 conn(0x7f449c0f9f70 msgr2=0x7f449c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 -- 172.21.15.69:0/2049604566 shutdown_connections 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.798+0000 7f44a241d700 1 -- 172.21.15.69:0/2049604566 wait complete. 2023-12-14T18:28:55.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 Processor -- start 2023-12-14T18:28:55.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 -- start start 2023-12-14T18:28:55.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f449c0fe590 0x7f449c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 0x7f449c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 0x7f449c19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c19fc70 con 0x7f449c101f90 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c19fdb0 con 0x7f449c101600 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a241d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c19ff40 con 0x7f449c0fe590 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a09ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 0x7f449c19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449b7fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 0x7f449c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a09ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 0x7f449c19f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37216/0 (socket says 172.21.15.69:37216) 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a09ba700 1 -- 172.21.15.69:0/425256057 learned_addr learned my addr 172.21.15.69:0/425256057 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449bfff700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f449c0fe590 0x7f449c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449b7fe700 1 -- 172.21.15.69:0/425256057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f449c0fe590 msgr2=0x7f449c1980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449b7fe700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f449c0fe590 0x7f449c1980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449b7fe700 1 -- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 msgr2=0x7f449c19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449b7fe700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 0x7f449c19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f449b7fe700 1 -- 172.21.15.69:0/425256057 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0095f0 con 0x7f449c101600 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.799+0000 7f44a09ba700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 0x7f449c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.800+0000 7f449b7fe700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 0x7f449c198630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9f0 tx=0x7f449000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.800+0000 7f44997fa700 1 -- 172.21.15.69:0/425256057 <== mon.2 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000c9c0 con 0x7f449c101600 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.800+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c10bae0 con 0x7f449c101600 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.800+0000 7f44997fa700 1 -- 172.21.15.69:0/425256057 <== mon.2 v2:172.21.15.91:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4490010430 con 0x7f449c101600 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.800+0000 7f44997fa700 1 -- 172.21.15.69:0/425256057 <== mon.2 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490018680 con 0x7f449c101600 2023-12-14T18:28:55.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.800+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c10b950 con 0x7f449c101600 2023-12-14T18:28:55.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.803+0000 7f44997fa700 1 -- 172.21.15.69:0/425256057 <== mon.2 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f44900105a0 con 0x7f449c101600 2023-12-14T18:28:55.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.803+0000 7f44997fa700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f44840a1150 0x7f44840a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.803+0000 7f449bfff700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f44840a1150 0x7f44840a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.803+0000 7f44997fa700 1 -- 172.21.15.69:0/425256057 <== mon.2 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4490014070 con 0x7f449c101600 2023-12-14T18:28:55.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.803+0000 7f44ae5abb80 1 Processor -- start 2023-12-14T18:28:55.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.803+0000 7f44ae5abb80 1 -- start start 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2317910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2318770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2319170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af22005e0 con 0x555af2318d00 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af226f870 con 0x555af2317500 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2268d00 con 0x555af2317e50 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f449bfff700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f44840a1150 0x7f44840a3600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f448c006010 tx=0x7f448c00b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f449bfff700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2317910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2319170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2319170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37218/0 (socket says 172.21.15.69:37218) 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f449bfff700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2317910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:53596/0 (socket says 172.21.15.69:53596) 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 -- 172.21.15.69:0/2156394557 learned_addr learned my addr 172.21.15.69:0/2156394557 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:55.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f449b7fe700 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2318770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 -- 172.21.15.69:0/2156394557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 msgr2=0x555af2318770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2318770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 -- 172.21.15.69:0/2156394557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 msgr2=0x555af2317910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2317910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 -- 172.21.15.69:0/2156394557 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af20ea3b0 con 0x555af2318d00 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f449b7fe700 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2318770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f449bfff700 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2317910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.804+0000 7f44a09ba700 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2319170 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f44940078d0 tx=0x7f44940091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8f8fb1a407fc5a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.805+0000 7f44827fc700 1 -- 172.21.15.69:0/2156394557 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494015850 con 0x555af2318d00 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.805+0000 7f44827fc700 1 -- 172.21.15.69:0/2156394557 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f449400f040 con 0x555af2318d00 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.805+0000 7f44827fc700 1 -- 172.21.15.69:0/2156394557 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494014c60 con 0x555af2318d00 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.805+0000 7f44ae5abb80 1 -- 172.21.15.69:0/2156394557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 msgr2=0x555af2319170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.805+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2319170 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f44940078d0 tx=0x7f44940091b0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- 172.21.15.69:0/2156394557 shutdown_connections 2023-12-14T18:28:55.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2319170 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2317910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/2156394557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2318770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- 172.21.15.69:0/2156394557 >> 172.21.15.69:0/2156394557 conn(0x555af230cca0 msgr2=0x555af2312430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- 172.21.15.69:0/2156394557 shutdown_connections 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- 172.21.15.69:0/2156394557 wait complete. 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- start start 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 Processor -- start 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317500 0x555af2321150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 0x555af2321690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af23286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2204f90 con 0x555af2317e50 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2204c30 con 0x555af2318d00 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af20ec6a0 con 0x555af2317500 2023-12-14T18:28:55.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.806+0000 7f44ae5abb80 10 client.0 _ll_register_callbacks cb 0x555af2228910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 0x555af2321690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 0x555af2321690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37224/0 (socket says 172.21.15.69:37224) 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 -- 172.21.15.69:0/374001052 learned_addr learned my addr 172.21.15.69:0/374001052 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f44a09ba700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af23286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449bfff700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317500 0x555af2321150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 -- 172.21.15.69:0/374001052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317500 msgr2=0x555af2321150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317500 0x555af2321150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 -- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 msgr2=0x555af23286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af23286d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 -- 172.21.15.69:0/374001052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4494007500 con 0x555af2317e50 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f44a09ba700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af23286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f449b7fe700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 0x555af2321690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f449000cfd0 tx=0x7f449009a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c90bfb053f02011 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f447b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f447b7fe700 1 -- 172.21.15.69:0/374001052 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900a2040 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555af230a2b0 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f447b7fe700 1 -- 172.21.15.69:0/374001052 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f449009deb0 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f447b7fe700 1 -- 172.21.15.69:0/374001052 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44900a22d0 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f44ae5abb80 10 client.15732 fetch_fsmap learned FSMap version 27 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.807+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555af222f170 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f447b7fe700 1 -- 172.21.15.69:0/374001052 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44900c8080 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f447b7fe700 1 -- 172.21.15.69:0/374001052 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f44900c9f90 con 0x555af2317e50 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f44ae5abb80 10 client.15732 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f44ae5abb80 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f44ae5abb80 20 client.15732 populate_metadata read hostname 'smithi069' 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af232d080 0x555af232f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f44ae5abb80 4 client.15732 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:28:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555af2261ce0 con 0x555af232d080 2023-12-14T18:28:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f449bfff700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af232d080 0x555af232f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f449bfff700 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af232d080 0x555af232f490 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa94f2e4075b9e12 server_cookie=534e391e9bd87a5d in_seq=0 out_seq=0 2023-12-14T18:28:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.808+0000 7f447b7fe700 10 client.15732 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f447b7fe700 1 -- 172.21.15.69:0/374001052 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555af2261ce0 con 0x555af232d080 2023-12-14T18:28:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f447b7fe700 10 client.15732 handle_command_reply: tid=0 2023-12-14T18:28:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f44ae5abb80 1 client.15732 shutdown 2023-12-14T18:28:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 msgr2=0x555af2321690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 0x555af2321690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f449000cfd0 tx=0x7f449009a3c0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 shutdown_connections 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.814+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af232d080 0x555af232f490 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af23286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317500 0x555af2321150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/374001052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317e50 0x555af2321690 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 >> 172.21.15.69:0/374001052 conn(0x555af230cca0 msgr2=0x555af2310f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f447b7fe700 0 client.15732 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 shutdown_connections 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 1 -- 172.21.15.69:0/374001052 wait complete. 2023-12-14T18:28:55.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.815+0000 7f44ae5abb80 20 client.15732 trim_cache size 0 max 16384 2023-12-14T18:28:55.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.831+0000 7f44ae5abb80 1 Processor -- start 2023-12-14T18:28:55.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.831+0000 7f44ae5abb80 1 -- start start 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 0x555af232f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2328690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af231f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2312a30 con 0x555af2317500 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af232a340 con 0x555af2318d00 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2313580 con 0x555af2317e50 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 0x555af232f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 0x555af232f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37226/0 (socket says 172.21.15.69:37226) 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 -- 172.21.15.69:0/1568775054 learned_addr learned my addr 172.21.15.69:0/1568775054 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449b7fe700 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2328690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f44a09ba700 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af231f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 -- 172.21.15.69:0/1568775054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 msgr2=0x555af2328690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2328690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 -- 172.21.15.69:0/1568775054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 msgr2=0x555af231f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af231f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 -- 172.21.15.69:0/1568775054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af222eec0 con 0x555af2317500 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f449bfff700 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 0x555af232f090 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f449c068d60 tx=0x7f448c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a8792f40b6c29d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f4482ffd700 1 -- 172.21.15.69:0/1568775054 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c037070 con 0x555af2317500 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f4482ffd700 1 -- 172.21.15.69:0/1568775054 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f448c01e040 con 0x555af2317500 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.832+0000 7f4482ffd700 1 -- 172.21.15.69:0/1568775054 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c033350 con 0x555af2317500 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 -- 172.21.15.69:0/1568775054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 msgr2=0x555af232f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 0x555af232f090 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f449c068d60 tx=0x7f448c020000 comp rx=0 tx=0).stop 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 -- 172.21.15.69:0/1568775054 shutdown_connections 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2318d00 0x555af231f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2317500 0x555af232f090 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/1568775054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2328690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 -- 172.21.15.69:0/1568775054 >> 172.21.15.69:0/1568775054 conn(0x555af230cca0 msgr2=0x555af2333df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:55.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 -- 172.21.15.69:0/1568775054 shutdown_connections 2023-12-14T18:28:55.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.833+0000 7f44ae5abb80 1 -- 172.21.15.69:0/1568775054 wait complete. 2023-12-14T18:28:55.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 -- start start 2023-12-14T18:28:55.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 Processor -- start 2023-12-14T18:28:55.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2324110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2324650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2327670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2327bb0 con 0x555af2318d00 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2327d20 con 0x555af2317500 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af2327ee0 con 0x555af2317e50 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44ae5abb80 10 client.0 _ll_register_callbacks cb 0x7f44900999c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44a09ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2327670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f449bfff700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2324110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44a09ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2327670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37230/0 (socket says 172.21.15.69:37230) 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f449bfff700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2324110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.69:53614/0 (socket says 172.21.15.69:53614) 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.834+0000 7f44a09ba700 1 -- 172.21.15.69:0/3101187935 learned_addr learned my addr 172.21.15.69:0/3101187935 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44a09ba700 1 -- 172.21.15.69:0/3101187935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 msgr2=0x555af2324650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44a09ba700 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2324650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44a09ba700 1 -- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 msgr2=0x555af2324110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44a09ba700 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2324110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44a09ba700 1 -- 172.21.15.69:0/3101187935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0054b0 con 0x555af2318d00 2023-12-14T18:28:55.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f449bfff700 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2324110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44a09ba700 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2327670 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4494009010 tx=0x7f4494014ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce3a250f5de165a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f447b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f447b7fe700 1 -- 172.21.15.69:0/3101187935 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494015850 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f447b7fe700 1 -- 172.21.15.69:0/3101187935 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44940159b0 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f449400f040 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f447b7fe700 1 -- 172.21.15.69:0/3101187935 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4494015bb0 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44ae5abb80 10 client.15738 fetch_fsmap learned FSMap version 27 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555af22159a0 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.835+0000 7f447b7fe700 1 -- 172.21.15.69:0/3101187935 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f449400f040 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f447b7fe700 1 -- 172.21.15.69:0/3101187935 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f449401fbc0 con 0x555af2318d00 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f44ae5abb80 10 client.15738 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f44ae5abb80 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f44ae5abb80 20 client.15738 populate_metadata read hostname 'smithi069' 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af2381c00 0x555af2384010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f44ae5abb80 4 client.15738 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:28:55.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555af2261a00 con 0x555af2381c00 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f449bfff700 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af2381c00 0x555af2384010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f447b7fe700 10 client.15738 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f449bfff700 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af2381c00 0x555af2384010 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a2a9b29ddd1598 server_cookie=d23e03188185d6ba in_seq=0 out_seq=0 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f447b7fe700 1 -- 172.21.15.69:0/3101187935 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555af2261a00 con 0x555af2381c00 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.836+0000 7f447b7fe700 10 client.15738 handle_command_reply: tid=0 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 client.15738 shutdown 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 msgr2=0x555af2327670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2327670 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4494009010 tx=0x7f4494014ae0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 shutdown_connections 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x555af2381c00 0x555af2384010 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555af2318d00 0x555af2327670 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555af2317500 0x555af2324110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f447b7fe700 0 client.15738 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 --2- 172.21.15.69:0/3101187935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555af2317e50 0x555af2324650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 >> 172.21.15.69:0/3101187935 conn(0x555af230cca0 msgr2=0x555af232f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 shutdown_connections 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 1 -- 172.21.15.69:0/3101187935 wait complete. 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44ae5abb80 20 client.15738 trim_cache size 0 max 16384 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "24e216fd-4344-48d1-88ed-3922142d5fa3": { 2023-12-14T18:28:55.844 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:28:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "24e216fd-4344-48d1-88ed-3922142d5fa3", 2023-12-14T18:28:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:28:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:28:55.845 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:28:55.845 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:28:55.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f44840a1150 msgr2=0x7f44840a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f44840a1150 0x7f44840a3600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f448c006010 tx=0x7f448c00b2a0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 msgr2=0x7f449c198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 0x7f449c198630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9f0 tx=0x7f449000ed00 comp rx=0 tx=0).stop 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 shutdown_connections 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f44840a1150 0x7f44840a3600 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f449c101f90 0x7f449c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.837+0000 7f44a241d700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f449c0fe590 0x7f449c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.838+0000 7f44a241d700 1 --2- 172.21.15.69:0/425256057 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f449c101600 0x7f449c198630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.838+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 >> 172.21.15.69:0/425256057 conn(0x7f449c0f9f70 msgr2=0x7f449c0fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.838+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 shutdown_connections 2023-12-14T18:28:55.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:28:55.838+0000 7f44a241d700 1 -- 172.21.15.69:0/425256057 wait complete. 2023-12-14T18:28:55.852 INFO:tasks.cephfs.filesystem:scrub status for tag:24e216fd-4344-48d1-88ed-3922142d5fa3 - {'path': '/', 'tag': '24e216fd-4344-48d1-88ed-3922142d5fa3', 'options': 'recursive,force'} 2023-12-14T18:28:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:55 smithi119 ceph-mon[43973]: pgmap v385: 97 pgs: 97 active+clean; 490 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 100 op/s 2023-12-14T18:28:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:55 smithi091 ceph-mon[43601]: pgmap v385: 97 pgs: 97 active+clean; 490 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 100 op/s 2023-12-14T18:28:57.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:57 smithi069 ceph-mon[42047]: pgmap v386: 97 pgs: 97 active+clean; 496 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 74 op/s 2023-12-14T18:28:57.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:57 smithi119 ceph-mon[43973]: pgmap v386: 97 pgs: 97 active+clean; 496 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 74 op/s 2023-12-14T18:28:57.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:57 smithi091 ceph-mon[43601]: pgmap v386: 97 pgs: 97 active+clean; 496 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 74 op/s 2023-12-14T18:28:59.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:28:59 smithi069 ceph-mon[42047]: pgmap v387: 97 pgs: 97 active+clean; 498 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 81 op/s 2023-12-14T18:28:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:28:59 smithi119 ceph-mon[43973]: pgmap v387: 97 pgs: 97 active+clean; 498 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 81 op/s 2023-12-14T18:28:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:28:59 smithi091 ceph-mon[43601]: pgmap v387: 97 pgs: 97 active+clean; 498 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 81 op/s 2023-12-14T18:29:01.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:01 smithi069 ceph-mon[42047]: pgmap v388: 97 pgs: 97 active+clean; 502 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 82 op/s 2023-12-14T18:29:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:01 smithi119 ceph-mon[43973]: pgmap v388: 97 pgs: 97 active+clean; 502 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 82 op/s 2023-12-14T18:29:01.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:01 smithi091 ceph-mon[43601]: pgmap v388: 97 pgs: 97 active+clean; 502 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 82 op/s 2023-12-14T18:29:03.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:03 smithi069 ceph-mon[42047]: pgmap v389: 97 pgs: 97 active+clean; 505 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 80 op/s 2023-12-14T18:29:03.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:03 smithi119 ceph-mon[43973]: pgmap v389: 97 pgs: 97 active+clean; 505 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 80 op/s 2023-12-14T18:29:03.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:03 smithi091 ceph-mon[43601]: pgmap v389: 97 pgs: 97 active+clean; 505 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 80 op/s 2023-12-14T18:29:05.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:05 smithi119 ceph-mon[43973]: pgmap v390: 97 pgs: 97 active+clean; 508 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 66 op/s 2023-12-14T18:29:05.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:05 smithi091 ceph-mon[43601]: pgmap v390: 97 pgs: 97 active+clean; 508 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 66 op/s 2023-12-14T18:29:05.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:05 smithi069 ceph-mon[42047]: pgmap v390: 97 pgs: 97 active+clean; 508 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 66 op/s 2023-12-14T18:29:07.305 INFO:tasks.workunit.client.0.smithi069.stdout:cleaned up hierarchy 2023-12-14T18:29:07.805 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:29:07.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:29:07.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:07 smithi069 ceph-mon[42047]: pgmap v391: 97 pgs: 97 active+clean; 511 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 62 op/s 2023-12-14T18:29:07.856 INFO:tasks.workunit:Running workunit fs/misc/filelock_deadlock.py... 2023-12-14T18:29:07.856 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/filelock_deadlock.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_deadlock.py 2023-12-14T18:29:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:07 smithi119 ceph-mon[43973]: pgmap v391: 97 pgs: 97 active+clean; 511 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 62 op/s 2023-12-14T18:29:07.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:07 smithi091 ceph-mon[43601]: pgmap v391: 97 pgs: 97 active+clean; 511 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 62 op/s 2023-12-14T18:29:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:09 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:09 smithi119 ceph-mon[43973]: pgmap v392: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 69 op/s 2023-12-14T18:29:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:09 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:09.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:09 smithi091 ceph-mon[43601]: pgmap v392: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 69 op/s 2023-12-14T18:29:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:09 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:09.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:09 smithi069 ceph-mon[42047]: pgmap v392: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 69 op/s 2023-12-14T18:29:11.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:11 smithi119 ceph-mon[43973]: pgmap v393: 97 pgs: 97 active+clean; 516 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 77 op/s 2023-12-14T18:29:11.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:11 smithi091 ceph-mon[43601]: pgmap v393: 97 pgs: 97 active+clean; 516 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 77 op/s 2023-12-14T18:29:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:11 smithi069 ceph-mon[42047]: pgmap v393: 97 pgs: 97 active+clean; 516 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 77 op/s 2023-12-14T18:29:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:13 smithi119 ceph-mon[43973]: pgmap v394: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 74 op/s 2023-12-14T18:29:13.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:13 smithi091 ceph-mon[43601]: pgmap v394: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 74 op/s 2023-12-14T18:29:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:13 smithi069 ceph-mon[42047]: pgmap v394: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 74 op/s 2023-12-14T18:29:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:15 smithi119 ceph-mon[43973]: pgmap v395: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 69 op/s 2023-12-14T18:29:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:15 smithi091 ceph-mon[43601]: pgmap v395: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 69 op/s 2023-12-14T18:29:15.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:15 smithi069 ceph-mon[42047]: pgmap v395: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 69 op/s 2023-12-14T18:29:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:17 smithi119 ceph-mon[43973]: pgmap v396: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 789 KiB/s wr, 63 op/s 2023-12-14T18:29:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:17 smithi091 ceph-mon[43601]: pgmap v396: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 789 KiB/s wr, 63 op/s 2023-12-14T18:29:17.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:17 smithi069 ceph-mon[42047]: pgmap v396: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 789 KiB/s wr, 63 op/s 2023-12-14T18:29:18.009 INFO:tasks.workunit.client.0.smithi069.stdout:ok 2023-12-14T18:29:18.014 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:29:18.015 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:29:18.075 INFO:tasks.workunit:Running workunit fs/misc/filelock_interrupt.py... 2023-12-14T18:29:18.075 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/filelock_interrupt.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_interrupt.py 2023-12-14T18:29:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:19 smithi119 ceph-mon[43973]: pgmap v397: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 495 KiB/s wr, 57 op/s 2023-12-14T18:29:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:19 smithi119 ceph-mon[43973]: scrub summary: idle 2023-12-14T18:29:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:19 smithi119 ceph-mon[43973]: scrub summary: idle 2023-12-14T18:29:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:19 smithi119 ceph-mon[43973]: scrub summary: idle 2023-12-14T18:29:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:19 smithi091 ceph-mon[43601]: pgmap v397: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 495 KiB/s wr, 57 op/s 2023-12-14T18:29:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:19 smithi091 ceph-mon[43601]: scrub summary: idle 2023-12-14T18:29:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:19 smithi091 ceph-mon[43601]: scrub summary: idle 2023-12-14T18:29:19.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:19 smithi091 ceph-mon[43601]: scrub summary: idle 2023-12-14T18:29:19.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:19 smithi069 ceph-mon[42047]: pgmap v397: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 495 KiB/s wr, 57 op/s 2023-12-14T18:29:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:19 smithi069 ceph-mon[42047]: scrub summary: idle 2023-12-14T18:29:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:19 smithi069 ceph-mon[42047]: scrub summary: idle 2023-12-14T18:29:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:19 smithi069 ceph-mon[42047]: scrub summary: idle 2023-12-14T18:29:21.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:21 smithi119 ceph-mon[43973]: pgmap v398: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 204 KiB/s wr, 46 op/s 2023-12-14T18:29:21.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:21 smithi091 ceph-mon[43601]: pgmap v398: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 204 KiB/s wr, 46 op/s 2023-12-14T18:29:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:21 smithi069 ceph-mon[42047]: pgmap v398: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 204 KiB/s wr, 46 op/s 2023-12-14T18:29:23.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:23 smithi119 ceph-mon[43973]: pgmap v399: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 75 KiB/s wr, 23 op/s 2023-12-14T18:29:23.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:23 smithi091 ceph-mon[43601]: pgmap v399: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 75 KiB/s wr, 23 op/s 2023-12-14T18:29:23.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:23 smithi069 ceph-mon[42047]: pgmap v399: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 75 KiB/s wr, 23 op/s 2023-12-14T18:29:25.854 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:29:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:25 smithi119 ceph-mon[43973]: pgmap v400: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 12 op/s 2023-12-14T18:29:25.882 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:25 smithi069 ceph-mon[42047]: pgmap v400: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 12 op/s 2023-12-14T18:29:25.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:25 smithi091 ceph-mon[43601]: pgmap v400: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 12 op/s 2023-12-14T18:29:25.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/391966631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f541035d0 msgr2=0x7f7f541059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:25.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/391966631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f541035d0 0x7f7f541059b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009990 tx=0x7f7f50009ca0 comp rx=0 tx=0).stop 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/391966631 shutdown_connections 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/391966631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f54105ef0 0x7f7f54108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/391966631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f54100cb0 0x7f7f54103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/391966631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f541035d0 0x7f7f541059b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.987+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/391966631 >> 172.21.15.69:0/391966631 conn(0x7f7f540fa750 msgr2=0x7f7f540fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.988+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/391966631 shutdown_connections 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.988+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/391966631 wait complete. 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.988+0000 7f7f5bfd8700 1 Processor -- start 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.988+0000 7f7f5bfd8700 1 -- start start 2023-12-14T18:29:25.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.988+0000 7f7f5bfd8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f54100cb0 0x7f7f54195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f541035d0 0x7f7f54196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 0x7f7f5419d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5419dad0 con 0x7f7f54105ef0 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5419dc10 con 0x7f7f541035d0 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5419dda0 con 0x7f7f54100cb0 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 0x7f7f5419d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 0x7f7f5419d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58990/0 (socket says 172.21.15.69:58990) 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 -- 172.21.15.69:0/1992826585 learned_addr learned my addr 172.21.15.69:0/1992826585 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f59d74700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f54100cb0 0x7f7f54195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:25.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f59573700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f541035d0 0x7f7f54196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 -- 172.21.15.69:0/1992826585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f54100cb0 msgr2=0x7f7f54195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f54100cb0 0x7f7f54195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 -- 172.21.15.69:0/1992826585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f541035d0 msgr2=0x7f7f54196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f541035d0 0x7f7f54196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 -- 172.21.15.69:0/1992826585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500095f0 con 0x7f7f54105ef0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5a575700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 0x7f7f5419d500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00ada0 tx=0x7f7f4c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f4affd700 1 -- 172.21.15.69:0/1992826585 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00f070 con 0x7f7f54105ef0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f4affd700 1 -- 172.21.15.69:0/1992826585 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f4c007b30 con 0x7f7f54105ef0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5410baf0 con 0x7f7f54105ef0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f4affd700 1 -- 172.21.15.69:0/1992826585 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c005280 con 0x7f7f54105ef0 2023-12-14T18:29:25.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.989+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5410b960 con 0x7f7f54105ef0 2023-12-14T18:29:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.991+0000 7f7f4affd700 1 -- 172.21.15.69:0/1992826585 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7f4c00c8d0 con 0x7f7f54105ef0 2023-12-14T18:29:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.992+0000 7f7f4affd700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f400a1150 0x7f7f400a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.992+0000 7f7f59d74700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f400a1150 0x7f7f400a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.992+0000 7f7f4affd700 1 -- 172.21.15.69:0/1992826585 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f4c0cbe70 con 0x7f7f54105ef0 2023-12-14T18:29:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.992+0000 7f7f59d74700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f400a1150 0x7f7f400a3600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009a10 tx=0x7f7f44009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 Processor -- start 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 -- start start 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc3a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc3c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bb235e0 con 0x55ab0bc3a500 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bb92870 con 0x55ab0bc3ae50 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f68166b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bb8bd00 con 0x55ab0bc3bd00 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f59d74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc3a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f59d74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc3a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58998/0 (socket says 172.21.15.69:58998) 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.993+0000 7f7f59d74700 1 -- 172.21.15.69:0/3562452000 learned_addr learned my addr 172.21.15.69:0/3562452000 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59573700 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f5a575700 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc3c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59d74700 1 -- 172.21.15.69:0/3562452000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3bd00 msgr2=0x55ab0bc3c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59d74700 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc3c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59d74700 1 -- 172.21.15.69:0/3562452000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3ae50 msgr2=0x55ab0bc3b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59d74700 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc3b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59d74700 1 -- 172.21.15.69:0/3562452000 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0ba0d3b0 con 0x55ab0bc3a500 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59573700 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc3b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f59d74700 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc3a910 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400ea00 tx=0x7f7f44011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86b6e9528a7f69c server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f3ffff700 1 -- 172.21.15.69:0/3562452000 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44015480 con 0x55ab0bc3a500 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f3ffff700 1 -- 172.21.15.69:0/3562452000 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f44015a70 con 0x55ab0bc3a500 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.994+0000 7f7f3ffff700 1 -- 172.21.15.69:0/3562452000 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44013990 con 0x55ab0bc3a500 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 -- 172.21.15.69:0/3562452000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 msgr2=0x55ab0bc3a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc3a910 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400ea00 tx=0x7f7f44011000 comp rx=0 tx=0).stop 2023-12-14T18:29:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 -- 172.21.15.69:0/3562452000 shutdown_connections 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc3c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc3a910 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 --2- 172.21.15.69:0/3562452000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc3b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 -- 172.21.15.69:0/3562452000 >> 172.21.15.69:0/3562452000 conn(0x55ab0bc2fca0 msgr2=0x55ab0bc35430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 -- 172.21.15.69:0/3562452000 shutdown_connections 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 -- 172.21.15.69:0/3562452000 wait complete. 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 -- start start 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.995+0000 7f7f68166b80 1 Processor -- start 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3a500 0x55ab0bc44140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc44680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc4b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bb27f90 con 0x55ab0bc3bd00 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bb27c30 con 0x55ab0bc3a500 2023-12-14T18:29:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0ba0f6a0 con 0x55ab0bc3ae50 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 10 client.0 _ll_register_callbacks cb 0x55ab0bb4b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc4b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc4b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59002/0 (socket says 172.21.15.69:59002) 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 -- 172.21.15.69:0/4193352605 learned_addr learned my addr 172.21.15.69:0/4193352605 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f59573700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc44680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f59d74700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3a500 0x55ab0bc44140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 -- 172.21.15.69:0/4193352605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 msgr2=0x55ab0bc44680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc44680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 -- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3a500 msgr2=0x55ab0bc44140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3a500 0x55ab0bc44140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 -- 172.21.15.69:0/4193352605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4400e6e0 con 0x55ab0bc3bd00 2023-12-14T18:29:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f5a575700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc4b6c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0a11b0 tx=0x7f7f4c099480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1236ff4ae8898104 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f3d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/4193352605 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c09d120 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/4193352605 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f4c0c9e40 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.996+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab0bc2d2b0 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/4193352605 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f4c00cb80 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 10 client.15750 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ab0bb52170 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/4193352605 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ab0bc2d2b0 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/4193352605 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7f4c098810 con 0x55ab0bc3bd00 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 10 client.15750 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 20 client.15750 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bc4fe80 0x55ab0bc52290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 4 client.15750 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab0bb84ce0 con 0x55ab0bc4fe80 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.997+0000 7f7f59d74700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bc4fe80 0x55ab0bc52290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.998+0000 7f7f3d7fa700 10 client.15750 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.998+0000 7f7f59d74700 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bc4fe80 0x55ab0bc52290 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0ec3107619b76 server_cookie=99b28e8acc91836 in_seq=0 out_seq=0 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.998+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/4193352605 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ab0bb84ce0 con 0x55ab0bc4fe80 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.998+0000 7f7f3d7fa700 10 client.15750 handle_command_reply: tid=0 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 client.15750 shutdown 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 msgr2=0x55ab0bc4b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc4b6c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0a11b0 tx=0x7f7f4c099480 comp rx=0 tx=0).stop 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 shutdown_connections 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bc4fe80 0x55ab0bc52290 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc4b6c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3a500 0x55ab0bc44140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4193352605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc44680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f3d7fa700 0 client.15750 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 >> 172.21.15.69:0/4193352605 conn(0x55ab0bc2fca0 msgr2=0x55ab0bc33f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 shutdown_connections 2023-12-14T18:29:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 1 -- 172.21.15.69:0/4193352605 wait complete. 2023-12-14T18:29:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:25.999+0000 7f7f68166b80 20 client.15750 trim_cache size 0 max 16384 2023-12-14T18:29:26.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.015+0000 7f7f68166b80 1 Processor -- start 2023-12-14T18:29:26.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.015+0000 7f7f68166b80 1 -- start start 2023-12-14T18:29:26.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc42ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f68166b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bc3bb50 con 0x55ab0bc3a500 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f68166b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bc41e40 con 0x55ab0bc3bd00 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f68166b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bc3a100 con 0x55ab0bc3ae50 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc42ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc42ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59006/0 (socket says 172.21.15.69:59006) 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 -- 172.21.15.69:0/4014644880 learned_addr learned my addr 172.21.15.69:0/4014644880 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59573700 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 -- 172.21.15.69:0/4014644880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 msgr2=0x55ab0bc4b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 -- 172.21.15.69:0/4014644880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 msgr2=0x55ab0bc349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 -- 172.21.15.69:0/4014644880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0bb51ec0 con 0x55ab0bc3a500 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f59d74700 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc42ee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400e4b0 tx=0x7f7f44006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71acd53dcd161ac5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f48ff9700 1 -- 172.21.15.69:0/4014644880 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4402e040 con 0x55ab0bc3a500 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f48ff9700 1 -- 172.21.15.69:0/4014644880 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f44033420 con 0x55ab0bc3a500 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.016+0000 7f7f48ff9700 1 -- 172.21.15.69:0/4014644880 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44013530 con 0x55ab0bc3a500 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 -- 172.21.15.69:0/4014644880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 msgr2=0x55ab0bc42ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc42ee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400e4b0 tx=0x7f7f44006d90 comp rx=0 tx=0).stop 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 -- 172.21.15.69:0/4014644880 shutdown_connections 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3a500 0x55ab0bc42ee0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 --2- 172.21.15.69:0/4014644880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 -- 172.21.15.69:0/4014644880 >> 172.21.15.69:0/4014644880 conn(0x55ab0bc2fca0 msgr2=0x55ab0bc352c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 -- 172.21.15.69:0/4014644880 shutdown_connections 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 -- 172.21.15.69:0/4014644880 wait complete. 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 -- start start 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.017+0000 7f7f68166b80 1 Processor -- start 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3a500 0x55ab0bc4af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bc48000 con 0x55ab0bc3ae50 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bc48170 con 0x55ab0bc3bd00 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0bc48330 con 0x55ab0bc3a500 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 10 client.0 _ll_register_callbacks cb 0x7f7f4c098c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59012/0 (socket says 172.21.15.69:59012) 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 -- 172.21.15.69:0/2624432735 learned_addr learned my addr 172.21.15.69:0/2624432735 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59d74700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3a500 0x55ab0bc4af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 -- 172.21.15.69:0/2624432735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3a500 msgr2=0x55ab0bc4af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3a500 0x55ab0bc4af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f5a575700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 -- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 msgr2=0x55ab0bc479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 -- 172.21.15.69:0/2624432735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab0ba0d3b0 con 0x55ab0bc3ae50 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59d74700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3a500 0x55ab0bc4af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f59573700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b480 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7f500098e0 tx=0x7f7f5000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3518e5a796b7d2ae server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f3d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/2624432735 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5001d030 con 0x55ab0bc3ae50 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/2624432735 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f50004700 con 0x55ab0bc3ae50 2023-12-14T18:29:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f44015a70 con 0x55ab0bc3ae50 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/2624432735 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f500056e0 con 0x55ab0bc3ae50 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 10 client.15756 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.018+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ab0bb389a0 con 0x55ab0bc3ae50 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/2624432735 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f44015a70 con 0x55ab0bc3ae50 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/2624432735 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7f500099c0 con 0x55ab0bc3ae50 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f68166b80 10 client.15756 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f68166b80 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f68166b80 20 client.15756 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f68166b80 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bca5240 0x55ab0bca7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f68166b80 4 client.15756 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ab0bb84a00 con 0x55ab0bca5240 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f59d74700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bca5240 0x55ab0bca7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f3d7fa700 10 client.15756 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.019+0000 7f7f59d74700 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bca5240 0x55ab0bca7650 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c85835e90dd7f9 server_cookie=48c07e36883bb07a in_seq=0 out_seq=0 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f3d7fa700 1 -- 172.21.15.69:0/2624432735 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ab0bb84a00 con 0x55ab0bca5240 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f3d7fa700 10 client.15756 handle_command_reply: tid=0 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 client.15756 shutdown 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 msgr2=0x55ab0bc4b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b480 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7f500098e0 tx=0x7f7f5000bef0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 shutdown_connections 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55ab0bca5240 0x55ab0bca7650 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ab0bc3bd00 0x55ab0bc479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f3d7fa700 0 client.15756 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ab0bc3a500 0x55ab0bc4af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 --2- 172.21.15.69:0/2624432735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab0bc3ae50 0x55ab0bc4b480 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 >> 172.21.15.69:0/2624432735 conn(0x55ab0bc2fca0 msgr2=0x55ab0bc42ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 shutdown_connections 2023-12-14T18:29:26.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 1 -- 172.21.15.69:0/2624432735 wait complete. 2023-12-14T18:29:26.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f68166b80 20 client.15756 trim_cache size 0 max 16384 2023-12-14T18:29:26.030 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:29:26.030 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T18:29:26.030 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T18:29:26.030 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f400a1150 msgr2=0x7f7f400a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f400a1150 0x7f7f400a3600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009a10 tx=0x7f7f44009190 comp rx=0 tx=0).stop 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 msgr2=0x7f7f5419d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 0x7f7f5419d500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00ada0 tx=0x7f7f4c00c330 comp rx=0 tx=0).stop 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 shutdown_connections 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f7f400a1150 0x7f7f400a3600 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f54105ef0 0x7f7f5419d500 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f54100cb0 0x7f7f54195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 --2- 172.21.15.69:0/1992826585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f541035d0 0x7f7f54196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.020+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 >> 172.21.15.69:0/1992826585 conn(0x7f7f540fa750 msgr2=0x7f7f54101910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.021+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 shutdown_connections 2023-12-14T18:29:26.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.021+0000 7f7f5bfd8700 1 -- 172.21.15.69:0/1992826585 wait complete. 2023-12-14T18:29:26.034 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T18:29:26.034 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:29:26.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.195+0000 7f96e900f700 1 -- 172.21.15.69:0/3830961605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e4100cd0 msgr2=0x7f96e4107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.195+0000 7f96e900f700 1 --2- 172.21.15.69:0/3830961605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e4100cd0 0x7f96e4107590 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009990 tx=0x7f96d4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 -- 172.21.15.69:0/3830961605 shutdown_connections 2023-12-14T18:29:26.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 --2- 172.21.15.69:0/3830961605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e4100cd0 0x7f96e4107590 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 --2- 172.21.15.69:0/3830961605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e40ff150 0x7f96e40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 --2- 172.21.15.69:0/3830961605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 0x7f96e4100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 -- 172.21.15.69:0/3830961605 >> 172.21.15.69:0/3830961605 conn(0x7f96e40fa750 msgr2=0x7f96e40fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 -- 172.21.15.69:0/3830961605 shutdown_connections 2023-12-14T18:29:26.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 -- 172.21.15.69:0/3830961605 wait complete. 2023-12-14T18:29:26.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.196+0000 7f96e900f700 1 Processor -- start 2023-12-14T18:29:26.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 -- start start 2023-12-14T18:29:26.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 0x7f96e4194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 0x7f96e4195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4100cd0 0x7f96e419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e419c8c0 con 0x7f96e40ff150 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e419ca00 con 0x7f96e4100340 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e419cb90 con 0x7f96e4100cd0 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 0x7f96e4194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 0x7f96e4194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59024/0 (socket says 172.21.15.69:59024) 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 -- 172.21.15.69:0/1804756697 learned_addr learned my addr 172.21.15.69:0/1804756697 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e259c700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 0x7f96e4195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e359e700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4100cd0 0x7f96e419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 -- 172.21.15.69:0/1804756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4100cd0 msgr2=0x7f96e419c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4100cd0 0x7f96e419c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 -- 172.21.15.69:0/1804756697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 msgr2=0x7f96e4195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 0x7f96e4195280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 -- 172.21.15.69:0/1804756697 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d40095f0 con 0x7f96e40ff150 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e259c700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 0x7f96e4195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e359e700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4100cd0 0x7f96e419c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e2d9d700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 0x7f96e4194d40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f96dc007b50 tx=0x7f96dc007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc011070 con 0x7f96e40ff150 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e410a970 con 0x7f96e40ff150 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.197+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96dc00c2e0 con 0x7f96e40ff150 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.198+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc003e10 con 0x7f96e40ff150 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.198+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e410a7e0 con 0x7f96e40ff150 2023-12-14T18:29:26.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.199+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e4067e40 con 0x7f96e40ff150 2023-12-14T18:29:26.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.200+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f96dc003fb0 con 0x7f96e40ff150 2023-12-14T18:29:26.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.200+0000 7f96cbfff700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96cc0a1150 0x7f96cc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.200+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f96dc0cdd70 con 0x7f96e40ff150 2023-12-14T18:29:26.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.200+0000 7f96e259c700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96cc0a1150 0x7f96cc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.201+0000 7f96e259c700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96cc0a1150 0x7f96cc0a3600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009dd0 tx=0x7f96d8009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.205+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f96dc097560 con 0x7f96e40ff150 2023-12-14T18:29:26.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.440+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96e4106540 con 0x7f96e40ff150 2023-12-14T18:29:26.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.440+0000 7f96cbfff700 1 -- 172.21.15.69:0/1804756697 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f96dc09ab80 con 0x7f96e40ff150 2023-12-14T18:29:26.443 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:29:26.443 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:27:06.542050+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:29:26.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96cc0a1150 msgr2=0x7f96cc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96cc0a1150 0x7f96cc0a3600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009dd0 tx=0x7f96d8009040 comp rx=0 tx=0).stop 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 msgr2=0x7f96e4194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 0x7f96e4194d40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f96dc007b50 tx=0x7f96dc007f10 comp rx=0 tx=0).stop 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 shutdown_connections 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f96cc0a1150 0x7f96cc0a3600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4100cd0 0x7f96e419c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e40ff150 0x7f96e4194d40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 --2- 172.21.15.69:0/1804756697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96e4100340 0x7f96e4195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.442+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 >> 172.21.15.69:0/1804756697 conn(0x7f96e40fa750 msgr2=0x7f96e4103800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.443+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 shutdown_connections 2023-12-14T18:29:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.443+0000 7f96e900f700 1 -- 172.21.15.69:0/1804756697 wait complete. 2023-12-14T18:29:26.447 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 27 2023-12-14T18:29:26.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T18:29:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 -- 172.21.15.69:0/3736188935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c0ff370 msgr2=0x7f8c2c0ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 --2- 172.21.15.69:0/3736188935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c0ff7e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009990 tx=0x7f8c28009ca0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 -- 172.21.15.69:0/3736188935 shutdown_connections 2023-12-14T18:29:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 --2- 172.21.15.69:0/3736188935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ffd20 0x7f8c2c1075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 --2- 172.21.15.69:0/3736188935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 --2- 172.21.15.69:0/3736188935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c0ff7e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 -- 172.21.15.69:0/3736188935 >> 172.21.15.69:0/3736188935 conn(0x7f8c2c0f9eb0 msgr2=0x7f8c2c0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.581+0000 7f8c33fde700 1 -- 172.21.15.69:0/3736188935 shutdown_connections 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 -- 172.21.15.69:0/3736188935 wait complete. 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 Processor -- start 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 -- start start 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c103120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c0ffd20 0x7f8c2c101760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c102440 con 0x7f8c2c1007b0 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c1025b0 con 0x7f8c2c0ff370 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c33fde700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c19ff60 con 0x7f8c2c0ffd20 2023-12-14T18:29:26.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c3257b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c3257b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c101ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59038/0 (socket says 172.21.15.69:59038) 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c3257b700 1 -- 172.21.15.69:0/4224852990 learned_addr learned my addr 172.21.15.69:0/4224852990 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.582+0000 7f8c31579700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c0ffd20 0x7f8c2c101760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c103120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c3257b700 1 -- 172.21.15.69:0/4224852990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c0ffd20 msgr2=0x7f8c2c101760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c3257b700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c0ffd20 0x7f8c2c101760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c3257b700 1 -- 172.21.15.69:0/4224852990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ff370 msgr2=0x7f8c2c103120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c3257b700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c103120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c3257b700 1 -- 172.21.15.69:0/4224852990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280095f0 con 0x7f8c2c1007b0 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c31579700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c0ffd20 0x7f8c2c101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c3257b700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c101ca0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400ef30 tx=0x7f8c2400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c22ffd700 1 -- 172.21.15.69:0/4224852990 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24018070 con 0x7f8c2c1007b0 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c22ffd700 1 -- 172.21.15.69:0/4224852990 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c2400f040 con 0x7f8c2c1007b0 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c10a9d0 con 0x7f8c2c1007b0 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c22ffd700 1 -- 172.21.15.69:0/4224852990 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24003d00 con 0x7f8c2c1007b0 2023-12-14T18:29:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.583+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c10a840 con 0x7f8c2c1007b0 2023-12-14T18:29:26.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.585+0000 7f8c22ffd700 1 -- 172.21.15.69:0/4224852990 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8c2400caa0 con 0x7f8c2c1007b0 2023-12-14T18:29:26.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.585+0000 7f8c22ffd700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8c180a1150 0x7f8c180a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.586+0000 7f8c22ffd700 1 -- 172.21.15.69:0/4224852990 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c240cc640 con 0x7f8c2c1007b0 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.586+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8c180a1150 0x7f8c180a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.586+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8c180a1150 0x7f8c180a3600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c005fd0 tx=0x7f8c1c005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.586+0000 7f8c4016cb80 1 Processor -- start 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 -- start start 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 0x56475db5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db60770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475da485e0 con 0x56475db5f500 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475dab7870 con 0x56475db5fe50 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475dab0d00 con 0x56475db60d00 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 0x56475db5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 0x56475db5f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59044/0 (socket says 172.21.15.69:59044) 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 -- 172.21.15.69:0/4276236343 learned_addr learned my addr 172.21.15.69:0/4276236343 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31579700 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db60770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 -- 172.21.15.69:0/4276236343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 msgr2=0x56475db61170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 -- 172.21.15.69:0/4276236343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 msgr2=0x56475db60770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db60770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 -- 172.21.15.69:0/4276236343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56475d9323b0 con 0x56475db5f500 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.587+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 0x56475db5f910 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00edd0 tx=0x7f8c1c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca9c8af4ac9547a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c17fff700 1 -- 172.21.15.69:0/4276236343 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c022070 con 0x56475db5f500 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c17fff700 1 -- 172.21.15.69:0/4276236343 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c1c00ee00 con 0x56475db5f500 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c17fff700 1 -- 172.21.15.69:0/4276236343 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c005420 con 0x56475db5f500 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 -- 172.21.15.69:0/4276236343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 msgr2=0x56475db5f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 0x56475db5f910 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00edd0 tx=0x7f8c1c009f90 comp rx=0 tx=0).stop 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 -- 172.21.15.69:0/4276236343 shutdown_connections 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db61170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5f500 0x56475db5f910 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/4276236343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db60770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 -- 172.21.15.69:0/4276236343 >> 172.21.15.69:0/4276236343 conn(0x56475db54ca0 msgr2=0x56475db5a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 -- 172.21.15.69:0/4276236343 shutdown_connections 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.588+0000 7f8c4016cb80 1 -- 172.21.15.69:0/4276236343 wait complete. 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 -- start start 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 Processor -- start 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db691b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 0x56475db70730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475da4cf90 con 0x56475db60d00 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475da4cc30 con 0x56475db5fe50 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d9346a0 con 0x56475db5f500 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c4016cb80 10 client.0 _ll_register_callbacks cb 0x56475da70910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 0x56475db70730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 0x56475db70730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59060/0 (socket says 172.21.15.69:59060) 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 -- 172.21.15.69:0/823185426 learned_addr learned my addr 172.21.15.69:0/823185426 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 -- 172.21.15.69:0/823185426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 msgr2=0x56475db691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 -- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 msgr2=0x56475db696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.589+0000 7f8c3257b700 1 -- 172.21.15.69:0/823185426 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c00eab0 con 0x56475db60d00 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c3257b700 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 0x56475db70730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8c24095ff0 tx=0x7f8c24099580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c9a3e9072d5824 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c157fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c157fa700 1 -- 172.21.15.69:0/823185426 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24099af0 con 0x56475db60d00 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c157fa700 1 -- 172.21.15.69:0/823185426 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c2409db20 con 0x56475db60d00 2023-12-14T18:29:26.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56475db522b0 con 0x56475db60d00 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c157fa700 1 -- 172.21.15.69:0/823185426 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c240b2200 con 0x56475db60d00 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 10 client.15774 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56475da77170 con 0x56475db60d00 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c157fa700 1 -- 172.21.15.69:0/823185426 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56475db522b0 con 0x56475db60d00 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c157fa700 1 -- 172.21.15.69:0/823185426 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8c2401bbf0 con 0x56475db60d00 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 10 client.15774 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 10 client.15774 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 20 client.15774 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475db74e40 0x56475db77250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 4 client.15774 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.590+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56475daa9ce0 con 0x56475db74e40 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.591+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475db74e40 0x56475db77250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.591+0000 7f8c157fa700 10 client.15774 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.591+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475db74e40 0x56475db77250 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca9ed7d4da5fc2e6 server_cookie=5aa85103561d991a in_seq=0 out_seq=0 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c157fa700 1 -- 172.21.15.69:0/823185426 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56475daa9ce0 con 0x56475db74e40 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c157fa700 10 client.15774 handle_command_reply: tid=0 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 client.15774 shutdown 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 msgr2=0x56475db70730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 0x56475db70730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8c24095ff0 tx=0x7f8c24099580 comp rx=0 tx=0).stop 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 shutdown_connections 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475db74e40 0x56475db77250 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db60d00 0x56475db70730 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/823185426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5fe50 0x56475db696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c157fa700 0 client.15774 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:26.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 >> 172.21.15.69:0/823185426 conn(0x56475db54ca0 msgr2=0x56475db58f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 shutdown_connections 2023-12-14T18:29:26.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 1 -- 172.21.15.69:0/823185426 wait complete. 2023-12-14T18:29:26.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.592+0000 7f8c4016cb80 20 client.15774 trim_cache size 0 max 16384 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 Processor -- start 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 -- start start 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5f500 0x56475db67ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db68900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475db66f60 con 0x56475db5fe50 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475db5f100 con 0x56475db5f500 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475db64820 con 0x56475db60d00 2023-12-14T18:29:26.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c31579700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c31579700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59068/0 (socket says 172.21.15.69:59068) 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c31579700 1 -- 172.21.15.69:0/464106646 learned_addr learned my addr 172.21.15.69:0/464106646 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c31579700 1 -- 172.21.15.69:0/464106646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 msgr2=0x56475db68900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c3257b700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db68900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.605+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5f500 0x56475db67ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c31579700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db68900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c31579700 1 -- 172.21.15.69:0/464106646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5f500 msgr2=0x56475db67ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c31579700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5f500 0x56475db67ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c31579700 1 -- 172.21.15.69:0/464106646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56475da76ec0 con 0x56475db5fe50 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c3257b700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5f500 0x56475db67ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:26.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c31579700 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db706f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800b2e0 tx=0x7f8c28005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0248be7de2b8f0e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c20ff9700 1 -- 172.21.15.69:0/464106646 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28003680 con 0x56475db5fe50 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c20ff9700 1 -- 172.21.15.69:0/464106646 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c28003c70 con 0x56475db5fe50 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c20ff9700 1 -- 172.21.15.69:0/464106646 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800f460 con 0x56475db5fe50 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 -- 172.21.15.69:0/464106646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 msgr2=0x56475db706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db706f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800b2e0 tx=0x7f8c28005c20 comp rx=0 tx=0).stop 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 -- 172.21.15.69:0/464106646 shutdown_connections 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db60d00 0x56475db68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db5f500 0x56475db67ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/464106646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db706f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 -- 172.21.15.69:0/464106646 >> 172.21.15.69:0/464106646 conn(0x56475db54ca0 msgr2=0x56475db7bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.606+0000 7f8c4016cb80 1 -- 172.21.15.69:0/464106646 shutdown_connections 2023-12-14T18:29:26.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 -- 172.21.15.69:0/464106646 wait complete. 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 -- start start 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 Processor -- start 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db60d00 0x56475db6fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475db70190 con 0x56475db5fe50 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475db70300 con 0x56475db60d00 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475db704c0 con 0x56475db5f500 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c4016cb80 10 client.0 _ll_register_callbacks cb 0x7f8c240998c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c31579700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c31579700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db6ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59072/0 (socket says 172.21.15.69:59072) 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c31579700 1 -- 172.21.15.69:0/488838165 learned_addr learned my addr 172.21.15.69:0/488838165 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.607+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c3257b700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db60d00 0x56475db6fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c31579700 1 -- 172.21.15.69:0/488838165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 msgr2=0x56475db6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c31579700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db6e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c31579700 1 -- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db60d00 msgr2=0x56475db6fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c31579700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db60d00 0x56475db6fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c31579700 1 -- 172.21.15.69:0/488838165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c107f80 con 0x56475db5fe50 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c31579700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db6ed40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009ce0 tx=0x7f8c2800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8e7a2afdb728ad server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c157fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c157fa700 1 -- 172.21.15.69:0/488838165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28003a90 con 0x56475db5fe50 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c157fa700 1 -- 172.21.15.69:0/488838165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c2800f460 con 0x56475db5fe50 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c1c00ee00 con 0x56475db5fe50 2023-12-14T18:29:26.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c157fa700 1 -- 172.21.15.69:0/488838165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c2800f620 con 0x56475db5fe50 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c4016cb80 10 client.15780 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56475da5d9a0 con 0x56475db5fe50 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c157fa700 1 -- 172.21.15.69:0/488838165 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c2803c020 con 0x56475db5fe50 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c157fa700 1 -- 172.21.15.69:0/488838165 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8c280387c0 con 0x56475db5fe50 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c4016cb80 10 client.15780 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c4016cb80 10 client.15780 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.608+0000 7f8c4016cb80 20 client.15780 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475dbc99e0 0x56475dbcbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 4 client.15780 mds_command: new command op to 24458 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56475daa9a00 con 0x56475dbc99e0 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475dbc99e0 0x56475dbcbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c157fa700 10 client.15780 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:26.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c31d7a700 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475dbc99e0 0x56475dbcbdf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6361df4a4f8f1793 server_cookie=6e8b337aaf964a8b in_seq=0 out_seq=0 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c157fa700 1 -- 172.21.15.69:0/488838165 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56475daa9a00 con 0x56475dbc99e0 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c157fa700 10 client.15780 handle_command_reply: tid=0 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 client.15780 shutdown 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 msgr2=0x56475db6ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db6ed40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009ce0 tx=0x7f8c2800b710 comp rx=0 tx=0).stop 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 shutdown_connections 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.609+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x56475dbc99e0 0x56475dbcbdf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56475db60d00 0x56475db6fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56475db5f500 0x56475db6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 1 --2- 172.21.15.69:0/488838165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56475db5fe50 0x56475db6ed40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c157fa700 0 client.15780 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:26.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 >> 172.21.15.69:0/488838165 conn(0x56475db54ca0 msgr2=0x56475db67ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 shutdown_connections 2023-12-14T18:29:26.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 1 -- 172.21.15.69:0/488838165 wait complete. 2023-12-14T18:29:26.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c4016cb80 20 client.15780 trim_cache size 0 max 16384 2023-12-14T18:29:26.620 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8c180a1150 msgr2=0x7f8c180a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8c180a1150 0x7f8c180a3600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c005fd0 tx=0x7f8c1c005ee0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 msgr2=0x7f8c2c101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c101ca0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400ef30 tx=0x7f8c2400c450 comp rx=0 tx=0).stop 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 shutdown_connections 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8c180a1150 0x7f8c180a3600 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c2c1007b0 0x7f8c2c101ca0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c2c0ff370 0x7f8c2c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 --2- 172.21.15.69:0/4224852990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c2c0ffd20 0x7f8c2c101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 >> 172.21.15.69:0/4224852990 conn(0x7f8c2c0f9eb0 msgr2=0x7f8c2c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 shutdown_connections 2023-12-14T18:29:26.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.610+0000 7f8c33fde700 1 -- 172.21.15.69:0/4224852990 wait complete. 2023-12-14T18:29:26.624 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T18:29:26.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:26 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1804756697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:29:26.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 -- 172.21.15.69:0/493906441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100330 msgr2=0x7f3e80100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 --2- 172.21.15.69:0/493906441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100330 0x7f3e80100780 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009990 tx=0x7f3e74009ca0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 -- 172.21.15.69:0/493906441 shutdown_connections 2023-12-14T18:29:26.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 --2- 172.21.15.69:0/493906441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e80100cc0 0x7f3e80107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 --2- 172.21.15.69:0/493906441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e800ff140 0x7f3e800ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 --2- 172.21.15.69:0/493906441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100330 0x7f3e80100780 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 -- 172.21.15.69:0/493906441 >> 172.21.15.69:0/493906441 conn(0x7f3e800fa780 msgr2=0x7f3e800fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 -- 172.21.15.69:0/493906441 shutdown_connections 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 -- 172.21.15.69:0/493906441 wait complete. 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 Processor -- start 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.747+0000 7f3e86a45700 1 -- start start 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800ff140 0x7f3e80195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e80100330 0x7f3e80196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 0x7f3e8019d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8019da70 con 0x7f3e80100cc0 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8019dbb0 con 0x7f3e800ff140 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8019dd40 con 0x7f3e80100330 2023-12-14T18:29:26.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 0x7f3e8019d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 0x7f3e8019d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59092/0 (socket says 172.21.15.69:59092) 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 -- 172.21.15.69:0/4192693899 learned_addr learned my addr 172.21.15.69:0/4192693899 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800ff140 0x7f3e80195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e80100330 0x7f3e80196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 -- 172.21.15.69:0/4192693899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e80100330 msgr2=0x7f3e80196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e80100330 0x7f3e80196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 -- 172.21.15.69:0/4192693899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800ff140 msgr2=0x7f3e80195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800ff140 0x7f3e80195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 -- 172.21.15.69:0/4192693899 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740095f0 con 0x7f3e80100cc0 2023-12-14T18:29:26.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e80100330 0x7f3e80196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800ff140 0x7f3e80195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 0x7f3e8019d4a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800ef30 tx=0x7f3e7800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7d7fa700 1 -- 172.21.15.69:0/4192693899 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78018070 con 0x7f3e80100cc0 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8010ba90 con 0x7f3e80100cc0 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7d7fa700 1 -- 172.21.15.69:0/4192693899 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e7800f040 con 0x7f3e80100cc0 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e7d7fa700 1 -- 172.21.15.69:0/4192693899 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78003d00 con 0x7f3e80100cc0 2023-12-14T18:29:26.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.748+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8010b900 con 0x7f3e80100cc0 2023-12-14T18:29:26.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.751+0000 7f3e7d7fa700 1 -- 172.21.15.69:0/4192693899 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3e7800caa0 con 0x7f3e80100cc0 2023-12-14T18:29:26.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.751+0000 7f3e7d7fa700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3e680a1150 0x7f3e680a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.751+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3e680a1150 0x7f3e680a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.751+0000 7f3e7d7fa700 1 -- 172.21.15.69:0/4192693899 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3e780cc630 con 0x7f3e80100cc0 2023-12-14T18:29:26.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3e680a1150 0x7f3e680a3600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e80100190 tx=0x7f3e70005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 Processor -- start 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 -- start start 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b8a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b8b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b8c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6a735e0 con 0x5627c6b8ae50 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6ae2870 con 0x5627c6b8bd00 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6adbd00 con 0x5627c6b8a500 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b8b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b8b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59098/0 (socket says 172.21.15.69:59098) 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.752+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2521940440 learned_addr learned my addr 172.21.15.69:0/2521940440 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b8a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b8c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2521940440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 msgr2=0x5627c6b8a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b8a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2521940440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 msgr2=0x5627c6b8c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b8c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2521940440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c695d3b0 con 0x5627c6b8ae50 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b8a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b8b770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400b2e0 tx=0x7f3e74005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8782df2ba40a1b9e server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e667fc700 1 -- 172.21.15.69:0/2521940440 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7401e070 con 0x5627c6b8ae50 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e667fc700 1 -- 172.21.15.69:0/2521940440 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e740054c0 con 0x5627c6b8ae50 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.753+0000 7f3e667fc700 1 -- 172.21.15.69:0/2521940440 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400b6b0 con 0x5627c6b8ae50 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2521940440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 msgr2=0x5627c6b8b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b8b770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400b2e0 tx=0x7f3e74005c00 comp rx=0 tx=0).stop 2023-12-14T18:29:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2521940440 shutdown_connections 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b8c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b8a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2521940440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b8b770 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2521940440 >> 172.21.15.69:0/2521940440 conn(0x5627c6b7fca0 msgr2=0x5627c6b85430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2521940440 shutdown_connections 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2521940440 wait complete. 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 -- start start 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 Processor -- start 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.754+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b94050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b94590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6a77f90 con 0x5627c6b8a500 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6a77c30 con 0x5627c6b8bd00 2023-12-14T18:29:26.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c695f6a0 con 0x5627c6b8ae50 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 10 client.0 _ll_register_callbacks cb 0x5627c6a9b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b94050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b94050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59104/0 (socket says 172.21.15.69:59104) 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 -- 172.21.15.69:0/310116732 learned_addr learned my addr 172.21.15.69:0/310116732 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b94590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 -- 172.21.15.69:0/310116732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 msgr2=0x5627c6b94590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b94590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 -- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 msgr2=0x5627c6b9b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 -- 172.21.15.69:0/310116732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e80107eb0 con 0x5627c6b8a500 2023-12-14T18:29:26.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b94050 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3e70010a60 tx=0x7f3e70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b0277cdf27007 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/310116732 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000e920 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/310116732 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3e7000fc60 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627c6b7d2b0 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/310116732 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e7000eed0 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 10 client.15792 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.755+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5627c6aa2170 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/310116732 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627c6b7d2b0 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/310116732 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3e7002f070 con 0x5627c6b8a500 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e92bd3b80 10 client.15792 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e92bd3b80 10 client.15792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:29:26.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e92bd3b80 20 client.15792 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6b9feb0 0x5627c6ba22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e92bd3b80 4 client.15792 mds_command: new command op to 24482 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627c6ad4ce0 con 0x5627c6b9feb0 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6b9feb0 0x5627c6ba22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e5f7fe700 10 client.15792 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.756+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6b9feb0 0x5627c6ba22c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ce05e52a9201c44 server_cookie=b6f7567ef4c4c694 in_seq=0 out_seq=0 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/310116732 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5627c6ad4ce0 con 0x5627c6b9feb0 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e5f7fe700 10 client.15792 handle_command_reply: tid=0 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 client.15792 shutdown 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 msgr2=0x5627c6b94050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b94050 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3e70010a60 tx=0x7f3e70004750 comp rx=0 tx=0).stop 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 shutdown_connections 2023-12-14T18:29:26.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6b9feb0 0x5627c6ba22c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b94050 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e5f7fe700 0 client.15792 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/310116732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b94590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 >> 172.21.15.69:0/310116732 conn(0x5627c6b7fca0 msgr2=0x5627c6b83f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 shutdown_connections 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/310116732 wait complete. 2023-12-14T18:29:26.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.757+0000 7f3e92bd3b80 20 client.15792 trim_cache size 0 max 16384 2023-12-14T18:29:26.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 Processor -- start 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 -- start start 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b849d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b9b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b920b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6b935d0 con 0x5627c6b8a500 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6b8b5f0 con 0x5627c6b8bd00 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6b8bba0 con 0x5627c6b8ae50 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.770+0000 7f3e7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b849d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b849d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59114/0 (socket says 172.21.15.69:59114) 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 -- 172.21.15.69:0/1384863997 learned_addr learned my addr 172.21.15.69:0/1384863997 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b9b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 -- 172.21.15.69:0/1384863997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 msgr2=0x5627c6b9b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b9b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 -- 172.21.15.69:0/1384863997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 msgr2=0x5627c6b920b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b920b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 -- 172.21.15.69:0/1384863997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c6aa1ec0 con 0x5627c6b8a500 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b849d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000ea50 tx=0x7f3e7000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaef3179cf9a517 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e66ffd700 1 -- 172.21.15.69:0/1384863997 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e700056d0 con 0x5627c6b8a500 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e66ffd700 1 -- 172.21.15.69:0/1384863997 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e7002c070 con 0x5627c6b8a500 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.771+0000 7f3e66ffd700 1 -- 172.21.15.69:0/1384863997 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70031c40 con 0x5627c6b8a500 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/1384863997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 msgr2=0x5627c6b849d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b849d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000ea50 tx=0x7f3e7000f740 comp rx=0 tx=0).stop 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/1384863997 shutdown_connections 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b920b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8a500 0x5627c6b849d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/1384863997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8ae50 0x5627c6b9b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/1384863997 >> 172.21.15.69:0/1384863997 conn(0x5627c6b7fca0 msgr2=0x5627c6b85280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/1384863997 shutdown_connections 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/1384863997 wait complete. 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 -- start start 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.772+0000 7f3e92bd3b80 1 Processor -- start 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b97300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b97840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6b9ada0 con 0x5627c6b8ae50 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6b9af10 con 0x5627c6b8bd00 2023-12-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c6b9b0d0 con 0x5627c6b8a500 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 10 client.0 _ll_register_callbacks cb 0x7f3e7000ee20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b97840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b97840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59124/0 (socket says 172.21.15.69:59124) 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2396279506 learned_addr learned my addr 172.21.15.69:0/2396279506 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b97300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e84fe2700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2396279506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 msgr2=0x5627c6b97300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b97300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 msgr2=0x5627c6b9a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 -- 172.21.15.69:0/2396279506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627c6aa2170 con 0x5627c6b8ae50 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b97300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e7f7fe700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b97840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3e74003ec0 tx=0x7f3e7400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de46cba47aca6ca server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/2396279506 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7401e040 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/2396279506 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3e74003780 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.773+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e740054c0 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/2396279506 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e74003940 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 10 client.15798 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5627c6a889a0 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/2396279506 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e740054c0 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/2396279506 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3e740099c0 con 0x5627c6b8ae50 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 10 client.15798 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 10 client.15798 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 20 client.15798 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6bf4990 0x5627c6bf6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 4 client.15798 mds_command: new command op to 24482 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627c6ad4a00 con 0x5627c6bf4990 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.774+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6bf4990 0x5627c6bf6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e5f7fe700 10 client.15798 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e7ffff700 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6bf4990 0x5627c6bf6da0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be57e5ee0014113b server_cookie=87ad6699f3a2cd3b in_seq=0 out_seq=0 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e5f7fe700 1 -- 172.21.15.69:0/2396279506 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627c6ad4a00 con 0x5627c6bf4990 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e5f7fe700 10 client.15798 handle_command_reply: tid=0 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 client.15798 shutdown 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 msgr2=0x5627c6b97840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b97840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3e74003ec0 tx=0x7f3e7400b3c0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 shutdown_connections 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x5627c6bf4990 0x5627c6bf6da0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5627c6b8bd00 0x5627c6b9a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5627c6b8a500 0x5627c6b97300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 --2- 172.21.15.69:0/2396279506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627c6b8ae50 0x5627c6b97840 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 >> 172.21.15.69:0/2396279506 conn(0x5627c6b7fca0 msgr2=0x5627c6b8ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e5f7fe700 0 client.15798 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 shutdown_connections 2023-12-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 1 -- 172.21.15.69:0/2396279506 wait complete. 2023-12-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.775+0000 7f3e92bd3b80 20 client.15798 trim_cache size 0 max 16384 2023-12-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3e680a1150 msgr2=0x7f3e680a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3e680a1150 0x7f3e680a3600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e80100190 tx=0x7f3e70005f90 comp rx=0 tx=0).stop 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 msgr2=0x7f3e8019d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 0x7f3e8019d4a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800ef30 tx=0x7f3e7800c450 comp rx=0 tx=0).stop 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 shutdown_connections 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3e680a1150 0x7f3e680a3600 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e80100cc0 0x7f3e8019d4a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800ff140 0x7f3e80195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 --2- 172.21.15.69:0/4192693899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e80100330 0x7f3e80196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 >> 172.21.15.69:0/4192693899 conn(0x7f3e800fa780 msgr2=0x7f3e800fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 shutdown_connections 2023-12-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.776+0000 7f3e86a45700 1 -- 172.21.15.69:0/4192693899 wait complete. 2023-12-14T18:29:26.789 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T18:29:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:26 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1804756697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:29:26.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:26 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1804756697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:29:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 -- 172.21.15.69:0/651021026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 msgr2=0x7f00980fe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 --2- 172.21.15.69:0/651021026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f00980fe6d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0088009990 tx=0x7f0088009ca0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 -- 172.21.15.69:0/651021026 shutdown_connections 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 --2- 172.21.15.69:0/651021026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00980fec10 0x7f00981087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 --2- 172.21.15.69:0/651021026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 0x7f0098101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 --2- 172.21.15.69:0/651021026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f00980fe6d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 -- 172.21.15.69:0/651021026 >> 172.21.15.69:0/651021026 conn(0x7f00980f9eb0 msgr2=0x7f00980fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 -- 172.21.15.69:0/651021026 shutdown_connections 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.910+0000 7f009dbcf700 1 -- 172.21.15.69:0/651021026 wait complete. 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 Processor -- start 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 -- start start 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f0098195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00980fec10 0x7f0098196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 0x7f009819d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009819d9b0 con 0x7f00980fe280 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009819daf0 con 0x7f0098101810 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f009dbcf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009819dc80 con 0x7f00980fec10 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f0098195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f0098195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59142/0 (socket says 172.21.15.69:59142) 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 -- 172.21.15.69:0/2852812839 learned_addr learned my addr 172.21.15.69:0/2852812839 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f0096ffd700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00980fec10 0x7f0098196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 -- 172.21.15.69:0/2852812839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00980fec10 msgr2=0x7f0098196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f0097fff700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 0x7f009819d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00980fec10 0x7f0098196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 -- 172.21.15.69:0/2852812839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 msgr2=0x7f009819d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 0x7f009819d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 -- 172.21.15.69:0/2852812839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880095f0 con 0x7f00980fe280 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f0097fff700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 0x7f009819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.911+0000 7f00977fe700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f0098195e30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f008000e970 tx=0x7f008000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.912+0000 7f0094ff9700 1 -- 172.21.15.69:0/2852812839 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080009790 con 0x7f00980fe280 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.912+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009810ba30 con 0x7f00980fe280 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.912+0000 7f0094ff9700 1 -- 172.21.15.69:0/2852812839 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00800044b0 con 0x7f00980fe280 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.912+0000 7f0094ff9700 1 -- 172.21.15.69:0/2852812839 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080003dd0 con 0x7f00980fe280 2023-12-14T18:29:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.912+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009810b8a0 con 0x7f00980fe280 2023-12-14T18:29:26.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.914+0000 7f0094ff9700 1 -- 172.21.15.69:0/2852812839 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0080003f30 con 0x7f00980fe280 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.914+0000 7f0094ff9700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f00840a1150 0x7f00840a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.915+0000 7f0096ffd700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f00840a1150 0x7f00840a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.915+0000 7f0094ff9700 1 -- 172.21.15.69:0/2852812839 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0080014070 con 0x7f00980fe280 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.915+0000 7f0096ffd700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f00840a1150 0x7f00840a3600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0088006010 tx=0x7f008800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.915+0000 7f00a9d5db80 1 Processor -- start 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.915+0000 7f00a9d5db80 1 -- start start 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfbfbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfbfc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfadf5e0 con 0x55e3bfbfa910 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfb4e870 con 0x55e3bfbfc110 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfb47d00 con 0x55e3bfbfb260 2023-12-14T18:29:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59156/0 (socket says 172.21.15.69:59156) 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 -- 172.21.15.69:0/3496710958 learned_addr learned my addr 172.21.15.69:0/3496710958 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 -- 172.21.15.69:0/3496710958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 msgr2=0x55e3bfbfbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfbfbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 -- 172.21.15.69:0/3496710958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 msgr2=0x55e3bfbfc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f0097fff700 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfbfc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfbfc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 -- 172.21.15.69:0/3496710958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3bf9c93b0 con 0x55e3bfbfa910 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f00977fe700 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfad20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f00800a1fa0 tx=0x7f0080099c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42418a3230aad303 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f008dffb700 1 -- 172.21.15.69:0/3496710958 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008009a080 con 0x55e3bfbfa910 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f008dffb700 1 -- 172.21.15.69:0/3496710958 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f008009e0b0 con 0x55e3bfbfa910 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.916+0000 7f008dffb700 1 -- 172.21.15.69:0/3496710958 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008009a2e0 con 0x55e3bfbfa910 2023-12-14T18:29:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3496710958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 msgr2=0x55e3bfbfad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfad20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f00800a1fa0 tx=0x7f0080099c40 comp rx=0 tx=0).stop 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3496710958 shutdown_connections 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfbfc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfad20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3496710958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfbfbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3496710958 >> 172.21.15.69:0/3496710958 conn(0x55e3bfbebca0 msgr2=0x55e3bfbf1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3496710958 shutdown_connections 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3496710958 wait complete. 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.917+0000 7f00a9d5db80 1 -- start start 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 Processor -- start 2023-12-14T18:29:26.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfa910 0x55e3bfc04590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 0x55e3bfc04ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfae3f90 con 0x55e3bfbfb260 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfae3c30 con 0x55e3bfbfc110 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bf9cb6a0 con 0x55e3bfbfa910 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 10 client.0 _ll_register_callbacks cb 0x55e3bfb07910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 0x55e3bfc04ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 0x55e3bfc04ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59160/0 (socket says 172.21.15.69:59160) 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 -- 172.21.15.69:0/3192105759 learned_addr learned my addr 172.21.15.69:0/3192105759 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00977fe700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfa910 0x55e3bfc04590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0097fff700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 -- 172.21.15.69:0/3192105759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfa910 msgr2=0x55e3bfc04590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfa910 0x55e3bfc04590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 -- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 msgr2=0x55e3bfc0bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 -- 172.21.15.69:0/3192105759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009810b8a0 con 0x55e3bfbfb260 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0096ffd700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 0x55e3bfc04ad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0088015000 tx=0x7f0088009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde051296c632693 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0076ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0076ffd700 1 -- 172.21.15.69:0/3192105759 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008802b070 con 0x55e3bfbfb260 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f0076ffd700 1 -- 172.21.15.69:0/3192105759 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00880041d0 con 0x55e3bfbfb260 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.918+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3bfbe92b0 con 0x55e3bfbfb260 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f0076ffd700 1 -- 172.21.15.69:0/3192105759 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f008800b920 con 0x55e3bfbfb260 2023-12-14T18:29:26.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 10 client.15810 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e3bfb0e170 con 0x55e3bfbfb260 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f0076ffd700 1 -- 172.21.15.69:0/3192105759 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e3bfbe92b0 con 0x55e3bfbfb260 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f0076ffd700 1 -- 172.21.15.69:0/3192105759 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0088004cd0 con 0x55e3bfbfb260 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 10 client.15810 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 20 client.15810 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc10460 0x55e3bfc12870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 4 client.15810 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3bfb40ce0 con 0x55e3bfc10460 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.919+0000 7f00977fe700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc10460 0x55e3bfc12870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f0076ffd700 10 client.15810 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00977fe700 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc10460 0x55e3bfc12870 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9e2328a5b6410a server_cookie=e15537fabe4b172e in_seq=0 out_seq=0 2023-12-14T18:29:26.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f0076ffd700 1 -- 172.21.15.69:0/3192105759 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e3bfb40ce0 con 0x55e3bfc10460 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f0076ffd700 10 client.15810 handle_command_reply: tid=0 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 client.15810 shutdown 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 msgr2=0x55e3bfc04ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 0x55e3bfc04ad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0088015000 tx=0x7f0088009310 comp rx=0 tx=0).stop 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 shutdown_connections 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc10460 0x55e3bfc12870 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f0076ffd700 0 client.15810 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfa910 0x55e3bfc04590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/3192105759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfb260 0x55e3bfc04ad0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 >> 172.21.15.69:0/3192105759 conn(0x55e3bfbebca0 msgr2=0x55e3bfbeff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 shutdown_connections 2023-12-14T18:29:26.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.920+0000 7f00a9d5db80 1 -- 172.21.15.69:0/3192105759 wait complete. 2023-12-14T18:29:26.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.921+0000 7f00a9d5db80 20 client.15810 trim_cache size 0 max 16384 2023-12-14T18:29:26.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 Processor -- start 2023-12-14T18:29:26.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 -- start start 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc0bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 0x55e3bfc02560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfc0d780 con 0x55e3bfbfc110 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfbf2550 con 0x55e3bfbfa910 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfc02310 con 0x55e3bfbfb260 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f0097fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 0x55e3bfc02560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f0097fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 0x55e3bfc02560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59162/0 (socket says 172.21.15.69:59162) 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.933+0000 7f0097fff700 1 -- 172.21.15.69:0/1469675857 learned_addr learned my addr 172.21.15.69:0/1469675857 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0096ffd700 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc0bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f00977fe700 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0097fff700 1 -- 172.21.15.69:0/1469675857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 msgr2=0x55e3bfc0bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0097fff700 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc0bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0097fff700 1 -- 172.21.15.69:0/1469675857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfa910 msgr2=0x55e3bfbfc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0097fff700 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0097fff700 1 -- 172.21.15.69:0/1469675857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3bfb0dec0 con 0x55e3bfbfc110 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f0097fff700 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 0x55e3bfc02560 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f00900102c0 tx=0x7f00900105d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34da40a0f665498 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f008e7fc700 1 -- 172.21.15.69:0/1469675857 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090014620 con 0x55e3bfbfc110 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f008e7fc700 1 -- 172.21.15.69:0/1469675857 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f009000d040 con 0x55e3bfbfc110 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.934+0000 7f008e7fc700 1 -- 172.21.15.69:0/1469675857 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090013990 con 0x55e3bfbfc110 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- 172.21.15.69:0/1469675857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 msgr2=0x55e3bfc02560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 0x55e3bfc02560 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f00900102c0 tx=0x7f00900105d0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- 172.21.15.69:0/1469675857 shutdown_connections 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfc110 0x55e3bfc02560 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfa910 0x55e3bfbfc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/1469675857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc0bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- 172.21.15.69:0/1469675857 >> 172.21.15.69:0/1469675857 conn(0x55e3bfbebca0 msgr2=0x55e3bfc032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- 172.21.15.69:0/1469675857 shutdown_connections 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- 172.21.15.69:0/1469675857 wait complete. 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- start start 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 Processor -- start 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfc09a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc09fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfc0b520 con 0x55e3bfbfa910 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfc0b690 con 0x55e3bfbfc110 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3bfc0b800 con 0x55e3bfbfb260 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00a9d5db80 10 client.0 _ll_register_callbacks cb 0x7f00880057b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.935+0000 7f00977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfc09a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfc09a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59168/0 (socket says 172.21.15.69:59168) 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 -- 172.21.15.69:0/342991337 learned_addr learned my addr 172.21.15.69:0/342991337 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0096ffd700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc09fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0097fff700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 -- 172.21.15.69:0/342991337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 msgr2=0x55e3bfc09fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc09fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 -- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 msgr2=0x55e3bfc0afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 -- 172.21.15.69:0/342991337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0090007ce0 con 0x55e3bfbfa910 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00977fe700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfc09a90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f008009a010 tx=0x7f008000b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c12d38b7feab47 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0076ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0076ffd700 1 -- 172.21.15.69:0/342991337 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080098490 con 0x55e3bfbfa910 2023-12-14T18:29:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f008009e0b0 con 0x55e3bfbfa910 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0076ffd700 1 -- 172.21.15.69:0/342991337 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f008009a080 con 0x55e3bfbfa910 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0076ffd700 1 -- 172.21.15.69:0/342991337 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00800041e0 con 0x55e3bfbfa910 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 10 client.15816 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e3bfaf49a0 con 0x55e3bfbfa910 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0076ffd700 1 -- 172.21.15.69:0/342991337 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f008009e0b0 con 0x55e3bfbfa910 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f0076ffd700 1 -- 172.21.15.69:0/342991337 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f008009a2e0 con 0x55e3bfbfa910 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 10 client.15816 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 20 client.15816 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc65090 0x55e3bfc67470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 4 client.15816 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.936+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e3bfb40a00 con 0x55e3bfc65090 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f0096ffd700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc65090 0x55e3bfc67470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:26.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f0076ffd700 10 client.15816 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f0096ffd700 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc65090 0x55e3bfc67470 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0cf8d28b15fd7f server_cookie=b51fba1a976a2223 in_seq=0 out_seq=0 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f0076ffd700 1 -- 172.21.15.69:0/342991337 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e3bfb40a00 con 0x55e3bfc65090 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f0076ffd700 10 client.15816 handle_command_reply: tid=0 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 client.15816 shutdown 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 msgr2=0x55e3bfc09a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfc09a90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f008009a010 tx=0x7f008000b400 comp rx=0 tx=0).stop 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 shutdown_connections 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55e3bfc65090 0x55e3bfc67470 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e3bfbfc110 0x55e3bfc0afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e3bfbfa910 0x55e3bfc09a90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f0076ffd700 0 client.15816 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 --2- 172.21.15.69:0/342991337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e3bfbfb260 0x55e3bfc09fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 >> 172.21.15.69:0/342991337 conn(0x55e3bfbebca0 msgr2=0x55e3bfc02560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 shutdown_connections 2023-12-14T18:29:26.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.937+0000 7f00a9d5db80 1 -- 172.21.15.69:0/342991337 wait complete. 2023-12-14T18:29:26.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f00a9d5db80 20 client.15816 trim_cache size 0 max 16384 2023-12-14T18:29:26.947 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f00840a1150 msgr2=0x7f00840a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f00840a1150 0x7f00840a3600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0088006010 tx=0x7f008800b260 comp rx=0 tx=0).stop 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 msgr2=0x7f0098195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f0098195e30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f008000e970 tx=0x7f008000ed30 comp rx=0 tx=0).stop 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 shutdown_connections 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f00840a1150 0x7f00840a3600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0098101810 0x7f009819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00980fe280 0x7f0098195e30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 --2- 172.21.15.69:0/2852812839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00980fec10 0x7f0098196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 >> 172.21.15.69:0/2852812839 conn(0x7f00980f9eb0 msgr2=0x7f0098104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 shutdown_connections 2023-12-14T18:29:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:26.938+0000 7f009dbcf700 1 -- 172.21.15.69:0/2852812839 wait complete. 2023-12-14T18:29:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:27 smithi119 ceph-mon[43973]: pgmap v401: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 10 op/s 2023-12-14T18:29:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:27 smithi091 ceph-mon[43601]: pgmap v401: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 10 op/s 2023-12-14T18:29:27.953 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-14T18:29:27.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-14T18:29:27.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:27 smithi069 ceph-mon[42047]: pgmap v401: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 10 op/s 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 -- 172.21.15.69:0/888524467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908105f00 msgr2=0x7ff908108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 --2- 172.21.15.69:0/888524467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908105f00 0x7ff908108360 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff90000b0a0 tx=0x7ff90000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 -- 172.21.15.69:0/888524467 shutdown_connections 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 --2- 172.21.15.69:0/888524467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908105f00 0x7ff908108360 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 --2- 172.21.15.69:0/888524467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff908100cc0 0x7ff9081030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 --2- 172.21.15.69:0/888524467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9081035e0 0x7ff9081059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 -- 172.21.15.69:0/888524467 >> 172.21.15.69:0/888524467 conn(0x7ff9080fa740 msgr2=0x7ff9080fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 -- 172.21.15.69:0/888524467 shutdown_connections 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.090+0000 7ff90e95a700 1 -- 172.21.15.69:0/888524467 wait complete. 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 Processor -- start 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 -- start start 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 0x7ff9081981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9081035e0 0x7ff9081986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff908105f00 0x7ff90819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819fd30 con 0x7ff908100cc0 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819fe70 con 0x7ff908105f00 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff90e95a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9081a0000 con 0x7ff9081035e0 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff907fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 0x7ff9081981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff907fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 0x7ff9081981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59184/0 (socket says 172.21.15.69:59184) 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff907fff700 1 -- 172.21.15.69:0/832533377 learned_addr learned my addr 172.21.15.69:0/832533377 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.091+0000 7ff9077fe700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9081035e0 0x7ff9081986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff907fff700 1 -- 172.21.15.69:0/832533377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9081035e0 msgr2=0x7ff9081986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff90cef7700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff908105f00 0x7ff90819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff907fff700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9081035e0 0x7ff9081986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff907fff700 1 -- 172.21.15.69:0/832533377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff908105f00 msgr2=0x7ff90819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff907fff700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff908105f00 0x7ff90819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff907fff700 1 -- 172.21.15.69:0/832533377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900009d00 con 0x7ff908100cc0 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff90cef7700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff908105f00 0x7ff90819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff907fff700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 0x7ff9081981b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800d950 tx=0x7ff8f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff9057fa700 1 -- 172.21.15.69:0/832533377 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8009940 con 0x7ff908100cc0 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff9057fa700 1 -- 172.21.15.69:0/832533377 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8f8010460 con 0x7ff908100cc0 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90810bb00 con 0x7ff908100cc0 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff9057fa700 1 -- 172.21.15.69:0/832533377 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800f620 con 0x7ff908100cc0 2023-12-14T18:29:28.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.092+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90810b970 con 0x7ff908100cc0 2023-12-14T18:29:28.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.094+0000 7ff9057fa700 1 -- 172.21.15.69:0/832533377 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff8f80105d0 con 0x7ff908100cc0 2023-12-14T18:29:28.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.094+0000 7ff9057fa700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8f00a1150 0x7ff8f00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff9077fe700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8f00a1150 0x7ff8f00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff9057fa700 1 -- 172.21.15.69:0/832533377 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff8f80cc750 con 0x7ff908100cc0 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff9077fe700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8f00a1150 0x7ff8f00a3600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005950 tx=0x7ff8fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff91aae8b80 1 Processor -- start 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff91aae8b80 1 -- start start 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 0x563df558a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.095+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df558b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df558c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5473660 con 0x563df558a580 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df54e28f0 con 0x563df558bd80 2023-12-14T18:29:28.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df54dbd80 con 0x563df558aed0 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 0x563df558a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 0x563df558a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59194/0 (socket says 172.21.15.69:59194) 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 -- 172.21.15.69:0/1036584471 learned_addr learned my addr 172.21.15.69:0/1036584471 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff9077fe700 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df558b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff90cef7700 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df558c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 -- 172.21.15.69:0/1036584471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 msgr2=0x563df558b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df558b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 -- 172.21.15.69:0/1036584471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 msgr2=0x563df558c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df558c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 -- 172.21.15.69:0/1036584471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563df535d430 con 0x563df558a580 2023-12-14T18:29:28.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff90cef7700 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df558c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff907fff700 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 0x563df558a990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8096070 tx=0x7ff8f80994d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1193d2b9b9bb3ec server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff8ee7fc700 1 -- 172.21.15.69:0/1036584471 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8099b70 con 0x563df558a580 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff8ee7fc700 1 -- 172.21.15.69:0/1036584471 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8f809dba0 con 0x563df558a580 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.096+0000 7ff8ee7fc700 1 -- 172.21.15.69:0/1036584471 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80a1b30 con 0x563df558a580 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 -- 172.21.15.69:0/1036584471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 msgr2=0x563df558a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 0x563df558a990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8096070 tx=0x7ff8f80994d0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 -- 172.21.15.69:0/1036584471 shutdown_connections 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df558c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558a580 0x563df558a990 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/1036584471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df558b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 -- 172.21.15.69:0/1036584471 >> 172.21.15.69:0/1036584471 conn(0x563df557fd20 msgr2=0x563df55854b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 -- 172.21.15.69:0/1036584471 shutdown_connections 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 -- 172.21.15.69:0/1036584471 wait complete. 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 -- start start 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.097+0000 7ff91aae8b80 1 Processor -- start 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 0x563df559b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5478010 con 0x563df558bd80 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5477cb0 con 0x563df558a580 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df535f720 con 0x563df558aed0 2023-12-14T18:29:28.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 10 client.0 _ll_register_callbacks cb 0x563df549b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 0x563df559b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 0x563df559b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59208/0 (socket says 172.21.15.69:59208) 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 -- 172.21.15.69:0/2359193821 learned_addr learned my addr 172.21.15.69:0/2359193821 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff907fff700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff9077fe700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 -- 172.21.15.69:0/2359193821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 msgr2=0x563df5594590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 -- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 msgr2=0x563df5594050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 -- 172.21.15.69:0/2359193821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90810b970 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff9077fe700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff90cef7700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 0x563df559b5d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff90000b070 tx=0x7ff9000093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984b021267c0789b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff8e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff8e77fe700 1 -- 172.21.15.69:0/2359193821 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000e050 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff8e77fe700 1 -- 172.21.15.69:0/2359193821 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff900005040 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.098+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563df557d330 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff8e77fe700 1 -- 172.21.15.69:0/2359193821 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff900004e60 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 10 client.15828 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563df54a21f0 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff8e77fe700 1 -- 172.21.15.69:0/2359193821 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563df557d330 con 0x563df558bd80 2023-12-14T18:29:28.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff8e77fe700 1 -- 172.21.15.69:0/2359193821 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff90000b0d0 con 0x563df558bd80 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 10 client.15828 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 20 client.15828 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df559fde0 0x563df55a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 4 client.15828 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563df54d4d60 con 0x563df559fde0 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.099+0000 7ff907fff700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df559fde0 0x563df55a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.100+0000 7ff8e77fe700 10 client.15828 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.100+0000 7ff907fff700 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df559fde0 0x563df55a21f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a646565e8e8a0a90 server_cookie=1d9a756318b83948 in_seq=0 out_seq=0 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.100+0000 7ff8e77fe700 1 -- 172.21.15.69:0/2359193821 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563df54d4d60 con 0x563df559fde0 2023-12-14T18:29:28.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.100+0000 7ff8e77fe700 10 client.15828 handle_command_reply: tid=0 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.100+0000 7ff91aae8b80 1 client.15828 shutdown 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 msgr2=0x563df559b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 0x563df559b5d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff90000b070 tx=0x7ff9000093b0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 shutdown_connections 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df559fde0 0x563df55a21f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558bd80 0x563df559b5d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff8e77fe700 0 client.15828 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/2359193821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 >> 172.21.15.69:0/2359193821 conn(0x563df557fd20 msgr2=0x563df5583fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 shutdown_connections 2023-12-14T18:29:28.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 1 -- 172.21.15.69:0/2359193821 wait complete. 2023-12-14T18:29:28.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.101+0000 7ff91aae8b80 20 client.15828 trim_cache size 0 max 16384 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.117+0000 7ff91aae8b80 1 Processor -- start 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 -- start start 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df559b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df55935a0 con 0x563df558aed0 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5586760 con 0x563df558bd80 2023-12-14T18:29:28.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df558ba00 con 0x563df558a580 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59216/0 (socket says 172.21.15.69:59216) 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 -- 172.21.15.69:0/4183296633 learned_addr learned my addr 172.21.15.69:0/4183296633 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff907fff700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff90cef7700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df559b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 -- 172.21.15.69:0/4183296633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558a580 msgr2=0x563df5594050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 -- 172.21.15.69:0/4183296633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 msgr2=0x563df559b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df559b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 -- 172.21.15.69:0/4183296633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563df54a1f40 con 0x563df558aed0 2023-12-14T18:29:28.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff907fff700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff90cef7700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df559b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff9077fe700 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5594590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc011000 tx=0x7ff8fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1243ab76e84dc9c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff8eeffd700 1 -- 172.21.15.69:0/4183296633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc028630 con 0x563df558aed0 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff8eeffd700 1 -- 172.21.15.69:0/4183296633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8fc015070 con 0x563df558aed0 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.118+0000 7ff8eeffd700 1 -- 172.21.15.69:0/4183296633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0277c0 con 0x563df558aed0 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4183296633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 msgr2=0x563df5594590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5594590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc011000 tx=0x7ff8fc013000 comp rx=0 tx=0).stop 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4183296633 shutdown_connections 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558bd80 0x563df559b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558a580 0x563df5594050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4183296633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5594590 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4183296633 >> 172.21.15.69:0/4183296633 conn(0x563df557fd20 msgr2=0x563df558ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4183296633 shutdown_connections 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4183296633 wait complete. 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.119+0000 7ff91aae8b80 1 -- start start 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 Processor -- start 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5598670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5598bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558bd80 0x563df5599bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df559a100 con 0x563df558aed0 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df559a270 con 0x563df558a580 2023-12-14T18:29:28.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df559a430 con 0x563df558bd80 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff91aae8b80 10 client.0 _ll_register_callbacks cb 0x7ff900009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5598bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5598bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59220/0 (socket says 172.21.15.69:59220) 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 -- 172.21.15.69:0/4088173480 learned_addr learned my addr 172.21.15.69:0/4088173480 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff907fff700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5598670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 -- 172.21.15.69:0/4088173480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558bd80 msgr2=0x563df5599bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff90cef7700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558bd80 0x563df5599bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558bd80 0x563df5599bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 -- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 msgr2=0x563df5598670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5598670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 -- 172.21.15.69:0/4088173480 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc010cb0 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff90cef7700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558bd80 0x563df5599bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff9077fe700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5598bb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc01eea0 tx=0x7ff8fc0052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5376f9c082330f5b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff8e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.120+0000 7ff8e77fe700 1 -- 172.21.15.69:0/4088173480 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc02e070 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8f809dba0 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff8e77fe700 1 -- 172.21.15.69:0/4088173480 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff8fc017070 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff8e77fe700 1 -- 172.21.15.69:0/4088173480 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8fc004750 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 10 client.15834 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563df5488a20 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff8e77fe700 1 -- 172.21.15.69:0/4088173480 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8f809dba0 con 0x563df558aed0 2023-12-14T18:29:28.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff8e77fe700 1 -- 172.21.15.69:0/4088173480 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff8fc01e920 con 0x563df558aed0 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 20 client.15834 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df55f6010 0x563df55f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 4 client.15834 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563df54d4a80 con 0x563df55f6010 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.121+0000 7ff907fff700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df55f6010 0x563df55f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.122+0000 7ff8e77fe700 10 client.15834 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.122+0000 7ff907fff700 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df55f6010 0x563df55f8420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3aa857b71a738b server_cookie=1fa7049b9da38b37 in_seq=0 out_seq=0 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff8e77fe700 1 -- 172.21.15.69:0/4088173480 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563df54d4a80 con 0x563df55f6010 2023-12-14T18:29:28.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff8e77fe700 10 client.15834 handle_command_reply: tid=0 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 client.15834 shutdown 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 msgr2=0x563df5598bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5598bb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc01eea0 tx=0x7ff8fc0052c0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 shutdown_connections 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x563df55f6010 0x563df55f8420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563df558bd80 0x563df5599bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff8e77fe700 0 client.15834 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x563df558a580 0x563df5598670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 --2- 172.21.15.69:0/4088173480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563df558aed0 0x563df5598bb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 >> 172.21.15.69:0/4088173480 conn(0x563df557fd20 msgr2=0x563df558ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 shutdown_connections 2023-12-14T18:29:28.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 1 -- 172.21.15.69:0/4088173480 wait complete. 2023-12-14T18:29:28.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.123+0000 7ff91aae8b80 20 client.15834 trim_cache size 0 max 16384 2023-12-14T18:29:28.135 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:29:28.135 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2023-12-14T18:29:28.135 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "4e114eca-e31e-43c5-abb3-e2f8c715de2c", 2023-12-14T18:29:28.135 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2023-12-14T18:29:28.135 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:29:28.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8f00a1150 msgr2=0x7ff8f00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8f00a1150 0x7ff8f00a3600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005950 tx=0x7ff8fc00b410 comp rx=0 tx=0).stop 2023-12-14T18:29:28.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 msgr2=0x7ff9081981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 0x7ff9081981b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800d950 tx=0x7ff8f800dc60 comp rx=0 tx=0).stop 2023-12-14T18:29:28.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 shutdown_connections 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8f00a1150 0x7ff8f00a3600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff908105f00 0x7ff90819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff908100cc0 0x7ff9081981b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 --2- 172.21.15.69:0/832533377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9081035e0 0x7ff9081986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 >> 172.21.15.69:0/832533377 conn(0x7ff9080fa740 msgr2=0x7ff9080ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 shutdown_connections 2023-12-14T18:29:28.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.124+0000 7ff90e95a700 1 -- 172.21.15.69:0/832533377 wait complete. 2023-12-14T18:29:28.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:29:28.139 INFO:tasks.workunit.client.0.smithi069.stdout:ok 2023-12-14T18:29:28.141 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:29:28.141 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:29:28.229 INFO:tasks.workunit:Running workunit fs/misc/general_vxattrs.sh... 2023-12-14T18:29:28.229 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/general_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/general_vxattrs.sh 2023-12-14T18:29:28.296 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p dir 2023-12-14T18:29:28.298 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.pin dir 2023-12-14T18:29:28.299 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'ceph.dir.pin="-1"' 2023-12-14T18:29:28.301 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.pin="-1" 2023-12-14T18:29:28.301 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin dir 2023-12-14T18:29:28.301 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 -- 172.21.15.69:0/3592381354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 msgr2=0x7f9d80107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 --2- 172.21.15.69:0/3592381354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d80107570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800b0a0 tx=0x7f9d7800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 -- 172.21.15.69:0/3592381354 shutdown_connections 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 --2- 172.21.15.69:0/3592381354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d80107570 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 --2- 172.21.15.69:0/3592381354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d800ff130 0x7f9d800ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 --2- 172.21.15.69:0/3592381354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d80100320 0x7f9d80100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 -- 172.21.15.69:0/3592381354 >> 172.21.15.69:0/3592381354 conn(0x7f9d800fa750 msgr2=0x7f9d800fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 -- 172.21.15.69:0/3592381354 shutdown_connections 2023-12-14T18:29:28.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 -- 172.21.15.69:0/3592381354 wait complete. 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 Processor -- start 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.306+0000 7f9d86981700 1 -- start start 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d800ff130 0x7f9d80194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100320 0x7f9d801953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d8019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019ca20 con 0x7f9d80100cb0 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019cb60 con 0x7f9d800ff130 2023-12-14T18:29:28.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019ccf0 con 0x7f9d80100320 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d8019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d8019c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59232/0 (socket says 172.21.15.69:59232) 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 -- 172.21.15.69:0/2415792779 learned_addr learned my addr 172.21.15.69:0/2415792779 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d800ff130 0x7f9d80194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100320 0x7f9d801953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 -- 172.21.15.69:0/2415792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100320 msgr2=0x7f9d801953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100320 0x7f9d801953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 -- 172.21.15.69:0/2415792779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d800ff130 msgr2=0x7f9d80194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d800ff130 0x7f9d80194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 -- 172.21.15.69:0/2415792779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009d00 con 0x7f9d80100cb0 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d8019c450 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800bad0 tx=0x7f9d7800bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d7d7fa700 1 -- 172.21.15.69:0/2415792779 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800e040 con 0x7f9d80100cb0 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d7d7fa700 1 -- 172.21.15.69:0/2415792779 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d78003c00 con 0x7f9d80100cb0 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8010a950 con 0x7f9d80100cb0 2023-12-14T18:29:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d7d7fa700 1 -- 172.21.15.69:0/2415792779 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780052a0 con 0x7f9d80100cb0 2023-12-14T18:29:28.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.307+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8010a7c0 con 0x7f9d80100cb0 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.309+0000 7f9d7d7fa700 1 -- 172.21.15.69:0/2415792779 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9d7801d470 con 0x7f9d80100cb0 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.310+0000 7f9d7d7fa700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d680a1150 0x7f9d680a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.310+0000 7f9d7d7fa700 1 -- 172.21.15.69:0/2415792779 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d780cdba0 con 0x7f9d80100cb0 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.310+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d680a1150 0x7f9d680a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.310+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d680a1150 0x7f9d680a3600 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d80100180 tx=0x7f9d70009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 Processor -- start 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 -- start start 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe9277910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 0x55cbe9278770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9279170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe91605e0 con 0x55cbe9277e50 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe91cf870 con 0x55cbe9278d00 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe91c8d00 con 0x55cbe9277500 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 0x55cbe9278770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 0x55cbe9278770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59234/0 (socket says 172.21.15.69:59234) 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 -- 172.21.15.69:0/2891386227 learned_addr learned my addr 172.21.15.69:0/2891386227 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 -- 172.21.15.69:0/2891386227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 msgr2=0x55cbe9277910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe9277910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 -- 172.21.15.69:0/2891386227 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 msgr2=0x55cbe9279170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.311+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9279170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d7f7fe700 1 -- 172.21.15.69:0/2891386227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbe904a3b0 con 0x55cbe9277e50 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 0x55cbe9278770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bcf0 tx=0x7f9d74010560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63893584fc0e35ca server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d667fc700 1 -- 172.21.15.69:0/2891386227 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74015070 con 0x55cbe9277e50 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d667fc700 1 -- 172.21.15.69:0/2891386227 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d740198a0 con 0x55cbe9277e50 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d667fc700 1 -- 172.21.15.69:0/2891386227 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740187d0 con 0x55cbe9277e50 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/2891386227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 msgr2=0x55cbe9278770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 0x55cbe9278770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400bcf0 tx=0x7f9d74010560 comp rx=0 tx=0).stop 2023-12-14T18:29:28.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/2891386227 shutdown_connections 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.312+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9279170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe9277910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/2891386227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277e50 0x55cbe9278770 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/2891386227 >> 172.21.15.69:0/2891386227 conn(0x55cbe926cca0 msgr2=0x55cbe9272430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/2891386227 shutdown_connections 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/2891386227 wait complete. 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- start start 2023-12-14T18:29:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 Processor -- start 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe92811f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9281730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9288770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe9164f90 con 0x55cbe9277500 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe9164c30 con 0x55cbe9278d00 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe904c6a0 con 0x55cbe9277e50 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d92b0fb80 10 client.0 _ll_register_callbacks cb 0x55cbe9188910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe92811f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.313+0000 7f9d7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe92811f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59244/0 (socket says 172.21.15.69:59244) 2023-12-14T18:29:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 -- 172.21.15.69:0/662577407 learned_addr learned my addr 172.21.15.69:0/662577407 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9281730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9288770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 -- 172.21.15.69:0/662577407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 msgr2=0x55cbe9281730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9281730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 -- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 msgr2=0x55cbe9288770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9288770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 -- 172.21.15.69:0/662577407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7400b9a0 con 0x55cbe9277500 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9288770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:28.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe92811f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d70011fd0 tx=0x7f9d70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c80ed9e17143c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/662577407 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70004220 con 0x55cbe9277500 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/662577407 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d70004380 con 0x55cbe9277500 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbe926a2b0 con 0x55cbe9277500 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/662577407 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d7002c030 con 0x55cbe9277500 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d92b0fb80 10 client.15846 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.314+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cbe918f170 con 0x55cbe9277500 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/662577407 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cbe926a2b0 con 0x55cbe9277500 2023-12-14T18:29:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/662577407 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9d70026640 con 0x55cbe9277500 2023-12-14T18:29:28.329 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d92b0fb80 10 client.15846 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:28.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d92b0fb80 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:28.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d92b0fb80 20 client.15846 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:28.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe928cfe0 0x55cbe928f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d92b0fb80 4 client.15846 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:28.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbe91c1ce0 con 0x55cbe928cfe0 2023-12-14T18:29:28.330 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin -v 1 dir 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe928cfe0 0x55cbe928f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe928cfe0 0x55cbe928f3f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43bf8d1f1a96f40d server_cookie=1f763da399b91f55 in_seq=0 out_seq=0 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.315+0000 7f9d5f7fe700 10 client.15846 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/662577407 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cbe91c1ce0 con 0x55cbe928cfe0 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d5f7fe700 10 client.15846 handle_command_reply: tid=0 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 client.15846 shutdown 2023-12-14T18:29:28.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 msgr2=0x55cbe92811f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe92811f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d70011fd0 tx=0x7f9d70004750 comp rx=0 tx=0).stop 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 shutdown_connections 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe928cfe0 0x55cbe928f3f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe9288770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe92811f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/662577407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9281730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d5f7fe700 0 client.15846 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 >> 172.21.15.69:0/662577407 conn(0x55cbe926cca0 msgr2=0x55cbe9270f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 shutdown_connections 2023-12-14T18:29:28.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/662577407 wait complete. 2023-12-14T18:29:28.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.316+0000 7f9d92b0fb80 20 client.15846 trim_cache size 0 max 16384 2023-12-14T18:29:28.334 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.pin dir 2023-12-14T18:29:28.334 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'ceph.dir.pin="1"' 2023-12-14T18:29:28.334 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.pin="1" 2023-12-14T18:29:28.335 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.pin dir 2023-12-14T18:29:28.335 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.pin dir 2023-12-14T18:29:28.335 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'ceph.dir.pin="-1"' 2023-12-14T18:29:28.336 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.pin="-1" 2023-12-14T18:29:28.336 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.distributed dir 2023-12-14T18:29:28.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.337 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.distributed -v 1 dir 2023-12-14T18:29:28.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.pin.distributed dir 2023-12-14T18:29:28.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.random dir 2023-12-14T18:29:28.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.339 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.pin.random -v 0.01 dir 2023-12-14T18:29:28.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.pin.random dir 2023-12-14T18:29:28.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_bytes dir 2023-12-14T18:29:28.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.340 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.341 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_bytes -v 100000000 dir 2023-12-14T18:29:28.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.334+0000 7f9d92b0fb80 1 Processor -- start 2023-12-14T18:29:28.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.334+0000 7f9d92b0fb80 1 -- start start 2023-12-14T18:29:28.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe9272280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9288730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe927f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe928a3e0 con 0x55cbe9277500 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe927ef30 con 0x55cbe9278d00 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe927c820 con 0x55cbe9277e50 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe9272280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe9272280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59248/0 (socket says 172.21.15.69:59248) 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 -- 172.21.15.69:0/357215084 learned_addr learned my addr 172.21.15.69:0/357215084 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe927f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9288730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 -- 172.21.15.69:0/357215084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 msgr2=0x55cbe9288730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9288730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 -- 172.21.15.69:0/357215084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 msgr2=0x55cbe927f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe927f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 -- 172.21.15.69:0/357215084 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbe918eec0 con 0x55cbe9277500 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9288730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe9272280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d70016040 tx=0x7f9d70005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c6ac888bb9061a server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d66ffd700 1 -- 172.21.15.69:0/357215084 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7002c040 con 0x55cbe9277500 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d66ffd700 1 -- 172.21.15.69:0/357215084 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d70021070 con 0x55cbe9277500 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.335+0000 7f9d66ffd700 1 -- 172.21.15.69:0/357215084 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700038e0 con 0x55cbe9277500 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/357215084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 msgr2=0x55cbe9272280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe9272280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d70016040 tx=0x7f9d70005d40 comp rx=0 tx=0).stop 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/357215084 shutdown_connections 2023-12-14T18:29:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9278d00 0x55cbe927f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9277500 0x55cbe9272280 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/357215084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277e50 0x55cbe9288730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/357215084 >> 172.21.15.69:0/357215084 conn(0x55cbe926cca0 msgr2=0x55cbe92719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/357215084 shutdown_connections 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/357215084 wait complete. 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.336+0000 7f9d92b0fb80 1 -- start start 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 Processor -- start 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe92866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9277e50 0x55cbe9286c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 0x55cbe9287c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe9288150 con 0x55cbe9278d00 2023-12-14T18:29:28.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe92882c0 con 0x55cbe9277e50 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe9288480 con 0x55cbe9277500 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d92b0fb80 10 client.0 _ll_register_callbacks cb 0x7f9d7000e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 0x55cbe9287c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 0x55cbe9287c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59260/0 (socket says 172.21.15.69:59260) 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 -- 172.21.15.69:0/273879793 learned_addr learned my addr 172.21.15.69:0/273879793 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe92866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d7f7fe700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9277e50 0x55cbe9286c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 -- 172.21.15.69:0/273879793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 msgr2=0x55cbe92866c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe92866c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 -- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9277e50 msgr2=0x55cbe9286c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9277e50 0x55cbe9286c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 -- 172.21.15.69:0/273879793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbe918f170 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d84f1e700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 0x55cbe9287c10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9d78007950 tx=0x7f9d7809aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ada3009e9a75e16 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.337+0000 7f9d5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/273879793 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7809f080 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/273879793 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d780a3410 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d740198a0 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/273879793 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d780b8020 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 10 client.15852 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cbe91759a0 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/273879793 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d740198a0 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/273879793 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9d780b9200 con 0x55cbe9278d00 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 10 client.15852 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:28.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 20 client.15852 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe92e1b90 0x55cbe92e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 4 client.15852 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cbe91c1a00 con 0x55cbe92e1b90 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.338+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe92e1b90 0x55cbe92e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.339+0000 7f9d5f7fe700 10 client.15852 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.339+0000 7f9d7ffff700 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe92e1b90 0x55cbe92e3fa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea72e1c90ec2e1b9 server_cookie=8f5b6e22b9cbdc10 in_seq=0 out_seq=0 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.340+0000 7f9d5f7fe700 1 -- 172.21.15.69:0/273879793 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cbe91c1a00 con 0x55cbe92e1b90 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d5f7fe700 10 client.15852 handle_command_reply: tid=0 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 client.15852 shutdown 2023-12-14T18:29:28.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 msgr2=0x55cbe9287c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 0x55cbe9287c10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9d78007950 tx=0x7f9d7809aa80 comp rx=0 tx=0).stop 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 shutdown_connections 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55cbe92e1b90 0x55cbe92e3fa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbe9278d00 0x55cbe9287c10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cbe9277500 0x55cbe92866c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d5f7fe700 0 client.15852 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 --2- 172.21.15.69:0/273879793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cbe9277e50 0x55cbe9286c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 >> 172.21.15.69:0/273879793 conn(0x55cbe926cca0 msgr2=0x55cbe9272260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 shutdown_connections 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 1 -- 172.21.15.69:0/273879793 wait complete. 2023-12-14T18:29:28.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d92b0fb80 20 client.15852 trim_cache size 0 max 16384 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: "4e114eca-e31e-43c5-abb3-e2f8c715de2c": { 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "4e114eca-e31e-43c5-abb3-e2f8c715de2c", 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2023-12-14T18:29:28.355 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:29:28.356 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:29:28.356 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:29:28.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d680a1150 msgr2=0x7f9d680a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d86981700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d680a1150 0x7f9d680a3600 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d80100180 tx=0x7f9d70009260 comp rx=0 tx=0).stop 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 msgr2=0x7f9d8019c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d86981700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d8019c450 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800bad0 tx=0x7f9d7800bb00 comp rx=0 tx=0).stop 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 shutdown_connections 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.341+0000 7f9d86981700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f9d680a1150 0x7f9d680a3600 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.342+0000 7f9d86981700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d80100cb0 0x7f9d8019c450 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.342+0000 7f9d86981700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d800ff130 0x7f9d80194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.342+0000 7f9d86981700 1 --2- 172.21.15.69:0/2415792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d80100320 0x7f9d801953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.342+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 >> 172.21.15.69:0/2415792779 conn(0x7f9d800fa750 msgr2=0x7f9d800fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.342+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 shutdown_connections 2023-12-14T18:29:28.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:28.342+0000 7f9d86981700 1 -- 172.21.15.69:0/2415792779 wait complete. 2023-12-14T18:29:28.358 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.quota.max_bytes dir 2023-12-14T18:29:28.358 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_files dir 2023-12-14T18:29:28.358 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.359 INFO:tasks.cephfs.filesystem:scrub status for tag:4e114eca-e31e-43c5-abb3-e2f8c715de2c - {'path': '/', 'tag': '4e114eca-e31e-43c5-abb3-e2f8c715de2c', 'options': 'recursive,force'} 2023-12-14T18:29:28.359 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.359 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.quota.max_files -v 10000 dir 2023-12-14T18:29:28.360 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.quota.max_files dir 2023-12-14T18:29:28.364 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir dir 2023-12-14T18:29:28.381 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo OK 2023-12-14T18:29:28.382 INFO:tasks.workunit.client.0.smithi069.stdout:OK 2023-12-14T18:29:28.383 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:29:28.383 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:29:28.460 INFO:tasks.workunit:Running workunit fs/misc/i_complete_vs_rename.sh... 2023-12-14T18:29:28.460 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/i_complete_vs_rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/i_complete_vs_rename.sh 2023-12-14T18:29:28.546 INFO:tasks.workunit.client.0.smithi069.stdout:a 2023-12-14T18:29:28.546 INFO:tasks.workunit.client.0.smithi069.stdout:b 2023-12-14T18:29:28.547 INFO:tasks.workunit.client.0.smithi069.stdout:c 2023-12-14T18:29:28.547 INFO:tasks.workunit.client.0.smithi069.stdout:d 2023-12-14T18:29:28.550 INFO:tasks.workunit.client.0.smithi069.stderr:stat: cannot statx 'e': No such file or directory 2023-12-14T18:29:28.554 INFO:tasks.workunit.client.0.smithi069.stdout:attempting rename over existing file... 2023-12-14T18:29:28.570 INFO:tasks.workunit.client.0.smithi069.stdout:f 2023-12-14T18:29:28.570 INFO:tasks.workunit.client.0.smithi069.stdout:rename over existing file is okay 2023-12-14T18:29:28.570 INFO:tasks.workunit.client.0.smithi069.stdout:attempting rename over negative dentry... 2023-12-14T18:29:28.581 INFO:tasks.workunit.client.0.smithi069.stdout:e 2023-12-14T18:29:28.581 INFO:tasks.workunit.client.0.smithi069.stdout:rename over negative dentry is ok 2023-12-14T18:29:28.581 INFO:tasks.workunit.client.0.smithi069.stdout:OK 2023-12-14T18:29:28.581 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-14T18:29:28.581 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-14T18:29:28.648 INFO:tasks.workunit:Running workunit fs/misc/layout_vxattrs.sh... 2023-12-14T18:29:28.649 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/misc/layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh 2023-12-14T18:29:28.675 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool= 2023-12-14T18:29:28.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ dir=. 2023-12-14T18:29:28.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo . 2023-12-14T18:29:28.676 INFO:tasks.workunit.client.0.smithi069.stdout:. 2023-12-14T18:29:28.677 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout.pool . --only-values 2023-12-14T18:29:28.677 INFO:tasks.workunit.client.0.smithi069.stderr:.: ceph.dir.layout.pool: No such attribute 2023-12-14T18:29:28.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool= 2023-12-14T18:29:28.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ dir=./.. 2023-12-14T18:29:28.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo ./.. 2023-12-14T18:29:28.678 INFO:tasks.workunit.client.0.smithi069.stdout:./.. 2023-12-14T18:29:28.678 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout.pool ./.. --only-values 2023-12-14T18:29:28.678 INFO:tasks.workunit.client.0.smithi069.stderr:./..: ceph.dir.layout.pool: No such attribute 2023-12-14T18:29:28.679 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool= 2023-12-14T18:29:28.679 INFO:tasks.workunit.client.0.smithi069.stderr:+ dir=./../.. 2023-12-14T18:29:28.679 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.679 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo ./../.. 2023-12-14T18:29:28.679 INFO:tasks.workunit.client.0.smithi069.stdout:./../.. 2023-12-14T18:29:28.679 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout.pool ./../.. --only-values 2023-12-14T18:29:28.681 INFO:tasks.workunit.client.0.smithi069.stderr:+ datapool=cephfs_data 2023-12-14T18:29:28.681 INFO:tasks.workunit.client.0.smithi069.stderr:+ break 2023-12-14T18:29:28.681 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f file file2 2023-12-14T18:29:28.681 INFO:tasks.workunit.client.0.smithi069.stderr:+ touch file file2 2023-12-14T18:29:28.685 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T18:29:28.687 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T18:29:28.687 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data" 2023-12-14T18:29:28.687 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.687 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T18:29:28.687 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q object_size= 2023-12-14T18:29:28.689 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T18:29:28.689 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_count= 2023-12-14T18:29:28.692 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T18:29:28.692 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_unit= 2023-12-14T18:29:28.694 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout file 2023-12-14T18:29:28.694 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q pool= 2023-12-14T18:29:28.695 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file 2023-12-14T18:29:28.697 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T18:29:28.697 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.pool="cephfs_data" 2023-12-14T18:29:28.698 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file 2023-12-14T18:29:28.699 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T18:29:28.699 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.pool_namespace="" 2023-12-14T18:29:28.699 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file 2023-12-14T18:29:28.702 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T18:29:28.702 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.stripe_unit="4194304" 2023-12-14T18:29:28.702 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file 2023-12-14T18:29:28.704 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T18:29:28.704 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.stripe_count="1" 2023-12-14T18:29:28.704 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.704 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file 2023-12-14T18:29:28.706 INFO:tasks.workunit.client.0.smithi069.stdout:# file: file 2023-12-14T18:29:28.706 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.file.layout.object_size="4194304" 2023-12-14T18:29:28.707 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.707 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.bogus file 2023-12-14T18:29:28.707 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 'No such attribute' 2023-12-14T18:29:28.708 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout file 2023-12-14T18:29:28.708 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 'No such attribute' 2023-12-14T18:29:28.710 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.stripe_unit -v 1048576 file2 2023-12-14T18:29:28.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.stripe_count -v 8 file2 2023-12-14T18:29:28.720 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.object_size -v 10485760 file2 2023-12-14T18:29:28.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.pool -v cephfs_data file2 2023-12-14T18:29:28.729 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T18:29:28.729 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T18:29:28.733 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout.pool_namespace -v foons file2 2023-12-14T18:29:28.738 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T18:29:28.738 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foons 2023-12-14T18:29:28.742 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_namespace file2 2023-12-14T18:29:28.748 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T18:29:28.748 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q -v foons 2023-12-14T18:29:28.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T18:29:28.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T18:29:28.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T18:29:28.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T18:29:28.762 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T18:29:28.762 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 10485760 2023-12-14T18:29:28.766 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=4194304 stripe_count=16 object_size=41943040 pool=cephfs_data pool_namespace=foons' file2 2023-12-14T18:29:28.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T18:29:28.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 4194304 2023-12-14T18:29:28.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T18:29:28.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 16 2023-12-14T18:29:28.780 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T18:29:28.780 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 41943040 2023-12-14T18:29:28.784 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T18:29:28.784 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T18:29:28.789 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T18:29:28.789 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foons 2023-12-14T18:29:28.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v stripe_unit=1048576 file2 2023-12-14T18:29:28.798 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T18:29:28.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T18:29:28.803 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T18:29:28.803 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 16 2023-12-14T18:29:28.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T18:29:28.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 41943040 2023-12-14T18:29:28.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T18:29:28.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T18:29:28.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T18:29:28.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foons 2023-12-14T18:29:28.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=2097152 stripe_count=4 object_size=2097152 pool=cephfs_data pool_namespace=barns' file2 2023-12-14T18:29:28.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2023-12-14T18:29:28.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 2097152 2023-12-14T18:29:28.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T18:29:28.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 4 2023-12-14T18:29:28.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size file2 2023-12-14T18:29:28.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 2097152 2023-12-14T18:29:28.840 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool file2 2023-12-14T18:29:28.840 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T18:29:28.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2023-12-14T18:29:28.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q barns 2023-12-14T18:29:28.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f dir/file 2023-12-14T18:29:28.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ rmdir dir 2023-12-14T18:29:28.852 INFO:tasks.workunit.client.0.smithi069.stderr:rmdir: failed to remove 'dir': No such file or directory 2023-12-14T18:29:28.852 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.852 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir -p dir 2023-12-14T18:29:28.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -d -m - dir 2023-12-14T18:29:28.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q ceph.dir.layout 2023-12-14T18:29:28.855 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.855 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -d -m - dir 2023-12-14T18:29:28.855 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q ceph.file.layout 2023-12-14T18:29:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.856 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.858 INFO:tasks.workunit.client.0.smithi069.stderr:dir: ceph.dir.layout: No such attribute 2023-12-14T18:29:28.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-12-14T18:29:28.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.stripe_unit -v 1048576 dir 2023-12-14T18:29:28.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.stripe_count -v 8 dir 2023-12-14T18:29:28.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.object_size -v 10485760 dir 2023-12-14T18:29:28.870 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.pool -v cephfs_data dir 2023-12-14T18:29:28.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout.pool_namespace -v dirns dir 2023-12-14T18:29:28.878 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.880 INFO:tasks.workunit.client.0.smithi069.stdout:# file: dir 2023-12-14T18:29:28.880 INFO:tasks.workunit.client.0.smithi069.stdout:ceph.dir.layout="stripe_unit=1048576 stripe_count=8 object_size=10485760 pool=cephfs_data pool_namespace=dirns" 2023-12-14T18:29:28.880 INFO:tasks.workunit.client.0.smithi069.stdout: 2023-12-14T18:29:28.880 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.880 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q object_size=10485760 2023-12-14T18:29:28.883 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.883 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_count=8 2023-12-14T18:29:28.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q stripe_unit=1048576 2023-12-14T18:29:28.887 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.887 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q pool=cephfs_data 2023-12-14T18:29:28.889 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.889 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q pool_namespace=dirns 2023-12-14T18:29:28.892 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.pool dir 2023-12-14T18:29:28.892 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T18:29:28.894 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.stripe_unit dir 2023-12-14T18:29:28.894 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T18:29:28.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.stripe_count dir 2023-12-14T18:29:28.897 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T18:29:28.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.object_size dir 2023-12-14T18:29:28.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 10485760 2023-12-14T18:29:28.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout.pool_namespace dir 2023-12-14T18:29:28.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q dirns 2023-12-14T18:29:28.903 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v stripe_count=16 file2 2023-12-14T18:29:28.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T18:29:28.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 16 2023-12-14T18:29:28.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.file.layout -v 'object_size=10485760 stripe_count=8 stripe_unit=1048576 pool=cephfs_data pool_namespace=dirns' file2 2023-12-14T18:29:28.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2023-12-14T18:29:28.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T18:29:28.920 INFO:tasks.workunit.client.0.smithi069.stderr:+ touch dir/file 2023-12-14T18:29:28.923 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool dir/file 2023-12-14T18:29:28.923 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q cephfs_data 2023-12-14T18:29:28.926 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_unit dir/file 2023-12-14T18:29:28.926 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 1048576 2023-12-14T18:29:28.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.stripe_count dir/file 2023-12-14T18:29:28.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 8 2023-12-14T18:29:28.931 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.object_size dir/file 2023-12-14T18:29:28.931 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 10485760 2023-12-14T18:29:28.933 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.file.layout.pool_namespace dir/file 2023-12-14T18:29:28.933 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q dirns 2023-12-14T18:29:28.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool dir 2023-12-14T18:29:28.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.940 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool_id dir 2023-12-14T18:29:28.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.942 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool_name dir 2023-12-14T18:29:28.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.944 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.stripe_unit dir 2023-12-14T18:29:28.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.946 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.stripe_count dir 2023-12-14T18:29:28.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.948 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.948 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.object_size dir 2023-12-14T18:29:28.949 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir: Invalid argument' 2023-12-14T18:29:28.950 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir: Invalid argument 2023-12-14T18:29:28.950 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool dir/file 2023-12-14T18:29:28.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T18:29:28.952 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T18:29:28.952 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_id dir/file 2023-12-14T18:29:28.952 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T18:29:28.953 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T18:29:28.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_name dir/file 2023-12-14T18:29:28.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T18:29:28.955 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T18:29:28.955 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.stripe_unit dir/file 2023-12-14T18:29:28.955 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T18:29:28.956 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T18:29:28.956 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.stripe_count dir/file 2023-12-14T18:29:28.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T18:29:28.957 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T18:29:28.958 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.object_size dir/file 2023-12-14T18:29:28.958 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2023-12-14T18:29:28.959 INFO:tasks.workunit.client.0.smithi069.stdout:setfattr: dir/file: Invalid argument 2023-12-14T18:29:28.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.file.layout.pool_namespace dir/file 2023-12-14T18:29:28.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout.pool_namespace dir 2023-12-14T18:29:28.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q -v pool_namespace=dirns 2023-12-14T18:29:28.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -x ceph.dir.layout dir 2023-12-14T18:29:28.974 INFO:tasks.workunit.client.0.smithi069.stderr:+ getfattr -n ceph.dir.layout dir 2023-12-14T18:29:28.974 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q 'No such attribute' 2023-12-14T18:29:28.976 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout . 2023-12-14T18:29:28.976 INFO:tasks.workunit.client.0.smithi069.stderr:++ sed -n 2,2p 2023-12-14T18:29:28.978 INFO:tasks.workunit.client.0.smithi069.stderr:.: ceph.dir.layout: No such attribute 2023-12-14T18:29:28.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ DEFAULT_LAYOUT= 2023-12-14T18:29:28.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ setfattr -n ceph.dir.layout -v 'stripe_unit=131072 stripe_count=2 object_size=131072' . 2023-12-14T18:29:28.983 INFO:tasks.workunit.client.0.smithi069.stderr:++ getfattr -n ceph.dir.layout . 2023-12-14T18:29:28.983 INFO:tasks.workunit.client.0.smithi069.stderr:++ sed -n 2,2p 2023-12-14T18:29:28.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:29:28.985 INFO:tasks.workunit.client.0.smithi069.stderr:+ CHANGED_LAYOUT='ceph.dir.layout="stripe_unit=131072 stripe_count=2 object_size=131072 pool=cephfs_data"' 2023-12-14T18:29:28.985 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 'ceph.dir.layout="stripe_unit=131072 stripe_count=2 object_size=131072 pool=cephfs_data"' == 'ceph.dir.layout="stripe_unit=131072 stripe_count=2 object_size=131072 pool=cephfs.a.data"' ']' 2023-12-14T18:29:28.986 INFO:tasks.workunit:Stopping ['fs/misc'] on client.0... 2023-12-14T18:29:28.986 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-14T18:29:29.310 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' 2023-12-14T18:29:31.603 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=255174987f7d49a1805f27c96562fb7c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_chrisphoffman_ceph_bf026da9d69000f3d4a9d16360156095d6612a2d/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' 2023-12-14T18:29:31.606 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-12-14T18:29:31.615 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-12-14T18:29:31.629 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:29 smithi091 ceph-mon[43601]: scrub queued for path: / 2023-12-14T18:29:31.629 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:29 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:29 smithi091 ceph-mon[43601]: scrub summary: active paths [/] 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:29 smithi091 ceph-mon[43601]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:29 smithi091 ceph-mon[43601]: pgmap v402: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:29 smithi091 ceph-mon[43601]: scrub summary: idle 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:29 smithi119 ceph-mon[43973]: scrub queued for path: / 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:29 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:31.630 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:29 smithi119 ceph-mon[43973]: scrub summary: active paths [/] 2023-12-14T18:29:31.631 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:29 smithi119 ceph-mon[43973]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:31.631 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:29 smithi119 ceph-mon[43973]: pgmap v402: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-12-14T18:29:31.631 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:29 smithi119 ceph-mon[43973]: scrub summary: idle 2023-12-14T18:29:31.631 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:29 smithi069 ceph-mon[42047]: scrub queued for path: / 2023-12-14T18:29:31.631 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:29 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:31.631 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:29 smithi069 ceph-mon[42047]: scrub summary: active paths [/] 2023-12-14T18:29:31.632 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:29 smithi069 ceph-mon[42047]: scrub summary: idle+waiting paths [/] 2023-12-14T18:29:31.632 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:29 smithi069 ceph-mon[42047]: pgmap v402: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-12-14T18:29:31.632 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:29 smithi069 ceph-mon[42047]: scrub summary: idle 2023-12-14T18:29:31.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:31 smithi119 ceph-mon[43973]: pgmap v403: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2023-12-14T18:29:31.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:31 smithi091 ceph-mon[43601]: pgmap v403: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2023-12-14T18:29:31.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:31 smithi069 ceph-mon[42047]: pgmap v403: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2023-12-14T18:29:33.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:33 smithi119 ceph-mon[43973]: pgmap v404: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 12 op/s 2023-12-14T18:29:33.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:33 smithi091 ceph-mon[43601]: pgmap v404: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 12 op/s 2023-12-14T18:29:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:33 smithi069 ceph-mon[42047]: pgmap v404: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 12 op/s 2023-12-14T18:29:35.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: pgmap v405: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 11 op/s 2023-12-14T18:29:35.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:29:35.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:29:35.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:29:35.877 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: pgmap v405: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 11 op/s 2023-12-14T18:29:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:29:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:29:35.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:29:35.888 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: pgmap v405: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 11 op/s 2023-12-14T18:29:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:29:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:35.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:29:35.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:29:35.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:29:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:36 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:29:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:36 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:29:36.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:36 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:29:36.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:36 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:29:36.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:36 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:29:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:36 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:29:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:36 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:29:36.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:36 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:29:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:36 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:29:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:36 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:29:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:36 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:29:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:36 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:29:37.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:37 smithi119 ceph-mon[43973]: pgmap v406: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-12-14T18:29:37.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:37 smithi091 ceph-mon[43601]: pgmap v406: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-12-14T18:29:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:37 smithi069 ceph-mon[42047]: pgmap v406: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-12-14T18:29:39.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:39 smithi119 ceph-mon[43973]: pgmap v407: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2023-12-14T18:29:39.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:39 smithi091 ceph-mon[43601]: pgmap v407: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2023-12-14T18:29:39.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:39 smithi069 ceph-mon[42047]: pgmap v407: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2023-12-14T18:29:41.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:41 smithi119 ceph-mon[43973]: pgmap v408: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2023-12-14T18:29:41.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:41 smithi091 ceph-mon[43601]: pgmap v408: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2023-12-14T18:29:41.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:41 smithi069 ceph-mon[42047]: pgmap v408: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2023-12-14T18:29:43.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:43 smithi119 ceph-mon[43973]: pgmap v409: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-12-14T18:29:43.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:43 smithi091 ceph-mon[43601]: pgmap v409: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-12-14T18:29:43.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:43 smithi069 ceph-mon[42047]: pgmap v409: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-12-14T18:29:45.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:45 smithi119 ceph-mon[43973]: pgmap v410: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2023-12-14T18:29:45.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:45 smithi091 ceph-mon[43601]: pgmap v410: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2023-12-14T18:29:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:45 smithi069 ceph-mon[42047]: pgmap v410: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2023-12-14T18:29:47.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:47 smithi119 ceph-mon[43973]: pgmap v411: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T18:29:47.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:47 smithi091 ceph-mon[43601]: pgmap v411: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T18:29:47.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:47 smithi069 ceph-mon[42047]: pgmap v411: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-12-14T18:29:49.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:49 smithi119 ceph-mon[43973]: pgmap v412: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-12-14T18:29:49.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:49 smithi091 ceph-mon[43601]: pgmap v412: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-12-14T18:29:49.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:49 smithi069 ceph-mon[42047]: pgmap v412: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-12-14T18:29:51.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:51 smithi119 ceph-mon[43973]: pgmap v413: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2023-12-14T18:29:51.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:51 smithi091 ceph-mon[43601]: pgmap v413: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2023-12-14T18:29:51.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:51 smithi069 ceph-mon[42047]: pgmap v413: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2023-12-14T18:29:53.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:53 smithi119 ceph-mon[43973]: pgmap v414: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2023-12-14T18:29:53.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:53 smithi091 ceph-mon[43601]: pgmap v414: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2023-12-14T18:29:53.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:53 smithi069 ceph-mon[42047]: pgmap v414: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2023-12-14T18:29:55.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:55 smithi119 ceph-mon[43973]: pgmap v415: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2023-12-14T18:29:55.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:55 smithi091 ceph-mon[43601]: pgmap v415: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2023-12-14T18:29:55.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:55 smithi069 ceph-mon[42047]: pgmap v415: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2023-12-14T18:29:57.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:57 smithi119 ceph-mon[43973]: pgmap v416: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2023-12-14T18:29:57.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:57 smithi091 ceph-mon[43601]: pgmap v416: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2023-12-14T18:29:57.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:57 smithi069 ceph-mon[42047]: pgmap v416: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2023-12-14T18:29:58.360 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-14T18:29:58.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.495+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1065391742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100ca0 msgr2=0x7f8ecc107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.495+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1065391742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100ca0 0x7f8ecc107560 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400b0a0 tx=0x7f8ec400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1065391742 shutdown_connections 2023-12-14T18:29:58.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1065391742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100ca0 0x7f8ecc107560 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1065391742 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ecc0ff120 0x7f8ecc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1065391742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ecc100310 0x7f8ecc100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1065391742 >> 172.21.15.69:0/1065391742 conn(0x7f8ecc0fa740 msgr2=0x7f8ecc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1065391742 shutdown_connections 2023-12-14T18:29:58.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1065391742 wait complete. 2023-12-14T18:29:58.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 Processor -- start 2023-12-14T18:29:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 -- start start 2023-12-14T18:29:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ecc0ff120 0x7f8ecc069af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 0x7f8ecc19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.496+0000 7f8ed1ba4700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ecc100ca0 0x7f8ecc19d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ed1ba4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19dae0 con 0x7f8ecc100310 2023-12-14T18:29:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ed1ba4700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19dc50 con 0x7f8ecc100ca0 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ed1ba4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19de10 con 0x7f8ecc0ff120 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 0x7f8ecc19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 0x7f8ecc19ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48102/0 (socket says 172.21.15.69:48102) 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 -- 172.21.15.69:0/1979517128 learned_addr learned my addr 172.21.15.69:0/1979517128 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ecc0ff120 0x7f8ecc069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecbfff700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ecc100ca0 0x7f8ecc19d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 -- 172.21.15.69:0/1979517128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ecc0ff120 msgr2=0x7f8ecc069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ecc0ff120 0x7f8ecc069af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 -- 172.21.15.69:0/1979517128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ecc100ca0 msgr2=0x7f8ecc19d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ecc100ca0 0x7f8ecc19d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 -- 172.21.15.69:0/1979517128 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009d00 con 0x7f8ecc100310 2023-12-14T18:29:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 0x7f8ecc19ad00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000d950 tx=0x7f8ec000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ec8ff9700 1 -- 172.21.15.69:0/1979517128 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000f890 con 0x7f8ecc100310 2023-12-14T18:29:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ec8ff9700 1 -- 172.21.15.69:0/1979517128 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec000fe80 con 0x7f8ecc100310 2023-12-14T18:29:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc10a940 con 0x7f8ecc100310 2023-12-14T18:29:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ec8ff9700 1 -- 172.21.15.69:0/1979517128 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000e3b0 con 0x7f8ecc100310 2023-12-14T18:29:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.497+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc10a7b0 con 0x7f8ecc100310 2023-12-14T18:29:58.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.500+0000 7f8ec8ff9700 1 -- 172.21.15.69:0/1979517128 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8ec0010460 con 0x7f8ecc100310 2023-12-14T18:29:58.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ec8ff9700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8eb40a11d0 0x7f8eb40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8eb40a11d0 0x7f8eb40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ec8ff9700 1 -- 172.21.15.69:0/1979517128 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8ec00cc6c0 con 0x7f8ecc100310 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 Processor -- start 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 -- start start 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8723910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8724770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8eb40a11d0 0x7f8eb40a3680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc100170 tx=0x7f8ebc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea8725170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea860c5e0 con 0x55eea8723500 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea867b870 con 0x55eea8723e50 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8674d00 con 0x55eea8724d00 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8723910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8723910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48112/0 (socket says 172.21.15.69:48112) 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.501+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/4274709255 learned_addr learned my addr 172.21.15.69:0/4274709255 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:58.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8724770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecbfff700 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea8725170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/4274709255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 msgr2=0x55eea8725170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea8725170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/4274709255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 msgr2=0x55eea8724770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8724770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/4274709255 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eea84f63b0 con 0x55eea8723500 2023-12-14T18:29:58.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8724770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:58.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8723910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00fd80 tx=0x7f8ebc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d2b8759b5025a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8eb1ffb700 1 -- 172.21.15.69:0/4274709255 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc010ac0 con 0x55eea8723500 2023-12-14T18:29:58.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8eb1ffb700 1 -- 172.21.15.69:0/4274709255 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ebc020070 con 0x55eea8723500 2023-12-14T18:29:58.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.502+0000 7f8eb1ffb700 1 -- 172.21.15.69:0/4274709255 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc01bd80 con 0x55eea8723500 2023-12-14T18:29:58.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 -- 172.21.15.69:0/4274709255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 msgr2=0x55eea8723910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8723910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00fd80 tx=0x7f8ebc012000 comp rx=0 tx=0).stop 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 -- 172.21.15.69:0/4274709255 shutdown_connections 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea8725170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8723910 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/4274709255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8724770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 -- 172.21.15.69:0/4274709255 >> 172.21.15.69:0/4274709255 conn(0x55eea8718ca0 msgr2=0x55eea871e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 -- 172.21.15.69:0/4274709255 shutdown_connections 2023-12-14T18:29:58.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 -- 172.21.15.69:0/4274709255 wait complete. 2023-12-14T18:29:58.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 -- start start 2023-12-14T18:29:58.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 Processor -- start 2023-12-14T18:29:58.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea872d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea872d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.503+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8724d00 0x55eea8734710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8610f90 con 0x55eea8723500 2023-12-14T18:29:58.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8610c30 con 0x55eea8724d00 2023-12-14T18:29:58.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea84f86a0 con 0x55eea8723e50 2023-12-14T18:29:58.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 10 client.0 _ll_register_callbacks cb 0x55eea8634910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:58.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea872d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea872d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48116/0 (socket says 172.21.15.69:48116) 2023-12-14T18:29:58.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/3393637534 learned_addr learned my addr 172.21.15.69:0/3393637534 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:58.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecbfff700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8724d00 0x55eea8734710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea872d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/3393637534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 msgr2=0x55eea872d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea872d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8724d00 msgr2=0x55eea8734710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8724d00 0x55eea8734710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/3393637534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ebc00fa60 con 0x55eea8723500 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea872d190 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc005dc0 tx=0x7f8ebc01bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb19f197dc2471a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:58.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eaaffd700 1 -- 172.21.15.69:0/3393637534 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc010cd0 con 0x55eea8723500 2023-12-14T18:29:58.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eaaffd700 1 -- 172.21.15.69:0/3393637534 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8ebc005040 con 0x55eea8723500 2023-12-14T18:29:58.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eea87162b0 con 0x55eea8723500 2023-12-14T18:29:58.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eaaffd700 1 -- 172.21.15.69:0/3393637534 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ebc00fed0 con 0x55eea8723500 2023-12-14T18:29:58.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 10 client.15864 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:58.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.504+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eea863b170 con 0x55eea8723500 2023-12-14T18:29:58.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eaaffd700 1 -- 172.21.15.69:0/3393637534 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eea87162b0 con 0x55eea8723500 2023-12-14T18:29:58.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eaaffd700 1 -- 172.21.15.69:0/3393637534 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8ebc02d070 con 0x55eea8723500 2023-12-14T18:29:58.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eddd32b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:58.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eddd32b80 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:58.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eddd32b80 20 client.15864 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:58.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea873b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eddd32b80 4 client.15864 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:58.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eea866dce0 con 0x55eea8738e40 2023-12-14T18:29:58.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.505+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea873b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eaaffd700 10 client.15864 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:58.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea873b250 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfa436828d5feeb3 server_cookie=dbfe2f19a9975daa in_seq=0 out_seq=0 2023-12-14T18:29:58.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eaaffd700 1 -- 172.21.15.69:0/3393637534 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55eea866dce0 con 0x55eea8738e40 2023-12-14T18:29:58.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eaaffd700 10 client.15864 handle_command_reply: tid=0 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 client.15864 shutdown 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 msgr2=0x55eea872d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea872d190 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc005dc0 tx=0x7f8ebc01bd70 comp rx=0 tx=0).stop 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 shutdown_connections 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea873b250 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8724d00 0x55eea8734710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eaaffd700 0 client.15864 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:58.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea872d190 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/3393637534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea872d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.506+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 >> 172.21.15.69:0/3393637534 conn(0x55eea8718ca0 msgr2=0x55eea871cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.507+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 shutdown_connections 2023-12-14T18:29:58.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.507+0000 7f8eddd32b80 1 -- 172.21.15.69:0/3393637534 wait complete. 2023-12-14T18:29:58.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.507+0000 7f8eddd32b80 20 client.15864 trim_cache size 0 max 16384 2023-12-14T18:29:58.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.523+0000 7f8eddd32b80 1 Processor -- start 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.523+0000 7f8eddd32b80 1 -- start start 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8727c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8728140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea87346d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea871ea00 con 0x55eea8723500 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea871f550 con 0x55eea8723e50 2023-12-14T18:29:58.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8728770 con 0x55eea8724d00 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8727c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8727c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48132/0 (socket says 172.21.15.69:48132) 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/2103609463 learned_addr learned my addr 172.21.15.69:0/2103609463 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8728140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/2103609463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 msgr2=0x55eea87346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea87346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/2103609463 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 msgr2=0x55eea8728140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8728140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 -- 172.21.15.69:0/2103609463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eea872c1b0 con 0x55eea8723500 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8728140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8727c00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc025490 tx=0x7f8ebc00ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ae02a82dac6cf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eb27fc700 1 -- 172.21.15.69:0/2103609463 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc03e070 con 0x55eea8723500 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eb27fc700 1 -- 172.21.15.69:0/2103609463 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ebc02a040 con 0x55eea8723500 2023-12-14T18:29:58.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.524+0000 7f8eb27fc700 1 -- 172.21.15.69:0/2103609463 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc010d30 con 0x55eea8723500 2023-12-14T18:29:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 -- 172.21.15.69:0/2103609463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 msgr2=0x55eea8727c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8727c00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc025490 tx=0x7f8ebc00ff50 comp rx=0 tx=0).stop 2023-12-14T18:29:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 -- 172.21.15.69:0/2103609463 shutdown_connections 2023-12-14T18:29:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8724d00 0x55eea87346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8723500 0x55eea8727c00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/2103609463 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723e50 0x55eea8728140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 -- 172.21.15.69:0/2103609463 >> 172.21.15.69:0/2103609463 conn(0x55eea8718ca0 msgr2=0x55eea8735000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 -- 172.21.15.69:0/2103609463 shutdown_connections 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 -- 172.21.15.69:0/2103609463 wait complete. 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.525+0000 7f8eddd32b80 1 -- start start 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 Processor -- start 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723500 0x55eea8733f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea87344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 0x55eea8730a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8731020 con 0x55eea8724d00 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8731160 con 0x55eea8723500 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea8731320 con 0x55eea8723e50 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eddd32b80 10 client.0 _ll_register_callbacks cb 0x7f8ebc00fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 0x55eea8730a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 0x55eea8730a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48142/0 (socket says 172.21.15.69:48142) 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 -- 172.21.15.69:0/1564562088 learned_addr learned my addr 172.21.15.69:0/1564562088 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723500 0x55eea8733f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecaffd700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea87344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 -- 172.21.15.69:0/1564562088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 msgr2=0x55eea87344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea87344a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 -- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723500 msgr2=0x55eea8733f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:58.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723500 0x55eea8733f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 -- 172.21.15.69:0/1564562088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eea863b170 con 0x55eea8724d00 2023-12-14T18:29:58.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8ecbfff700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 0x55eea8730a00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400b0a0 tx=0x7f8ec40094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b195aa62ebcd5b server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.526+0000 7f8eaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:58.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eaaffd700 1 -- 172.21.15.69:0/1564562088 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400e040 con 0x55eea8724d00 2023-12-14T18:29:58.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eaaffd700 1 -- 172.21.15.69:0/1564562088 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8ec4023070 con 0x55eea8724d00 2023-12-14T18:29:58.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ebc020070 con 0x55eea8724d00 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eaaffd700 1 -- 172.21.15.69:0/1564562088 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec4005040 con 0x55eea8724d00 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 10 client.15870 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eea863aec0 con 0x55eea8724d00 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eaaffd700 1 -- 172.21.15.69:0/1564562088 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ebc020070 con 0x55eea8724d00 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eaaffd700 1 -- 172.21.15.69:0/1564562088 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8ec4030070 con 0x55eea8724d00 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 10 client.15870 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:58.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 20 client.15870 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea8790340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 4 client.15870 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eea866da00 con 0x55eea8738e40 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.527+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea8790340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eaaffd700 10 client.15870 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8ecb7fe700 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea8790340 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30cc6704b3fb2df server_cookie=b78217141d6cb134 in_seq=0 out_seq=0 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eaaffd700 1 -- 172.21.15.69:0/1564562088 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55eea866da00 con 0x55eea8738e40 2023-12-14T18:29:58.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eaaffd700 10 client.15870 handle_command_reply: tid=0 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 client.15870 shutdown 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 msgr2=0x55eea8730a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 0x55eea8730a00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400b0a0 tx=0x7f8ec40094f0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 shutdown_connections 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55eea8738e40 0x55eea8790340 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eea8724d00 0x55eea8730a00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eaaffd700 0 client.15870 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:58.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55eea8723500 0x55eea8733f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 --2- 172.21.15.69:0/1564562088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eea8723e50 0x55eea87344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 >> 172.21.15.69:0/1564562088 conn(0x55eea8718ca0 msgr2=0x55eea8727c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 shutdown_connections 2023-12-14T18:29:58.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 1 -- 172.21.15.69:0/1564562088 wait complete. 2023-12-14T18:29:58.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.528+0000 7f8eddd32b80 20 client.15870 trim_cache size 0 max 16384 2023-12-14T18:29:58.547 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:29:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2023-12-14T18:29:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2023-12-14T18:29:58.547 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:29:58.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8eb40a11d0 msgr2=0x7f8eb40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8eb40a11d0 0x7f8eb40a3680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc100170 tx=0x7f8ebc00a380 comp rx=0 tx=0).stop 2023-12-14T18:29:58.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 msgr2=0x7f8ecc19ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 0x7f8ecc19ad00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000d950 tx=0x7f8ec000dc60 comp rx=0 tx=0).stop 2023-12-14T18:29:58.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 shutdown_connections 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f8eb40a11d0 0x7f8eb40a3680 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ecc100ca0 0x7f8ecc19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ecc0ff120 0x7f8ecc069af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 --2- 172.21.15.69:0/1979517128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc100310 0x7f8ecc19ad00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 >> 172.21.15.69:0/1979517128 conn(0x7f8ecc0fa740 msgr2=0x7f8ecc0fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 shutdown_connections 2023-12-14T18:29:58.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.529+0000 7f8ed1ba4700 1 -- 172.21.15.69:0/1979517128 wait complete. 2023-12-14T18:29:58.551 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-14T18:29:58.551 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:29:58.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 -- 172.21.15.69:0/2326676305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 msgr2=0x7f6cb01075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 --2- 172.21.15.69:0/2326676305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb01075a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800b0a0 tx=0x7f6ca800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 -- 172.21.15.69:0/2326676305 shutdown_connections 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 --2- 172.21.15.69:0/2326676305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb01075a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 --2- 172.21.15.69:0/2326676305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6cb00ff640 0x7f6cb00ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 --2- 172.21.15.69:0/2326676305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb0100350 0x7f6cb01007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 -- 172.21.15.69:0/2326676305 >> 172.21.15.69:0/2326676305 conn(0x7f6cb00f9e80 msgr2=0x7f6cb00fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 -- 172.21.15.69:0/2326676305 shutdown_connections 2023-12-14T18:29:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.672+0000 7f6cb7188700 1 -- 172.21.15.69:0/2326676305 wait complete. 2023-12-14T18:29:58.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 Processor -- start 2023-12-14T18:29:58.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 -- start start 2023-12-14T18:29:58.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6cb00ff640 0x7f6cb0194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb0100350 0x7f6cb0195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb019ca50 con 0x7f6cb0100d00 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb019cb90 con 0x7f6cb00ff640 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb7188700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb019cd20 con 0x7f6cb0100350 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb5725700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb5725700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb019c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48162/0 (socket says 172.21.15.69:48162) 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb5725700 1 -- 172.21.15.69:0/3279253009 learned_addr learned my addr 172.21.15.69:0/3279253009 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb4f24700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6cb00ff640 0x7f6cb0194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6caffff700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb0100350 0x7f6cb0195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb5725700 1 -- 172.21.15.69:0/3279253009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb0100350 msgr2=0x7f6cb0195410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb5725700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb0100350 0x7f6cb0195410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.673+0000 7f6cb5725700 1 -- 172.21.15.69:0/3279253009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6cb00ff640 msgr2=0x7f6cb0194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cb5725700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6cb00ff640 0x7f6cb0194ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cb5725700 1 -- 172.21.15.69:0/3279253009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009d00 con 0x7f6cb0100d00 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cb5725700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb019c480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80062a0 tx=0x7f6ca8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800e040 con 0x7f6cb0100d00 2023-12-14T18:29:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb010a940 con 0x7f6cb0100d00 2023-12-14T18:29:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ca8003e90 con 0x7f6cb0100d00 2023-12-14T18:29:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004020 con 0x7f6cb0100d00 2023-12-14T18:29:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.674+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb010a7b0 con 0x7f6cb0100d00 2023-12-14T18:29:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.675+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb0067160 con 0x7f6cb0100d00 2023-12-14T18:29:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.676+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6ca8003a00 con 0x7f6cb0100d00 2023-12-14T18:29:58.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.676+0000 7f6cadffb700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ca00a1150 0x7f6ca00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:58.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.677+0000 7f6cb4f24700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ca00a1150 0x7f6ca00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:58.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.677+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6ca80ce8c0 con 0x7f6cb0100d00 2023-12-14T18:29:58.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.677+0000 7f6cb4f24700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ca00a1150 0x7f6ca00a3600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0067940 tx=0x7f6ca400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:58.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.680+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6ca8098050 con 0x7f6cb0100d00 2023-12-14T18:29:58.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.916+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cb019d6b0 con 0x7f6cb0100d00 2023-12-14T18:29:58.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.916+0000 7f6cadffb700 1 -- 172.21.15.69:0/3279253009 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f6ca809b670 con 0x7f6cb0100d00 2023-12-14T18:29:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:29:58.918 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:27:06.542050+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:29:58.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.918+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ca00a1150 msgr2=0x7f6ca00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.918+0000 7f6cb7188700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ca00a1150 0x7f6ca00a3600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0067940 tx=0x7f6ca400a380 comp rx=0 tx=0).stop 2023-12-14T18:29:58.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 msgr2=0x7f6cb019c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb019c480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80062a0 tx=0x7f6ca8004d00 comp rx=0 tx=0).stop 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 shutdown_connections 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f6ca00a1150 0x7f6ca00a3600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cb0100d00 0x7f6cb019c480 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6cb00ff640 0x7f6cb0194ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 --2- 172.21.15.69:0/3279253009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb0100350 0x7f6cb0195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:58.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 >> 172.21.15.69:0/3279253009 conn(0x7f6cb00f9e80 msgr2=0x7f6cb00fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:58.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 shutdown_connections 2023-12-14T18:29:58.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:58.919+0000 7f6cb7188700 1 -- 172.21.15.69:0/3279253009 wait complete. 2023-12-14T18:29:58.922 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 27 2023-12-14T18:29:58.932 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-14T18:29:59.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 -- 172.21.15.69:0/4164002243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c105f40 msgr2=0x7f308c108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 --2- 172.21.15.69:0/4164002243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c105f40 0x7f308c108340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f308400b0a0 tx=0x7f308400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 -- 172.21.15.69:0/4164002243 shutdown_connections 2023-12-14T18:29:59.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 --2- 172.21.15.69:0/4164002243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c105f40 0x7f308c108340 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 --2- 172.21.15.69:0/4164002243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f308c100d00 0x7f308c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 --2- 172.21.15.69:0/4164002243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f308c103620 0x7f308c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 -- 172.21.15.69:0/4164002243 >> 172.21.15.69:0/4164002243 conn(0x7f308c0fa740 msgr2=0x7f308c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 -- 172.21.15.69:0/4164002243 shutdown_connections 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.056+0000 7f309369a700 1 -- 172.21.15.69:0/4164002243 wait complete. 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 Processor -- start 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 -- start start 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 0x7f308c195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f308c103620 0x7f308c196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f308c105f40 0x7f308c19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c19db40 con 0x7f308c100d00 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c19dc80 con 0x7f308c103620 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f309369a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c19de10 con 0x7f308c105f40 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 0x7f308c195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 0x7f308c195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48188/0 (socket says 172.21.15.69:48188) 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 -- 172.21.15.69:0/854727406 learned_addr learned my addr 172.21.15.69:0/854727406 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3090c35700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f308c103620 0x7f308c196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091c37700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f308c105f40 0x7f308c19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 -- 172.21.15.69:0/854727406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f308c105f40 msgr2=0x7f308c19d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f308c105f40 0x7f308c19d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 -- 172.21.15.69:0/854727406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f308c103620 msgr2=0x7f308c196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f308c103620 0x7f308c196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.057+0000 7f3091436700 1 -- 172.21.15.69:0/854727406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084009d00 con 0x7f308c100d00 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.058+0000 7f3091436700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 0x7f308c195fc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f307c00d950 tx=0x7f307c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.058+0000 7f30827fc700 1 -- 172.21.15.69:0/854727406 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c00f890 con 0x7f308c100d00 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.058+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308c10ba40 con 0x7f308c100d00 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.058+0000 7f30827fc700 1 -- 172.21.15.69:0/854727406 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f307c00fe80 con 0x7f308c100d00 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.058+0000 7f30827fc700 1 -- 172.21.15.69:0/854727406 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c00e3b0 con 0x7f308c100d00 2023-12-14T18:29:59.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.058+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c10b8b0 con 0x7f308c100d00 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.060+0000 7f30827fc700 1 -- 172.21.15.69:0/854727406 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f307c010460 con 0x7f308c100d00 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.061+0000 7f30827fc700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f30780a1150 0x7f30780a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.061+0000 7f3090c35700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f30780a1150 0x7f30780a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.061+0000 7f30827fc700 1 -- 172.21.15.69:0/854727406 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f307c0cc700 con 0x7f308c100d00 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.061+0000 7f3090c35700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f30780a1150 0x7f30780a3600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3088009c60 tx=0x7f3088009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 Processor -- start 2023-12-14T18:29:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 -- start start 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06d9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9e50 0x55cce06da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 0x55cce06db170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce05c25e0 con 0x55cce06d9500 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce0631870 con 0x55cce06dad00 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f309f828b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce062ad00 con 0x55cce06d9e50 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06d9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06d9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48198/0 (socket says 172.21.15.69:48198) 2023-12-14T18:29:59.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 -- 172.21.15.69:0/1760210537 learned_addr learned my addr 172.21.15.69:0/1760210537 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 -- 172.21.15.69:0/1760210537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9e50 msgr2=0x55cce06da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9e50 0x55cce06da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 -- 172.21.15.69:0/1760210537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 msgr2=0x55cce06db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 0x55cce06db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.062+0000 7f3091436700 1 -- 172.21.15.69:0/1760210537 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce04ac3b0 con 0x55cce06d9500 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f3091436700 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06d9910 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f307c099a50 tx=0x7f307c0994f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9527286526ffc0bb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f30777fe700 1 -- 172.21.15.69:0/1760210537 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c09daf0 con 0x55cce06d9500 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f30777fe700 1 -- 172.21.15.69:0/1760210537 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f307c0a1f10 con 0x55cce06d9500 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f30777fe700 1 -- 172.21.15.69:0/1760210537 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c0a1ce0 con 0x55cce06d9500 2023-12-14T18:29:59.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f309f828b80 1 -- 172.21.15.69:0/1760210537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 msgr2=0x55cce06d9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f309f828b80 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06d9910 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f307c099a50 tx=0x7f307c0994f0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f309f828b80 1 -- 172.21.15.69:0/1760210537 shutdown_connections 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f309f828b80 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 0x55cce06db170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f309f828b80 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06d9910 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.063+0000 7f309f828b80 1 --2- 172.21.15.69:0/1760210537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9e50 0x55cce06da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- 172.21.15.69:0/1760210537 >> 172.21.15.69:0/1760210537 conn(0x55cce06ceca0 msgr2=0x55cce06d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- 172.21.15.69:0/1760210537 shutdown_connections 2023-12-14T18:29:59.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- 172.21.15.69:0/1760210537 wait complete. 2023-12-14T18:29:59.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- start start 2023-12-14T18:29:59.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 Processor -- start 2023-12-14T18:29:59.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce05c6f90 con 0x55cce06d9500 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce05c6c30 con 0x55cce06d9e50 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce04ae6a0 con 0x55cce06dad00 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f309f828b80 10 client.0 _ll_register_callbacks cb 0x55cce05ea910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48204/0 (socket says 172.21.15.69:48204) 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.064+0000 7f3091436700 1 -- 172.21.15.69:0/3022251505 learned_addr learned my addr 172.21.15.69:0/3022251505 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3090c35700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091c37700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091436700 1 -- 172.21.15.69:0/3022251505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 msgr2=0x55cce06ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091436700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06ea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091436700 1 -- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 msgr2=0x55cce06e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091436700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091436700 1 -- 172.21.15.69:0/3022251505 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c10b8b0 con 0x55cce06d9500 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091c37700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3091436700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e3020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f307c0a19e0 tx=0x7f307c098fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201c1c3faa954d17 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3074ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3074ff9700 1 -- 172.21.15.69:0/3022251505 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c0b6070 con 0x55cce06d9500 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3074ff9700 1 -- 172.21.15.69:0/3022251505 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f307c0b20d0 con 0x55cce06d9500 2023-12-14T18:29:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cce06cc2b0 con 0x55cce06d9500 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3074ff9700 1 -- 172.21.15.69:0/3022251505 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f307c0b2290 con 0x55cce06d9500 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f309f828b80 10 client.15888 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cce05f1170 con 0x55cce06d9500 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3074ff9700 1 -- 172.21.15.69:0/3022251505 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cce06cc2b0 con 0x55cce06d9500 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.065+0000 7f3074ff9700 1 -- 172.21.15.69:0/3022251505 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f307c098a20 con 0x55cce06d9500 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f309f828b80 10 client.15888 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f309f828b80 10 client.15888 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f309f828b80 20 client.15888 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f309f828b80 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce06eea60 0x55cce06f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f309f828b80 4 client.15888 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cce0623ce0 con 0x55cce06eea60 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f3090c35700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce06eea60 0x55cce06f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f3074ff9700 10 client.15888 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.066+0000 7f3090c35700 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce06eea60 0x55cce06f0e70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ef250c8716254da server_cookie=3c78a7dbb8c6daec in_seq=0 out_seq=0 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f3074ff9700 1 -- 172.21.15.69:0/3022251505 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cce0623ce0 con 0x55cce06eea60 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f3074ff9700 10 client.15888 handle_command_reply: tid=0 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 client.15888 shutdown 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 msgr2=0x55cce06e3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e3020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f307c0a19e0 tx=0x7f307c098fb0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 shutdown_connections 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce06eea60 0x55cce06f0e70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e3020 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f3074ff9700 0 client.15888 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 --2- 172.21.15.69:0/3022251505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 >> 172.21.15.69:0/3022251505 conn(0x55cce06ceca0 msgr2=0x55cce06d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 shutdown_connections 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.067+0000 7f309f828b80 1 -- 172.21.15.69:0/3022251505 wait complete. 2023-12-14T18:29:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.068+0000 7f309f828b80 20 client.15888 trim_cache size 0 max 16384 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 Processor -- start 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 -- start start 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9500 0x55cce06e1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 0x55cce06ea560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 0x55cce06e1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce06d49e0 con 0x55cce06d9e50 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce06de7d0 con 0x55cce06dad00 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f309f828b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce06da240 con 0x55cce06d9500 2023-12-14T18:29:59.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 0x55cce06ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 0x55cce06ea560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48220/0 (socket says 172.21.15.69:48220) 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 -- 172.21.15.69:0/1361280983 learned_addr learned my addr 172.21.15.69:0/1361280983 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 -- 172.21.15.69:0/1361280983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9500 msgr2=0x55cce06e1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9500 0x55cce06e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 -- 172.21.15.69:0/1361280983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 msgr2=0x55cce06e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 0x55cce06e1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 -- 172.21.15.69:0/1361280983 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce05f0ec0 con 0x55cce06d9e50 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3090c35700 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 0x55cce06ea560 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55cce06f1750 tx=0x7f3088014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad96f0ef6aeef2fb server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.081+0000 7f3077fff700 1 -- 172.21.15.69:0/1361280983 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088023040 con 0x55cce06d9e50 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f3077fff700 1 -- 172.21.15.69:0/1361280983 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3088025cf0 con 0x55cce06d9e50 2023-12-14T18:29:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f3077fff700 1 -- 172.21.15.69:0/1361280983 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088003b90 con 0x55cce06d9e50 2023-12-14T18:29:59.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 -- 172.21.15.69:0/1361280983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 msgr2=0x55cce06ea560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 0x55cce06ea560 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55cce06f1750 tx=0x7f3088014000 comp rx=0 tx=0).stop 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 -- 172.21.15.69:0/1361280983 shutdown_connections 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06dad00 0x55cce06e1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06d9500 0x55cce06e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 --2- 172.21.15.69:0/1361280983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9e50 0x55cce06ea560 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 -- 172.21.15.69:0/1361280983 >> 172.21.15.69:0/1361280983 conn(0x55cce06ceca0 msgr2=0x55cce06e1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 -- 172.21.15.69:0/1361280983 shutdown_connections 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 -- 172.21.15.69:0/1361280983 wait complete. 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.082+0000 7f309f828b80 1 -- start start 2023-12-14T18:29:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 Processor -- start 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce06ea030 con 0x55cce06d9500 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce06ea1a0 con 0x55cce06d9e50 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce06ea360 con 0x55cce06dad00 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f309f828b80 10 client.0 _ll_register_callbacks cb 0x7f307c0996b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48230/0 (socket says 172.21.15.69:48230) 2023-12-14T18:29:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 -- 172.21.15.69:0/2628637287 learned_addr learned my addr 172.21.15.69:0/2628637287 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 -- 172.21.15.69:0/2628637287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 msgr2=0x55cce06e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 -- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 msgr2=0x55cce06e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3090c35700 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 -- 172.21.15.69:0/2628637287 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3088017070 con 0x55cce06d9500 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3091436700 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e6590 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f307c097e10 tx=0x7f307c0992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fddc4f0123047 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.083+0000 7f3074ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f3074ff9700 1 -- 172.21.15.69:0/2628637287 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c0b22e0 con 0x55cce06d9500 2023-12-14T18:29:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f307c0a1f10 con 0x55cce06d9500 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f3074ff9700 1 -- 172.21.15.69:0/2628637287 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f307c09daf0 con 0x55cce06d9500 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f3074ff9700 1 -- 172.21.15.69:0/2628637287 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f307c095ab0 con 0x55cce06d9500 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 10 client.15894 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cce05d79a0 con 0x55cce06d9500 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f3074ff9700 1 -- 172.21.15.69:0/2628637287 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f307c0a1f10 con 0x55cce06d9500 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f3074ff9700 1 -- 172.21.15.69:0/2628637287 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f307c084380 con 0x55cce06d9500 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 10 client.15894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 20 client.15894 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce07436f0 0x55cce0745b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 4 client.15894 mds_command: new command op to 24458 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 --> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cce0623a00 con 0x55cce07436f0 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.084+0000 7f3090c35700 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce07436f0 0x55cce0745b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f3074ff9700 10 client.15894 ms_handle_connect on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f3090c35700 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce07436f0 0x55cce0745b00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6010a551c96a28d7 server_cookie=dfbb0a5ce2620bdd in_seq=0 out_seq=0 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f3074ff9700 1 -- 172.21.15.69:0/2628637287 <== mds.2 v2:172.21.15.91:6834/426473742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cce0623a00 con 0x55cce07436f0 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f3074ff9700 10 client.15894 handle_command_reply: tid=0 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 client.15894 shutdown 2023-12-14T18:29:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 msgr2=0x55cce06e6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e6590 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f307c097e10 tx=0x7f307c0992e0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 shutdown_connections 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:6834/426473742,v1:172.21.15.91:6835/426473742] conn(0x55cce07436f0 0x55cce0745b00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cce06dad00 0x55cce06e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cce06d9500 0x55cce06e6590 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f3074ff9700 0 client.15894 ms_handle_reset on v2:172.21.15.91:6834/426473742 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 --2- 172.21.15.69:0/2628637287 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55cce06d9e50 0x55cce06e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 >> 172.21.15.69:0/2628637287 conn(0x55cce06ceca0 msgr2=0x55cce06e1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 shutdown_connections 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 1 -- 172.21.15.69:0/2628637287 wait complete. 2023-12-14T18:29:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.085+0000 7f309f828b80 20 client.15894 trim_cache size 0 max 16384 2023-12-14T18:29:59.095 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f30780a1150 msgr2=0x7f30780a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f30780a1150 0x7f30780a3600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3088009c60 tx=0x7f3088009260 comp rx=0 tx=0).stop 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 msgr2=0x7f308c195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 0x7f308c195fc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f307c00d950 tx=0x7f307c00dc60 comp rx=0 tx=0).stop 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 shutdown_connections 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f30780a1150 0x7f30780a3600 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f308c105f40 0x7f308c19d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f308c100d00 0x7f308c195fc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 --2- 172.21.15.69:0/854727406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f308c103620 0x7f308c196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 >> 172.21.15.69:0/854727406 conn(0x7f308c0fa740 msgr2=0x7f308c101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 shutdown_connections 2023-12-14T18:29:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.086+0000 7f309369a700 1 -- 172.21.15.69:0/854727406 wait complete. 2023-12-14T18:29:59.099 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 -- 172.21.15.69:0/1774531349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 msgr2=0x7ff8b8107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 --2- 172.21.15.69:0/1774531349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b8107560 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b0a0 tx=0x7ff8b000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 -- 172.21.15.69:0/1774531349 shutdown_connections 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 --2- 172.21.15.69:0/1774531349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b8107560 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 --2- 172.21.15.69:0/1774531349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8b80ff120 0x7ff8b80ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 --2- 172.21.15.69:0/1774531349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b8100310 0x7ff8b8100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 -- 172.21.15.69:0/1774531349 >> 172.21.15.69:0/1774531349 conn(0x7ff8b80fa740 msgr2=0x7ff8b80fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 -- 172.21.15.69:0/1774531349 shutdown_connections 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 -- 172.21.15.69:0/1774531349 wait complete. 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 Processor -- start 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.222+0000 7ff8c0667700 1 -- start start 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8b80ff120 0x7ff8b8198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b8100310 0x7ff8b8198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b819fdc0 con 0x7ff8b8100ca0 2023-12-14T18:29:59.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b819ff00 con 0x7ff8b8100310 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b81a0090 con 0x7ff8b80ff120 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b819f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48242/0 (socket says 172.21.15.69:48242) 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 -- 172.21.15.69:0/2566503478 learned_addr learned my addr 172.21.15.69:0/2566503478 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b8100310 0x7ff8b8198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8be403700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8b80ff120 0x7ff8b8198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 -- 172.21.15.69:0/2566503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8b80ff120 msgr2=0x7ff8b8198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8b80ff120 0x7ff8b8198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 -- 172.21.15.69:0/2566503478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b8100310 msgr2=0x7ff8b8198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b8100310 0x7ff8b8198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 -- 172.21.15.69:0/2566503478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0009d00 con 0x7ff8b8100ca0 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8bec04700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b819f7f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009fd0 tx=0x7ff8b000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8af7fe700 1 -- 172.21.15.69:0/2566503478 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000e040 con 0x7ff8b8100ca0 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8af7fe700 1 -- 172.21.15.69:0/2566503478 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8b0003c00 con 0x7ff8b8100ca0 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b810a990 con 0x7ff8b8100ca0 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8af7fe700 1 -- 172.21.15.69:0/2566503478 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b001b6c0 con 0x7ff8b8100ca0 2023-12-14T18:29:59.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.223+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b810a800 con 0x7ff8b8100ca0 2023-12-14T18:29:59.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.226+0000 7ff8af7fe700 1 -- 172.21.15.69:0/2566503478 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff8b001d470 con 0x7ff8b8100ca0 2023-12-14T18:29:59.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.226+0000 7ff8af7fe700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8a40a1150 0x7ff8a40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.226+0000 7ff8af7fe700 1 -- 172.21.15.69:0/2566503478 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff8b00cd920 con 0x7ff8b8100ca0 2023-12-14T18:29:59.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.226+0000 7ff8be403700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8a40a1150 0x7ff8a40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 Processor -- start 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8be403700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8a40a1150 0x7ff8a40a3600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8100170 tx=0x7ff8a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 -- start start 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510b9b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510b9c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510a845e0 con 0x560510b9be50 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510af3870 con 0x560510b9cd00 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510aecd00 con 0x560510b9b500 2023-12-14T18:29:59.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510b9c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510b9c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48244/0 (socket says 172.21.15.69:48244) 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 -- 172.21.15.69:0/2619340109 learned_addr learned my addr 172.21.15.69:0/2619340109 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bec04700 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8be403700 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510b9b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 -- 172.21.15.69:0/2619340109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 msgr2=0x560510b9b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510b9b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 -- 172.21.15.69:0/2619340109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 msgr2=0x560510b9d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.227+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8bdc02700 1 -- 172.21.15.69:0/2619340109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56051096e3b0 con 0x560510b9be50 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8bec04700 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510b9c770 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009d80 tx=0x7ff8b4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f26f63af144c641 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8acff9700 1 -- 172.21.15.69:0/2619340109 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4004230 con 0x560510b9be50 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8acff9700 1 -- 172.21.15.69:0/2619340109 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8b4004390 con 0x560510b9be50 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8acff9700 1 -- 172.21.15.69:0/2619340109 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40197e0 con 0x560510b9be50 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/2619340109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 msgr2=0x560510b9c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.228+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510b9c770 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009d80 tx=0x7ff8b4011720 comp rx=0 tx=0).stop 2023-12-14T18:29:59.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/2619340109 shutdown_connections 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510b9b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/2619340109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510b9c770 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/2619340109 >> 172.21.15.69:0/2619340109 conn(0x560510b90ca0 msgr2=0x560510b96430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/2619340109 shutdown_connections 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/2619340109 wait complete. 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- start start 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 Processor -- start 2023-12-14T18:29:59.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9b500 0x560510ba5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510ba5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9cd00 0x560510bac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510a88f90 con 0x560510b9be50 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510a88c30 con 0x560510b9b500 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605109706a0 con 0x560510b9cd00 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8cc7f5b80 10 client.0 _ll_register_callbacks cb 0x560510aac910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8bdc02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510ba5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8bdc02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510ba5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48248/0 (socket says 172.21.15.69:48248) 2023-12-14T18:29:59.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3099388483 learned_addr learned my addr 172.21.15.69:0/3099388483 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.229+0000 7ff8be403700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9b500 0x560510ba5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bec04700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9cd00 0x560510bac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3099388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9cd00 msgr2=0x560510bac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9cd00 0x560510bac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9b500 msgr2=0x560510ba5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9b500 0x560510ba5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3099388483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b40099e0 con 0x560510b9be50 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510ba5640 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400a010 tx=0x7ff8b40038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca79e612e7fb9aac server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:59.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3099388483 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4005450 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3099388483 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff8b4004500 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560510b8e2b0 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3099388483 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8b4003bc0 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8cc7f5b80 10 client.15906 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560510ab3170 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3099388483 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560510b8e2b0 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3099388483 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff8b4021040 con 0x560510b9be50 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8cc7f5b80 10 client.15906 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:59.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.230+0000 7ff8cc7f5b80 10 client.15906 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8cc7f5b80 20 client.15906 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510bb0e60 0x560510bb3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8cc7f5b80 4 client.15906 mds_command: new command op to 24482 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560510ae5ce0 con 0x560510bb0e60 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8be403700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510bb0e60 0x560510bb3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8a1ffb700 10 client.15906 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.231+0000 7ff8be403700 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510bb0e60 0x560510bb3270 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b87156c35042bc2 server_cookie=9cd703df5d24e987 in_seq=0 out_seq=0 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3099388483 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560510ae5ce0 con 0x560510bb0e60 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8a1ffb700 10 client.15906 handle_command_reply: tid=0 2023-12-14T18:29:59.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 client.15906 shutdown 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 msgr2=0x560510ba5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510ba5640 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400a010 tx=0x7ff8b40038b0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 shutdown_connections 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510bb0e60 0x560510bb3270 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9cd00 0x560510bac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9b500 0x560510ba5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8a1ffb700 0 client.15906 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3099388483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510ba5640 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 >> 172.21.15.69:0/3099388483 conn(0x560510b90ca0 msgr2=0x560510b94f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 shutdown_connections 2023-12-14T18:29:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3099388483 wait complete. 2023-12-14T18:29:59.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.232+0000 7ff8cc7f5b80 20 client.15906 trim_cache size 0 max 16384 2023-12-14T18:29:59.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 Processor -- start 2023-12-14T18:29:59.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 -- start start 2023-12-14T18:29:59.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510bacf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510bac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510b8de60 con 0x560510b9be50 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510ba5d80 con 0x560510b9cd00 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510bb38d0 con 0x560510b9b500 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510bac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510bac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48264/0 (socket says 172.21.15.69:48264) 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3851682914 learned_addr learned my addr 172.21.15.69:0/3851682914 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bec04700 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3851682914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 msgr2=0x560510bacf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510bacf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3851682914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 msgr2=0x560510b9fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 -- 172.21.15.69:0/3851682914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560510ab2ec0 con 0x560510b9be50 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bec04700 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510bac640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009cd0 tx=0x7ff8b4005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e11b4dee0ad1804 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8ad7fa700 1 -- 172.21.15.69:0/3851682914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40197b0 con 0x560510b9be50 2023-12-14T18:29:59.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8ad7fa700 1 -- 172.21.15.69:0/3851682914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8b4019e80 con 0x560510b9be50 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.245+0000 7ff8ad7fa700 1 -- 172.21.15.69:0/3851682914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4005720 con 0x560510b9be50 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3851682914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 msgr2=0x560510bac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510bac640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009cd0 tx=0x7ff8b4005a40 comp rx=0 tx=0).stop 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3851682914 shutdown_connections 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510b9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9b500 0x560510bacf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3851682914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9be50 0x560510bac640 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3851682914 >> 172.21.15.69:0/3851682914 conn(0x560510b90ca0 msgr2=0x560510bb7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3851682914 shutdown_connections 2023-12-14T18:29:59.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3851682914 wait complete. 2023-12-14T18:29:59.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 -- start start 2023-12-14T18:29:59.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.246+0000 7ff8cc7f5b80 1 Processor -- start 2023-12-14T18:29:59.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 0x560510ba80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9be50 0x560510ba8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510bab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510babb70 con 0x560510b9b500 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510babce0 con 0x560510b9cd00 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560510babea0 con 0x560510b9be50 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 10 client.0 _ll_register_callbacks cb 0x7ff8b4009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 0x560510ba80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 0x560510ba80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48272/0 (socket says 172.21.15.69:48272) 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 -- 172.21.15.69:0/3476763467 learned_addr learned my addr 172.21.15.69:0/3476763467 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8bec04700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510bab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 -- 172.21.15.69:0/3476763467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9be50 msgr2=0x560510ba8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9be50 0x560510ba8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9be50 0x560510ba8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 -- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 msgr2=0x560510bab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510bab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 -- 172.21.15.69:0/3476763467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560510ab3170 con 0x560510b9b500 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8bec04700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510bab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9be50 0x560510ba8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8be403700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 0x560510ba80d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009ab0 tx=0x7ff8a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39fd094d3f1a193 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3476763467 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8026070 con 0x560510b9b500 2023-12-14T18:29:59.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3476763467 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff8a8018070 con 0x560510b9b500 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.247+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560510ae5a00 con 0x560510b9b500 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3476763467 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a8012e10 con 0x560510b9b500 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 10 client.15912 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560510a999a0 con 0x560510b9b500 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3476763467 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560510ae5a00 con 0x560510b9b500 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3476763467 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff8a802a410 con 0x560510b9b500 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 10 client.15912 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 10 client.15912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-12-14T18:29:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 20 client.15912 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510c05a10 0x560510c07e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 4 client.15912 mds_command: new command op to 24482 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 --> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56051093bcf0 con 0x560510c05a10 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.248+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510c05a10 0x560510c07e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8bdc02700 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510c05a10 0x560510c07e20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1783509afe5e410 server_cookie=86a62183ef2e91d1 in_seq=0 out_seq=0 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8a1ffb700 10 client.15912 ms_handle_connect on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8a1ffb700 1 -- 172.21.15.69:0/3476763467 <== mds.1 v2:172.21.15.91:6836/3727199285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56051093bcf0 con 0x560510c05a10 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8a1ffb700 10 client.15912 handle_command_reply: tid=0 2023-12-14T18:29:59.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 client.15912 shutdown 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 msgr2=0x560510ba80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 0x560510ba80d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009ab0 tx=0x7ff8a8004750 comp rx=0 tx=0).stop 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 shutdown_connections 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:6836/3727199285,v1:172.21.15.91:6837/3727199285] conn(0x560510c05a10 0x560510c07e20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x560510b9cd00 0x560510bab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560510b9b500 0x560510ba80d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 --2- 172.21.15.69:0/3476763467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560510b9be50 0x560510ba8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8a1ffb700 0 client.15912 ms_handle_reset on v2:172.21.15.91:6836/3727199285 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 >> 172.21.15.69:0/3476763467 conn(0x560510b90ca0 msgr2=0x560510bacf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 shutdown_connections 2023-12-14T18:29:59.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 1 -- 172.21.15.69:0/3476763467 wait complete. 2023-12-14T18:29:59.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8cc7f5b80 20 client.15912 trim_cache size 0 max 16384 2023-12-14T18:29:59.260 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8a40a1150 msgr2=0x7ff8a40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8c0667700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8a40a1150 0x7ff8a40a3600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8100170 tx=0x7ff8a8009260 comp rx=0 tx=0).stop 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 msgr2=0x7ff8b819f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.249+0000 7ff8c0667700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b819f7f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009fd0 tx=0x7ff8b000ba50 comp rx=0 tx=0).stop 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 shutdown_connections 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff8a40a1150 0x7ff8a40a3600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b8100ca0 0x7ff8b819f7f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8b80ff120 0x7ff8b8198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 --2- 172.21.15.69:0/2566503478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b8100310 0x7ff8b8198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 >> 172.21.15.69:0/2566503478 conn(0x7ff8b80fa740 msgr2=0x7ff8b8067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 shutdown_connections 2023-12-14T18:29:59.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.250+0000 7ff8c0667700 1 -- 172.21.15.69:0/2566503478 wait complete. 2023-12-14T18:29:59.263 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-14T18:29:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 -- 172.21.15.69:0/3920379804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c100ca0 msgr2=0x7f348c107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 --2- 172.21.15.69:0/3920379804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c100ca0 0x7f348c107560 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f348400b0a0 tx=0x7f348400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 -- 172.21.15.69:0/3920379804 shutdown_connections 2023-12-14T18:29:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 --2- 172.21.15.69:0/3920379804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c100ca0 0x7f348c107560 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 --2- 172.21.15.69:0/3920379804 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f348c0ff120 0x7f348c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 --2- 172.21.15.69:0/3920379804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f348c100310 0x7f348c100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 -- 172.21.15.69:0/3920379804 >> 172.21.15.69:0/3920379804 conn(0x7f348c0fa740 msgr2=0x7f348c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 -- 172.21.15.69:0/3920379804 shutdown_connections 2023-12-14T18:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.386+0000 7f3493bc2700 1 -- 172.21.15.69:0/3920379804 wait complete. 2023-12-14T18:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 Processor -- start 2023-12-14T18:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 -- start start 2023-12-14T18:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 0x7f348c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f348c100310 0x7f348c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f348c100ca0 0x7f348c19d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c19daf0 con 0x7f348c0ff120 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c19dc60 con 0x7f348c100ca0 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f3493bc2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c19de20 con 0x7f348c100310 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f349195e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 0x7f348c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f349195e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 0x7f348c068940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48296/0 (socket says 172.21.15.69:48296) 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f349195e700 1 -- 172.21.15.69:0/2985720801 learned_addr learned my addr 172.21.15.69:0/2985720801 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f349115d700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f348c100310 0x7f348c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.387+0000 7f349215f700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f348c100ca0 0x7f348c19d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f349195e700 1 -- 172.21.15.69:0/2985720801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f348c100310 msgr2=0x7f348c19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f349195e700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f348c100310 0x7f348c19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f349195e700 1 -- 172.21.15.69:0/2985720801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f348c100ca0 msgr2=0x7f348c19d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f349195e700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f348c100ca0 0x7f348c19d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f349195e700 1 -- 172.21.15.69:0/2985720801 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009d00 con 0x7f348c0ff120 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f349195e700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 0x7f348c068940 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e970 tx=0x7f347c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f3482ffd700 1 -- 172.21.15.69:0/2985720801 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c009790 con 0x7f348c0ff120 2023-12-14T18:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f3482ffd700 1 -- 172.21.15.69:0/2985720801 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f347c00c7e0 con 0x7f348c0ff120 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f3482ffd700 1 -- 172.21.15.69:0/2985720801 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c003bd0 con 0x7f348c0ff120 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c10a940 con 0x7f348c0ff120 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.388+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c10a7b0 con 0x7f348c0ff120 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.390+0000 7f3482ffd700 1 -- 172.21.15.69:0/2985720801 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f347c00c950 con 0x7f348c0ff120 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.390+0000 7f3482ffd700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34780a1150 0x7f34780a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.391+0000 7f349115d700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34780a1150 0x7f34780a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.391+0000 7f3482ffd700 1 -- 172.21.15.69:0/2985720801 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f347c014070 con 0x7f348c0ff120 2023-12-14T18:29:59.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.391+0000 7f349115d700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34780a1150 0x7f34780a3600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3488005950 tx=0x7f348800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.391+0000 7f349fd50b80 1 Processor -- start 2023-12-14T18:29:59.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 -- start start 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cacf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacfe50 0x55bb0cad0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cad1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0c9b85e0 con 0x55bb0cacf500 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0ca27870 con 0x55bb0cad0d00 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349fd50b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0ca20d00 con 0x55bb0cacfe50 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cacf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cacf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48302/0 (socket says 172.21.15.69:48302) 2023-12-14T18:29:59.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 -- 172.21.15.69:0/4032424412 learned_addr learned my addr 172.21.15.69:0/4032424412 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349215f700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cad1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349115d700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacfe50 0x55bb0cad0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 -- 172.21.15.69:0/4032424412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacfe50 msgr2=0x55bb0cad0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacfe50 0x55bb0cad0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 -- 172.21.15.69:0/4032424412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 msgr2=0x55bb0cad1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cad1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 -- 172.21.15.69:0/4032424412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0c8a23b0 con 0x55bb0cacf500 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349215f700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cad1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349115d700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacfe50 0x55bb0cad0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:29:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.392+0000 7f349195e700 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cacf910 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f347c099e30 tx=0x7f347c099880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be12f20ca37edfa server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f3477fff700 1 -- 172.21.15.69:0/4032424412 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0a22f0 con 0x55bb0cacf500 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f3477fff700 1 -- 172.21.15.69:0/4032424412 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f347c098240 con 0x55bb0cacf500 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f3477fff700 1 -- 172.21.15.69:0/4032424412 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c099390 con 0x55bb0cacf500 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 -- 172.21.15.69:0/4032424412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 msgr2=0x55bb0cacf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cacf910 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f347c099e30 tx=0x7f347c099880 comp rx=0 tx=0).stop 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 -- 172.21.15.69:0/4032424412 shutdown_connections 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cad1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cacf910 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 --2- 172.21.15.69:0/4032424412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacfe50 0x55bb0cad0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 -- 172.21.15.69:0/4032424412 >> 172.21.15.69:0/4032424412 conn(0x55bb0cac4ca0 msgr2=0x55bb0caca430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.393+0000 7f349fd50b80 1 -- 172.21.15.69:0/4032424412 shutdown_connections 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 -- 172.21.15.69:0/4032424412 wait complete. 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 -- start start 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 Processor -- start 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cad9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 0x55bb0cae06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0c9bcf90 con 0x55bb0cad0d00 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0c9bcc30 con 0x55bb0cacfe50 2023-12-14T18:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0c8a46a0 con 0x55bb0cacf500 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349fd50b80 10 client.0 _ll_register_callbacks cb 0x55bb0c9e0910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349215f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 0x55bb0cae06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349215f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 0x55bb0cae06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48318/0 (socket says 172.21.15.69:48318) 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.394+0000 7f349215f700 1 -- 172.21.15.69:0/1647420947 learned_addr learned my addr 172.21.15.69:0/1647420947 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349115d700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349195e700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cad9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349215f700 1 -- 172.21.15.69:0/1647420947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 msgr2=0x55bb0cad9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349215f700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cad9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349215f700 1 -- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 msgr2=0x55bb0cad9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349215f700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349215f700 1 -- 172.21.15.69:0/1647420947 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c10a7b0 con 0x55bb0cad0d00 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349215f700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 0x55bb0cae06a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3484007850 tx=0x7f3484007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0523033866f0b70 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f34757fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f34757fa700 1 -- 172.21.15.69:0/1647420947 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400e040 con 0x55bb0cad0d00 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f34757fa700 1 -- 172.21.15.69:0/1647420947 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f348400bc50 con 0x55bb0cad0d00 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb0cac22b0 con 0x55bb0cad0d00 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f34757fa700 1 -- 172.21.15.69:0/1647420947 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f348402a030 con 0x55bb0cad0d00 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349fd50b80 10 client.15924 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bb0c9e7170 con 0x55bb0cad0d00 2023-12-14T18:29:59.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.395+0000 7f34757fa700 1 -- 172.21.15.69:0/1647420947 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb0cac22b0 con 0x55bb0cad0d00 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f34757fa700 1 -- 172.21.15.69:0/1647420947 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3484022020 con 0x55bb0cad0d00 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349fd50b80 10 client.15924 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349fd50b80 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349fd50b80 20 client.15924 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349fd50b80 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cae4ec0 0x55bb0cae72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349fd50b80 4 client.15924 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb0ca19ce0 con 0x55bb0cae4ec0 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349195e700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cae4ec0 0x55bb0cae72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f34757fa700 10 client.15924 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:59.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.396+0000 7f349195e700 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cae4ec0 0x55bb0cae72d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66d8dbc6b32b63c server_cookie=819a987192b475cb in_seq=0 out_seq=0 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f34757fa700 1 -- 172.21.15.69:0/1647420947 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bb0ca19ce0 con 0x55bb0cae4ec0 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f34757fa700 10 client.15924 handle_command_reply: tid=0 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 client.15924 shutdown 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 msgr2=0x55bb0cae06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 0x55bb0cae06a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3484007850 tx=0x7f3484007b20 comp rx=0 tx=0).stop 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 shutdown_connections 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cae4ec0 0x55bb0cae72d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cad0d00 0x55bb0cae06a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cad9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 --2- 172.21.15.69:0/1647420947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f34757fa700 0 client.15924 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 >> 172.21.15.69:0/1647420947 conn(0x55bb0cac4ca0 msgr2=0x55bb0cac8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 shutdown_connections 2023-12-14T18:29:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.397+0000 7f349fd50b80 1 -- 172.21.15.69:0/1647420947 wait complete. 2023-12-14T18:29:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.398+0000 7f349fd50b80 20 client.15924 trim_cache size 0 max 16384 2023-12-14T18:29:59.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 Processor -- start 2023-12-14T18:29:59.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 -- start start 2023-12-14T18:29:59.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cad3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cad0d00 0x55bb0cae05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0cad8670 con 0x55bb0cacf500 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0cad0980 con 0x55bb0cacfe50 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.410+0000 7f349fd50b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0cae22b0 con 0x55bb0cad0d00 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cad3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cad3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48328/0 (socket says 172.21.15.69:48328) 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 -- 172.21.15.69:0/3539770013 learned_addr learned my addr 172.21.15.69:0/3539770013 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349115d700 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 -- 172.21.15.69:0/3539770013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cad0d00 msgr2=0x55bb0cae05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349215f700 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cad0d00 0x55bb0cae05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cad0d00 0x55bb0cae05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 -- 172.21.15.69:0/3539770013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 msgr2=0x55bb0cad4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 -- 172.21.15.69:0/3539770013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0c9e6ec0 con 0x55bb0cacf500 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349115d700 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f349195e700 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cad3c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f347c00efd0 tx=0x7f347c09a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01ffcc20799bc0d server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f3480dac700 1 -- 172.21.15.69:0/3539770013 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0c8070 con 0x55bb0cacf500 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f3480dac700 1 -- 172.21.15.69:0/3539770013 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f347c097fe0 con 0x55bb0cacf500 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.411+0000 7f3480dac700 1 -- 172.21.15.69:0/3539770013 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0a1e60 con 0x55bb0cacf500 2023-12-14T18:29:59.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 -- 172.21.15.69:0/3539770013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 msgr2=0x55bb0cad3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cad3c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f347c00efd0 tx=0x7f347c09a100 comp rx=0 tx=0).stop 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 -- 172.21.15.69:0/3539770013 shutdown_connections 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cad0d00 0x55bb0cae05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacf500 0x55bb0cad3c40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 --2- 172.21.15.69:0/3539770013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cacfe50 0x55bb0cad4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 -- 172.21.15.69:0/3539770013 >> 172.21.15.69:0/3539770013 conn(0x55bb0cac4ca0 msgr2=0x55bb0cad7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 -- 172.21.15.69:0/3539770013 shutdown_connections 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 -- 172.21.15.69:0/3539770013 wait complete. 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 -- start start 2023-12-14T18:29:59.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.412+0000 7f349fd50b80 1 Processor -- start 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cadc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 0x55bb0cadcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cadfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0cadff90 con 0x55bb0cacfe50 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0cae0100 con 0x55bb0cad0d00 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0cae02c0 con 0x55bb0cacf500 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 10 client.0 _ll_register_callbacks cb 0x7f3484009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 0x55bb0cadcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 0x55bb0cadcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48344/0 (socket says 172.21.15.69:48344) 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 -- 172.21.15.69:0/267016786 learned_addr learned my addr 172.21.15.69:0/267016786 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349195e700 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cadc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 -- 172.21.15.69:0/267016786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 msgr2=0x55bb0cadc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cadc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 -- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 msgr2=0x55bb0cadfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cadfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 -- 172.21.15.69:0/267016786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c0b6040 con 0x55bb0cacfe50 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349115d700 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 0x55bb0cadcd30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f34880116c0 tx=0x7f34880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a132a48c82da28a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f34757fa700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-12-14T18:29:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f34757fa700 1 -- 172.21.15.69:0/267016786 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488024070 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f34757fa700 1 -- 172.21.15.69:0/267016786 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3488017070 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f347c098240 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f34757fa700 1 -- 172.21.15.69:0/267016786 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f348801e630 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 10 client.15930 fetch_fsmap learned FSMap version 27 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.413+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bb0c9cd9a0 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f34757fa700 1 -- 172.21.15.69:0/267016786 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f347c098240 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f34757fa700 1 -- 172.21.15.69:0/267016786 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3488029730 con 0x55bb0cacfe50 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349fd50b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 27 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349fd50b80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-14T18:29:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349fd50b80 20 client.15930 populate_metadata read hostname 'smithi069' 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349fd50b80 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cb39e30 0x55bb0cb3c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349fd50b80 4 client.15930 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 --> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bb0ca19a00 con 0x55bb0cb39e30 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349195e700 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cb39e30 0x55bb0cb3c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f34757fa700 10 client.15930 ms_handle_connect on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f349195e700 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cb39e30 0x55bb0cb3c240 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18769d0bc4a6e437 server_cookie=b80ac389352eac38 in_seq=0 out_seq=0 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f34757fa700 1 -- 172.21.15.69:0/267016786 <== mds.0 v2:172.21.15.91:6838/311589557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bb0ca19a00 con 0x55bb0cb39e30 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.414+0000 7f34757fa700 10 client.15930 handle_command_reply: tid=0 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 client.15930 shutdown 2023-12-14T18:29:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 msgr2=0x55bb0cadcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 0x55bb0cadcd30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f34880116c0 tx=0x7f34880047c0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 shutdown_connections 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:6838/311589557,v1:172.21.15.91:6839/311589557] conn(0x55bb0cb39e30 0x55bb0cb3c240 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb0cad0d00 0x55bb0cadfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0cacf500 0x55bb0cadc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 --2- 172.21.15.69:0/267016786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0cacfe50 0x55bb0cadcd30 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f34757fa700 0 client.15930 ms_handle_reset on v2:172.21.15.91:6838/311589557 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 >> 172.21.15.69:0/267016786 conn(0x55bb0cac4ca0 msgr2=0x55bb0cad3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 shutdown_connections 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 1 -- 172.21.15.69:0/267016786 wait complete. 2023-12-14T18:29:59.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f349fd50b80 20 client.15930 trim_cache size 0 max 16384 2023-12-14T18:29:59.425 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34780a1150 msgr2=0x7f34780a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34780a1150 0x7f34780a3600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3488005950 tx=0x7f348800b410 comp rx=0 tx=0).stop 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 msgr2=0x7f348c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 0x7f348c068940 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e970 tx=0x7f347c00ec80 comp rx=0 tx=0).stop 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 shutdown_connections 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f34780a1150 0x7f34780a3600 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f348c100ca0 0x7f348c19d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f348c0ff120 0x7f348c068940 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 --2- 172.21.15.69:0/2985720801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f348c100310 0x7f348c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:29:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 >> 172.21.15.69:0/2985720801 conn(0x7f348c0fa740 msgr2=0x7f348c0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:29:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 shutdown_connections 2023-12-14T18:29:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:29:59.415+0000 7f3493bc2700 1 -- 172.21.15.69:0/2985720801 wait complete. 2023-12-14T18:29:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:59 smithi119 ceph-mon[43973]: pgmap v417: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-14T18:29:59.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:29:59 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3279253009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:29:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:59 smithi091 ceph-mon[43601]: pgmap v417: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-14T18:29:59.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:29:59 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3279253009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:29:59.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:59 smithi069 ceph-mon[42047]: pgmap v417: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-14T18:30:00.074 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:29:59 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3279253009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:00.429 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2023-12-14T18:30:00.429 INFO:tasks.fwd_scrub:done joining 2023-12-14T18:30:00.429 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-12-14T18:30:00.439 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:30:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 -- 172.21.15.69:0/2481711697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e80ff160 msgr2=0x7f78e80ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 --2- 172.21.15.69:0/2481711697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e80ff160 0x7f78e80ff570 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009990 tx=0x7f78d8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 -- 172.21.15.69:0/2481711697 shutdown_connections 2023-12-14T18:30:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 --2- 172.21.15.69:0/2481711697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e8100ce0 0x7f78e81075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 --2- 172.21.15.69:0/2481711697 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e80ff160 0x7f78e80ff570 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 --2- 172.21.15.69:0/2481711697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e8100350 0x7f78e81007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 -- 172.21.15.69:0/2481711697 >> 172.21.15.69:0/2481711697 conn(0x7f78e80fa780 msgr2=0x7f78e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:00.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 -- 172.21.15.69:0/2481711697 shutdown_connections 2023-12-14T18:30:00.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.567+0000 7f78ee379700 1 -- 172.21.15.69:0/2481711697 wait complete. 2023-12-14T18:30:00.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 Processor -- start 2023-12-14T18:30:00.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 -- start start 2023-12-14T18:30:00.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e80ff160 0x7f78e8198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 0x7f78e8198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e8100ce0 0x7f78e819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e819fc90 con 0x7f78e8100350 2023-12-14T18:30:00.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e819fdd0 con 0x7f78e80ff160 2023-12-14T18:30:00.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.568+0000 7f78ee379700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e819ff60 con 0x7f78e8100ce0 2023-12-14T18:30:00.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 0x7f78e8198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 0x7f78e8198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48370/0 (socket says 172.21.15.69:48370) 2023-12-14T18:30:00.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 -- 172.21.15.69:0/4070892482 learned_addr learned my addr 172.21.15.69:0/4070892482 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:00.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e7fff700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e80ff160 0x7f78e8198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78ec916700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e8100ce0 0x7f78e819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 -- 172.21.15.69:0/4070892482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e8100ce0 msgr2=0x7f78e819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e8100ce0 0x7f78e819f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 -- 172.21.15.69:0/4070892482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e80ff160 msgr2=0x7f78e8198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e80ff160 0x7f78e8198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 -- 172.21.15.69:0/4070892482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80095f0 con 0x7f78e8100350 2023-12-14T18:30:00.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e77fe700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 0x7f78e8198650 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00d950 tx=0x7f78dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00f890 con 0x7f78e8100350 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e810a980 con 0x7f78e8100350 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78dc00fe80 con 0x7f78e8100350 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00e3b0 con 0x7f78e8100350 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.569+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e810a7f0 con 0x7f78e8100350 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.570+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8067e40 con 0x7f78e8100350 2023-12-14T18:30:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.571+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f78dc010460 con 0x7f78e8100350 2023-12-14T18:30:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.572+0000 7f78e57fa700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f78d00a11d0 0x7f78d00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.572+0000 7f78e7fff700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f78d00a11d0 0x7f78d00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.572+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f78dc0cc6d0 con 0x7f78e8100350 2023-12-14T18:30:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.572+0000 7f78e7fff700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f78d00a11d0 0x7f78d00a3680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f78d800b5c0 tx=0x7f78d8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.575+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f78dc095dd0 con 0x7f78e8100350 2023-12-14T18:30:00.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.764+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78e81a0b60 con 0x7f78e8100350 2023-12-14T18:30:00.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.765+0000 7f78e57fa700 1 -- 172.21.15.69:0/4070892482 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f78dc016090 con 0x7f78e8100350 2023-12-14T18:30:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:00.768 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.767+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f78d00a11d0 msgr2=0x7f78d00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.767+0000 7f78ee379700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f78d00a11d0 0x7f78d00a3680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f78d800b5c0 tx=0x7f78d8005960 comp rx=0 tx=0).stop 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.767+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 msgr2=0x7f78e8198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.767+0000 7f78ee379700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 0x7f78e8198650 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00d950 tx=0x7f78dc00dc60 comp rx=0 tx=0).stop 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 shutdown_connections 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f78d00a11d0 0x7f78d00a3680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e8100ce0 0x7f78e819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e80ff160 0x7f78e8198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 --2- 172.21.15.69:0/4070892482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78e8100350 0x7f78e8198650 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 >> 172.21.15.69:0/4070892482 conn(0x7f78e80fa780 msgr2=0x7f78e8068fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:00.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 shutdown_connections 2023-12-14T18:30:00.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.768+0000 7f78ee379700 1 -- 172.21.15.69:0/4070892482 wait complete. 2023-12-14T18:30:00.781 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:00 smithi069 ceph-mon[42047]: overall HEALTH_OK 2023-12-14T18:30:00.782 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:30:00.783 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:30:00.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:00 smithi119 ceph-mon[43973]: overall HEALTH_OK 2023-12-14T18:30:00.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:00 smithi091 ceph-mon[43601]: overall HEALTH_OK 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.907+0000 7f08d2502700 1 -- 172.21.15.69:0/1360826173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc0ff120 msgr2=0x7f08cc0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.907+0000 7f08d2502700 1 --2- 172.21.15.69:0/1360826173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc0ff120 0x7f08cc0ff530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009990 tx=0x7f08bc009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 -- 172.21.15.69:0/1360826173 shutdown_connections 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 --2- 172.21.15.69:0/1360826173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc100ca0 0x7f08cc107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 --2- 172.21.15.69:0/1360826173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc0ff120 0x7f08cc0ff530 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 --2- 172.21.15.69:0/1360826173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 0x7f08cc100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 -- 172.21.15.69:0/1360826173 >> 172.21.15.69:0/1360826173 conn(0x7f08cc0fa740 msgr2=0x7f08cc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:00.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 -- 172.21.15.69:0/1360826173 shutdown_connections 2023-12-14T18:30:00.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 -- 172.21.15.69:0/1360826173 wait complete. 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 Processor -- start 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.908+0000 7f08d2502700 1 -- start start 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d2502700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc0ff120 0x7f08cc195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d2502700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 0x7f08cc1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d2502700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 0x7f08cc19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d2502700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc19db30 con 0x7f08cc100ca0 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d2502700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc19dc70 con 0x7f08cc100310 2023-12-14T18:30:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d2502700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc19de00 con 0x7f08cc0ff120 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 0x7f08cc19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08cb7fe700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 0x7f08cc1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 0x7f08cc19d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48396/0 (socket says 172.21.15.69:48396) 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 -- 172.21.15.69:0/2459929001 learned_addr learned my addr 172.21.15.69:0/2459929001 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08cbfff700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc0ff120 0x7f08cc195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 -- 172.21.15.69:0/2459929001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc0ff120 msgr2=0x7f08cc195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc0ff120 0x7f08cc195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 -- 172.21.15.69:0/2459929001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 msgr2=0x7f08cc1964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 0x7f08cc1964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 -- 172.21.15.69:0/2459929001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0095f0 con 0x7f08cc100ca0 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08cb7fe700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 0x7f08cc1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08cbfff700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc0ff120 0x7f08cc195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.909+0000 7f08d0a9f700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 0x7f08cc19d560 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f08c400ef30 tx=0x7f08c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.910+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4018070 con 0x7f08cc100ca0 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.910+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08c400f040 con 0x7f08cc100ca0 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.910+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc10a940 con 0x7f08cc100ca0 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.910+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400cbc0 con 0x7f08cc100ca0 2023-12-14T18:30:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.910+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc10a7b0 con 0x7f08cc100ca0 2023-12-14T18:30:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.911+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc19e440 con 0x7f08cc100ca0 2023-12-14T18:30:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.912+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f08c4007500 con 0x7f08cc100ca0 2023-12-14T18:30:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.912+0000 7f08c97fa700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f08b40a1150 0x7f08b40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.913+0000 7f08cbfff700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f08b40a1150 0x7f08b40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.913+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08c40cc350 con 0x7f08cc100ca0 2023-12-14T18:30:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.913+0000 7f08cbfff700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f08b40a1150 0x7f08b40a3600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006010 tx=0x7f08bc00b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:00.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:00.917+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f08c4095b40 con 0x7f08cc100ca0 2023-12-14T18:30:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.104+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08cc19e9f0 con 0x7f08cc100ca0 2023-12-14T18:30:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.104+0000 7f08c97fa700 1 -- 172.21.15.69:0/2459929001 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08c4099160 con 0x7f08cc100ca0 2023-12-14T18:30:01.107 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:30:01.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f08b40a1150 msgr2=0x7f08b40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f08b40a1150 0x7f08b40a3600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006010 tx=0x7f08bc00b2a0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 msgr2=0x7f08cc19d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 0x7f08cc19d560 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f08c400ef30 tx=0x7f08c400c3a0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 shutdown_connections 2023-12-14T18:30:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f08b40a1150 0x7f08b40a3600 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08cc100ca0 0x7f08cc19d560 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08cc0ff120 0x7f08cc195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 --2- 172.21.15.69:0/2459929001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08cc100310 0x7f08cc1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 >> 172.21.15.69:0/2459929001 conn(0x7f08cc0fa740 msgr2=0x7f08cc067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 shutdown_connections 2023-12-14T18:30:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.106+0000 7f08d2502700 1 -- 172.21.15.69:0/2459929001 wait complete. 2023-12-14T18:30:01.121 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:30:01.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 -- 172.21.15.69:0/2964681179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100ca0 msgr2=0x7fc8dc107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/2964681179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100ca0 0x7fc8dc107560 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400b0a0 tx=0x7fc8d400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 -- 172.21.15.69:0/2964681179 shutdown_connections 2023-12-14T18:30:01.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/2964681179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100ca0 0x7fc8dc107560 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/2964681179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc0ff120 0x7fc8dc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/2964681179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8dc100310 0x7fc8dc100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 -- 172.21.15.69:0/2964681179 >> 172.21.15.69:0/2964681179 conn(0x7fc8dc0fa740 msgr2=0x7fc8dc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 -- 172.21.15.69:0/2964681179 shutdown_connections 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.244+0000 7fc8e30f7700 1 -- 172.21.15.69:0/2964681179 wait complete. 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 Processor -- start 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 -- start start 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc0ff120 0x7fc8dc196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 0x7fc8dc196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8dc100ca0 0x7fc8dc19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19db90 con 0x7fc8dc100310 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19dcd0 con 0x7fc8dc100ca0 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e30f7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19de60 con 0x7fc8dc0ff120 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 0x7fc8dc196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 0x7fc8dc196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48402/0 (socket says 172.21.15.69:48402) 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 -- 172.21.15.69:0/1997619456 learned_addr learned my addr 172.21.15.69:0/1997619456 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e0e93700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc0ff120 0x7fc8dc196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8e1694700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8dc100ca0 0x7fc8dc19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 -- 172.21.15.69:0/1997619456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc0ff120 msgr2=0x7fc8dc196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc0ff120 0x7fc8dc196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 -- 172.21.15.69:0/1997619456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8dc100ca0 msgr2=0x7fc8dc19d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8dc100ca0 0x7fc8dc19d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 -- 172.21.15.69:0/1997619456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4009d00 con 0x7fc8dc100310 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8dbfff700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 0x7fc8dc196550 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d950 tx=0x7fc8c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800f890 con 0x7fc8dc100310 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.245+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8c800fe80 con 0x7fc8dc100310 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.246+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc10a990 con 0x7fc8dc100310 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.246+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800e3b0 con 0x7fc8dc100310 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.246+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc10a800 con 0x7fc8dc100310 2023-12-14T18:30:01.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.247+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc19e5a0 con 0x7fc8dc100310 2023-12-14T18:30:01.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.247+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc8c8010460 con 0x7fc8dc100310 2023-12-14T18:30:01.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.248+0000 7fc8d9ffb700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc8cc0a11d0 0x7fc8cc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.248+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc8c80cc6c0 con 0x7fc8dc100310 2023-12-14T18:30:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.248+0000 7fc8e0e93700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc8cc0a11d0 0x7fc8cc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.248+0000 7fc8e0e93700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc8cc0a11d0 0x7fc8cc0a3680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc100170 tx=0x7fc8d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.252+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc8c8095dc0 con 0x7fc8dc100310 2023-12-14T18:30:01.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.446+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8dc19eb50 con 0x7fc8dc100310 2023-12-14T18:30:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.447+0000 7fc8d9ffb700 1 -- 172.21.15.69:0/1997619456 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8c80993e0 con 0x7fc8dc100310 2023-12-14T18:30:01.449 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:30:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc8cc0a11d0 msgr2=0x7fc8cc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc8cc0a11d0 0x7fc8cc0a3680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc100170 tx=0x7fc8d000b410 comp rx=0 tx=0).stop 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 msgr2=0x7fc8dc196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 0x7fc8dc196550 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d950 tx=0x7fc8c800dc60 comp rx=0 tx=0).stop 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 shutdown_connections 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fc8cc0a11d0 0x7fc8cc0a3680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8dc100ca0 0x7fc8dc19d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc0ff120 0x7fc8dc196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 --2- 172.21.15.69:0/1997619456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8dc100310 0x7fc8dc196550 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 >> 172.21.15.69:0/1997619456 conn(0x7fc8dc0fa740 msgr2=0x7fc8dc067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:01.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 shutdown_connections 2023-12-14T18:30:01.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.449+0000 7fc8e30f7700 1 -- 172.21.15.69:0/1997619456 wait complete. 2023-12-14T18:30:01.463 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:30:01.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 -- 172.21.15.69:0/916699266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee8100410 msgr2=0x7f3ee8106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/916699266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee8100410 0x7f3ee8106cd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c210 tx=0x7f3ee000c520 comp rx=0 tx=0).stop 2023-12-14T18:30:01.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 -- 172.21.15.69:0/916699266 shutdown_connections 2023-12-14T18:30:01.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/916699266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee8100410 0x7f3ee8106cd0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/916699266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ee80fe890 0x7f3ee80feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/916699266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ee80ffa80 0x7f3ee80ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 -- 172.21.15.69:0/916699266 >> 172.21.15.69:0/916699266 conn(0x7f3ee80f9ed0 msgr2=0x7f3ee80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 -- 172.21.15.69:0/916699266 shutdown_connections 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 -- 172.21.15.69:0/916699266 wait complete. 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 Processor -- start 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 -- start start 2023-12-14T18:30:01.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.588+0000 7f3eeeb84700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ee80fe890 0x7f3ee8196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eeeb84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 0x7f3ee8196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eeeb84700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ee8100410 0x7f3ee819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eeeb84700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee819dba0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eeeb84700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee819dce0 con 0x7f3ee8100410 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eeeb84700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee819de70 con 0x7f3ee80fe890 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 0x7f3ee8196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 0x7f3ee8196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48430/0 (socket says 172.21.15.69:48430) 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 -- 172.21.15.69:0/1997636380 learned_addr learned my addr 172.21.15.69:0/1997636380 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eec920700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ee80fe890 0x7f3ee8196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eed121700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ee8100410 0x7f3ee819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 -- 172.21.15.69:0/1997636380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ee80fe890 msgr2=0x7f3ee8196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ee80fe890 0x7f3ee8196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 -- 172.21.15.69:0/1997636380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ee8100410 msgr2=0x7f3ee819d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ee8100410 0x7f3ee819d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 -- 172.21.15.69:0/1997636380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee000ae10 con 0x7f3ee80ffa80 2023-12-14T18:30:01.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee7fff700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 0x7f3ee8196560 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400c9b0 tx=0x7f3ed400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:01.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4007b00 con 0x7f3ee80ffa80 2023-12-14T18:30:01.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee8109880 con 0x7f3ee80ffa80 2023-12-14T18:30:01.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ed400a5f0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.589+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40052a0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.590+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee81096f0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.590+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee819e610 con 0x7f3ee80ffa80 2023-12-14T18:30:01.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.591+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3ed4005460 con 0x7f3ee80ffa80 2023-12-14T18:30:01.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.592+0000 7f3ee5ffb700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ed80a11d0 0x7f3ed80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.592+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3ed40cc8e0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.592+0000 7f3eec920700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ed80a11d0 0x7f3ed80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.592+0000 7f3eec920700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ed80a11d0 0x7f3ed80a3680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80ff8e0 tx=0x7f3edc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:01.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.596+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3ed4095fe0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.788+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ee819ebc0 con 0x7f3ee80ffa80 2023-12-14T18:30:01.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.788+0000 7f3ee5ffb700 1 -- 172.21.15.69:0/1997636380 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ed4099600 con 0x7f3ee80ffa80 2023-12-14T18:30:01.791 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:30:01.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ed80a11d0 msgr2=0x7f3ed80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ed80a11d0 0x7f3ed80a3680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80ff8e0 tx=0x7f3edc00b410 comp rx=0 tx=0).stop 2023-12-14T18:30:01.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 msgr2=0x7f3ee8196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 0x7f3ee8196560 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400c9b0 tx=0x7f3ed400ccc0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 shutdown_connections 2023-12-14T18:30:01.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f3ed80a11d0 0x7f3ed80a3680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ee8100410 0x7f3ee819d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ee80fe890 0x7f3ee8196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 --2- 172.21.15.69:0/1997636380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ee80ffa80 0x7f3ee8196560 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 >> 172.21.15.69:0/1997636380 conn(0x7f3ee80f9ed0 msgr2=0x7f3ee8105120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:01.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 shutdown_connections 2023-12-14T18:30:01.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.790+0000 7f3eeeb84700 1 -- 172.21.15.69:0/1997636380 wait complete. 2023-12-14T18:30:01.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:01 smithi069 ceph-mon[42047]: pgmap v418: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-14T18:30:01.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:01 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/4070892482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:01.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:01 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2459929001' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:01.805 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:01 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1997619456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:01.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-12-14T18:30:01.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:01 smithi119 ceph-mon[43973]: pgmap v418: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-14T18:30:01.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:01 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/4070892482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:01.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:01 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2459929001' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:01.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:01 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1997619456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:01 smithi091 ceph-mon[43601]: pgmap v418: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-14T18:30:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:01 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/4070892482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:01 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2459929001' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:01.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:01 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1997619456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:01.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 -- 172.21.15.69:0/3439538127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94101430 msgr2=0x7fef94101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3439538127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94101430 0x7fef94101880 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fef90009990 tx=0x7fef90009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 -- 172.21.15.69:0/3439538127 shutdown_connections 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3439538127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef94101dc0 0x7fef94108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3439538127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94100240 0x7fef94100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3439538127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94101430 0x7fef94101880 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 -- 172.21.15.69:0/3439538127 >> 172.21.15.69:0/3439538127 conn(0x7fef940fb820 msgr2=0x7fef940fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 -- 172.21.15.69:0/3439538127 shutdown_connections 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.926+0000 7fef9c55c700 1 -- 172.21.15.69:0/3439538127 wait complete. 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 Processor -- start 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 -- start start 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 0x7fef94195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94101430 0x7fef941964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef94101dc0 0x7fef9419d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9419db10 con 0x7fef94100240 2023-12-14T18:30:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9419dc50 con 0x7fef94101dc0 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9c55c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9419dde0 con 0x7fef94101430 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 0x7fef94195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 0x7fef94195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48444/0 (socket says 172.21.15.69:48444) 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 -- 172.21.15.69:0/3359203367 learned_addr learned my addr 172.21.15.69:0/3359203367 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9aaf9700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef94101dc0 0x7fef9419d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef99af7700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94101430 0x7fef941964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 -- 172.21.15.69:0/3359203367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94101430 msgr2=0x7fef941964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94101430 0x7fef941964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 -- 172.21.15.69:0/3359203367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef94101dc0 msgr2=0x7fef9419d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef94101dc0 0x7fef9419d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 -- 172.21.15.69:0/3359203367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900095f0 con 0x7fef94100240 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef99af7700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94101430 0x7fef941964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.927+0000 7fef9a2f8700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 0x7fef94195f90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef8400e970 tx=0x7fef8400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.928+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84009790 con 0x7fef94100240 2023-12-14T18:30:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.928+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9410bab0 con 0x7fef94100240 2023-12-14T18:30:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.928+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9410b920 con 0x7fef94100240 2023-12-14T18:30:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.928+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef8400eec0 con 0x7fef94100240 2023-12-14T18:30:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.928+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84003ba0 con 0x7fef94100240 2023-12-14T18:30:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.929+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef78005320 con 0x7fef94100240 2023-12-14T18:30:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.930+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fef84003d20 con 0x7fef94100240 2023-12-14T18:30:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.930+0000 7fef8b7fe700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef800a1150 0x7fef800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.930+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fef84014070 con 0x7fef94100240 2023-12-14T18:30:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.930+0000 7fef99af7700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef800a1150 0x7fef800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.931+0000 7fef99af7700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef800a1150 0x7fef800a3600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef900098e0 tx=0x7fef90004740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:01.934+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fef840964a0 con 0x7fef94100240 2023-12-14T18:30:02.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.182+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fef78005190 con 0x7fef94100240 2023-12-14T18:30:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.190+0000 7fef8b7fe700 1 -- 172.21.15.69:0/3359203367 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733243 (secure 0 0 0) 0x7fef84099ac0 con 0x7fef94100240 2023-12-14T18:30:02.206 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:02.206 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:30:02.206 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 18, 2023-12-14T18:30:02.206 INFO:teuthology.orchestra.run.smithi069.stdout: "active_gid": 14152, 2023-12-14T18:30:02.206 INFO:teuthology.orchestra.run.smithi069.stdout: "active_name": "x", 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addrs": { 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6800", 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4294204545 2023-12-14T18:30:02.207 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6801", 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4294204545 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:02.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.209 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addr": "172.21.15.69:6801/4294204545", 2023-12-14T18:30:02.209 INFO:teuthology.orchestra.run.smithi069.stdout: "active_change": "2023-12-14T18:18:26.173905+0000", 2023-12-14T18:30:02.209 INFO:teuthology.orchestra.run.smithi069.stdout: "active_mgr_features": 4540138322906710015, 2023-12-14T18:30:02.209 INFO:teuthology.orchestra.run.smithi069.stdout: "available": true, 2023-12-14T18:30:02.209 INFO:teuthology.orchestra.run.smithi069.stdout: "standbys": [ 2023-12-14T18:30:02.209 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 24109, 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "z", 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540138322906710015, 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.210 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.211 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.214 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.216 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.217 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.218 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.219 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.220 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.221 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.222 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.223 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-12-14T18:30:02.224 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.225 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-12-14T18:30:02.226 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-12-14T18:30:02.227 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.228 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.229 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.230 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.232 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.233 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.233 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-12-14T18:30:02.233 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.233 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.233 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.234 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-12-14T18:30:02.235 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.238 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.240 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.241 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.242 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.243 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-12-14T18:30:02.244 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-12-14T18:30:02.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-14T18:30:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.247 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-14T18:30:02.248 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.249 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.250 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.252 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.253 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.254 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.257 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.258 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.259 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-12-14T18:30:02.261 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.262 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.263 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-12-14T18:30:02.264 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-12-14T18:30:02.265 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.266 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:02.267 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.268 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.269 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.270 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.271 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.272 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.273 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.274 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.275 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.276 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.277 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_password": { 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_password", 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.278 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web password", 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.279 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_user": { 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_user", 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.280 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web user", 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-12-14T18:30:02.281 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.282 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.284 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.285 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.286 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.287 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.288 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-12-14T18:30:02.289 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-14T18:30:02.290 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.291 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-12-14T18:30:02.292 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.293 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-12-14T18:30:02.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-12-14T18:30:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.299 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.300 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.301 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2023-12-14T18:30:02.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.303 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.304 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-12-14T18:30:02.305 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-12-14T18:30:02.306 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.307 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.308 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.310 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.311 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-12-14T18:30:02.312 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.313 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-12-14T18:30:02.314 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.315 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-12-14T18:30:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.329 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.330 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.331 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.332 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.333 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.334 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.335 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.336 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.337 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-12-14T18:30:02.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.340 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.342 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-14T18:30:02.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_password": { 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_password", 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web password", 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_user": { 2023-12-14T18:30:02.345 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_user", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web user", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.346 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.347 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.350 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.351 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2023-12-14T18:30:02.352 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-14T18:30:02.353 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.355 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.356 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-12-14T18:30:02.358 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.360 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.361 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.362 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.363 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.364 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.365 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.368 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.369 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.370 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.371 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.372 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.373 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.374 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.375 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-12-14T18:30:02.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.377 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-12-14T18:30:02.379 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.380 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.383 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-14T18:30:02.386 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.387 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.388 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-14T18:30:02.389 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.390 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.391 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.392 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-12-14T18:30:02.395 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.396 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.397 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-12-14T18:30:02.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.399 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.400 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.401 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.402 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-14T18:30:02.405 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.406 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.407 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-14T18:30:02.408 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.409 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.411 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.412 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.413 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.414 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-14T18:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.416 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-14T18:30:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.419 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.420 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-14T18:30:02.422 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.423 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.429 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.431 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.432 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.434 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.435 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-12-14T18:30:02.436 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-12-14T18:30:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.442 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.443 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.444 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.445 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.446 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.447 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.448 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.449 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.450 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-12-14T18:30:02.451 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.453 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:02.454 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.455 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.456 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.457 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.458 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-12-14T18:30:02.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.461 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.463 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.465 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.466 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.467 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.470 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.471 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.473 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.474 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.475 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.476 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.479 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-14T18:30:02.480 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-12-14T18:30:02.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.483 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.484 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.489 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.490 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.491 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T18:30:02.492 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-12-14T18:30:02.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-12-14T18:30:02.496 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-12-14T18:30:02.497 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-12-14T18:30:02.498 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.499 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.500 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.501 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.502 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.503 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.506 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.507 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.509 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.511 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.512 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.513 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-12-14T18:30:02.515 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.516 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.517 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.518 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.521 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.522 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.523 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.526 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.527 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.530 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.531 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.532 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.535 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.536 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.537 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.538 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.541 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.544 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-12-14T18:30:02.545 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.546 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.549 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.550 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.553 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-12-14T18:30:02.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.557 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.559 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-12-14T18:30:02.560 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.561 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.565 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-12-14T18:30:02.568 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.569 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.570 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.571 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.572 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.573 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.574 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.578 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.579 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T18:30:02.584 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.585 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.586 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.587 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.588 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.590 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.591 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.592 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.593 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.594 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.596 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.597 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.598 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.600 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.601 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.603 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.604 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.605 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.606 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.607 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.608 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-12-14T18:30:02.611 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.612 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.613 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.614 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.615 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.616 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.617 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.618 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "noautoscale": { 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "noautoscale", 2023-12-14T18:30:02.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "global autoscale flag", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.621 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.622 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.623 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-12-14T18:30:02.624 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.627 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.628 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.629 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.630 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.631 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.632 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.633 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.634 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.635 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-12-14T18:30:02.637 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.638 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2023-12-14T18:30:02.639 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-14T18:30:02.640 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.641 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.642 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.643 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.645 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.646 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.647 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-12-14T18:30:02.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.649 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-12-14T18:30:02.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.653 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.654 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-12-14T18:30:02.655 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.656 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.657 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T18:30:02.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.659 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.660 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.661 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.662 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.665 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.667 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.668 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.669 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.670 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.672 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.675 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.676 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.677 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.680 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.681 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:02.684 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.685 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.686 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.687 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.688 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.691 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-12-14T18:30:02.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.697 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.700 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.701 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.702 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.705 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.706 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.707 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.709 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.712 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.713 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.714 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.718 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.719 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-12-14T18:30:02.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.725 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-12-14T18:30:02.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.729 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-12-14T18:30:02.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.732 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.734 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.735 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.736 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.737 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.738 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.739 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.740 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.741 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.742 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.745 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.746 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.748 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.749 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.751 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.752 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.753 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.754 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.755 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.756 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.761 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.764 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.767 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.769 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.770 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.771 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.772 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-12-14T18:30:02.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.777 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.779 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:02.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.784 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.787 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.788 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.789 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.790 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.791 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.792 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-12-14T18:30:02.794 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.795 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.796 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.797 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.798 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.799 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.800 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.802 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.804 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T18:30:02.805 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.807 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.808 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.809 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.810 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.811 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-12-14T18:30:02.813 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-12-14T18:30:02.814 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.815 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-12-14T18:30:02.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.817 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.818 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.819 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.820 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.821 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.824 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.825 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.826 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.827 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-12-14T18:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-12-14T18:30:02.830 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.831 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 24116, 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "y", 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540138322906710015, 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-12-14T18:30:02.832 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.833 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.834 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.835 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.836 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-12-14T18:30:02.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.843 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.844 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.845 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-12-14T18:30:02.847 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.849 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-12-14T18:30:02.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.851 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.853 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.855 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-12-14T18:30:02.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-14T18:30:02.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-12-14T18:30:02.858 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-12-14T18:30:02.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.860 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-12-14T18:30:02.861 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-12-14T18:30:02.863 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.864 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.868 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.869 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.870 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.871 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-12-14T18:30:02.874 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.875 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:02.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.877 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.879 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.880 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-12-14T18:30:02.881 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.882 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.883 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.884 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.885 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_password": { 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_password", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web password", 2023-12-14T18:30:02.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_user": { 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_user", 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web user", 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-12-14T18:30:02.888 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.889 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.890 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.892 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-14T18:30:02.893 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-12-14T18:30:02.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.896 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.897 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.899 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2023-12-14T18:30:02.900 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-12-14T18:30:02.902 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.903 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.904 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.906 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2023-12-14T18:30:02.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.908 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.909 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.911 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.912 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.914 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-12-14T18:30:02.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.918 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.919 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-14T18:30:02.921 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-12-14T18:30:02.922 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-12-14T18:30:02.923 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.925 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.927 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.928 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.932 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.933 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.934 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.935 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-14T18:30:02.937 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.938 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.940 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.941 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-12-14T18:30:02.942 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.943 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.944 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.945 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_password": { 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_password", 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.946 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web password", 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.947 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_user": { 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_user", 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.948 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web user", 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-12-14T18:30:02.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.951 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.952 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.953 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.954 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.955 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.956 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.958 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.959 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.960 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.961 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-12-14T18:30:02.962 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.963 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-12-14T18:30:02.964 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:02.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.967 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.968 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.969 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:02.971 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.972 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-12-14T18:30:02.973 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.974 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-12-14T18:30:02.976 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.977 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-14T18:30:02.978 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.979 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.980 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.981 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.982 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.983 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.984 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-14T18:30:02.985 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.986 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.987 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.989 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.990 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.991 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-14T18:30:02.992 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.994 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.995 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-12-14T18:30:02.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.997 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:02.998 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-12-14T18:30:02.999 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.000 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.001 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.003 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.004 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.005 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.006 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.007 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.008 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.009 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.010 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.011 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.012 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-14T18:30:03.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.016 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.018 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-14T18:30:03.019 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.020 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.022 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.023 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.024 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.025 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.026 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.029 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.030 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.031 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.032 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.033 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.034 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.039 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.040 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-12-14T18:30:03.042 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-12-14T18:30:03.043 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T18:30:03.044 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.045 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.046 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.047 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.048 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.049 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.050 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.051 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.053 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.054 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.055 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.056 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.057 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T18:30:03.058 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.060 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.061 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.062 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T18:30:03.063 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.064 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.065 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-12-14T18:30:03.066 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.067 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.068 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.069 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.070 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.071 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.073 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.074 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.075 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-12-14T18:30:03.076 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-14T18:30:03.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.078 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-12-14T18:30:03.079 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.080 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.081 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.082 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.083 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.085 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.086 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.087 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.091 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.092 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.093 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.094 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.095 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.096 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.097 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.098 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-12-14T18:30:03.099 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-12-14T18:30:03.100 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.102 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:03.103 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.104 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.105 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.106 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.107 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.108 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.109 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.110 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.111 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.112 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.114 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.116 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:03.117 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-12-14T18:30:03.118 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.119 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-12-14T18:30:03.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.121 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.122 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.123 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.124 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.125 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.126 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.127 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.128 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.129 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.131 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.133 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.134 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.135 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.136 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.137 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2023-12-14T18:30:03.138 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.139 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2023-12-14T18:30:03.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.141 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.142 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.143 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.144 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.145 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.146 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.147 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.148 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-12-14T18:30:03.149 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.150 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.151 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.152 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.153 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.154 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.155 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.156 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.157 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.158 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.159 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.160 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-12-14T18:30:03.161 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-12-14T18:30:03.162 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.163 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-12-14T18:30:03.164 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.165 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.166 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.167 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.168 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.169 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.170 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.171 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.172 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.173 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.174 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.175 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.176 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.177 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.178 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.179 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.180 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.181 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-12-14T18:30:03.182 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.183 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.184 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.185 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.186 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.187 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.188 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.189 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T18:30:03.190 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.191 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.192 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.193 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.194 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.195 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.196 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.197 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.198 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.199 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.200 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.201 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.202 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.203 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.204 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.205 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.206 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.207 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.208 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.209 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.210 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.211 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.212 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.213 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.214 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.215 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.217 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.218 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.220 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.221 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.222 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.223 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.224 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "noautoscale": { 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "noautoscale", 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "global autoscale flag", 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.228 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-12-14T18:30:03.229 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.230 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.231 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T18:30:03.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.233 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.234 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.235 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.236 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.237 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.238 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.239 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.240 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.241 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.242 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-12-14T18:30:03.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.244 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.245 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.247 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.248 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.249 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.250 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.251 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.252 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.253 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.256 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.257 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.258 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.259 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.260 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.261 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.262 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.265 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T18:30:03.266 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.267 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.268 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T18:30:03.268 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.268 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.268 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.268 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.268 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.269 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.270 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.271 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.272 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.273 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.274 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-12-14T18:30:03.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.281 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-12-14T18:30:03.282 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.283 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.284 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.285 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.286 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.287 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.288 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.289 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.290 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.291 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.293 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:03.294 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:03.294 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.294 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.294 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.294 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.296 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.296 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.297 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.298 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.299 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.300 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.301 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.302 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.303 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.304 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.305 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.306 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.307 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.308 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.309 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.310 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.313 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.314 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.315 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.316 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.317 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-12-14T18:30:03.319 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.321 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.322 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.323 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.324 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.325 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.326 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.327 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.328 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-12-14T18:30:03.329 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.330 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-12-14T18:30:03.332 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.333 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.334 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.335 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.338 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.339 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-12-14T18:30:03.340 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.341 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.342 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-12-14T18:30:03.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.344 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.345 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.346 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-12-14T18:30:03.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.349 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.350 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.351 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.352 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.353 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.355 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.359 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.362 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.363 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.364 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.365 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.367 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.368 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.369 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.370 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.371 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.373 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.374 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-12-14T18:30:03.376 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-14T18:30:03.377 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:03.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.381 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.384 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.385 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.386 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.387 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.388 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.392 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.393 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.394 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.395 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.396 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.397 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-12-14T18:30:03.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.399 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-14T18:30:03.400 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.401 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.403 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.404 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-12-14T18:30:03.405 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-12-14T18:30:03.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.407 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.408 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.409 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.410 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.411 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.412 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.414 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.415 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.416 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-12-14T18:30:03.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.418 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.419 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.420 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.421 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-12-14T18:30:03.422 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.424 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.426 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.428 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.429 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.430 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.432 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.435 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.436 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.439 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.440 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.442 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.444 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.445 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:03.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.447 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.449 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.450 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.451 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.452 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.453 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.454 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.456 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.457 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.458 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.459 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: "modules": [ 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard", 2023-12-14T18:30:03.461 INFO:teuthology.orchestra.run.smithi069.stdout: "iostat", 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "nfs", 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "restful" 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.462 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.463 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.465 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.466 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.467 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.468 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.469 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-12-14T18:30:03.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.473 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.475 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-12-14T18:30:03.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-12-14T18:30:03.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-12-14T18:30:03.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-12-14T18:30:03.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.482 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.483 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.484 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.486 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.487 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-12-14T18:30:03.489 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T18:30:03.490 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-12-14T18:30:03.491 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-12-14T18:30:03.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.494 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.496 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:03.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.500 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.501 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.503 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.506 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.507 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.508 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-12-14T18:30:03.509 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.510 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.511 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:03.512 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-12-14T18:30:03.513 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.514 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:03.515 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.516 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.517 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.518 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-12-14T18:30:03.521 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_password": { 2023-12-14T18:30:03.522 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_password", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web password", 2023-12-14T18:30:03.523 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "alertmanager_web_user": { 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alertmanager_web_user", 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.524 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Alertmanager web user", 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.525 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.526 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-12-14T18:30:03.527 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.528 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-12-14T18:30:03.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-12-14T18:30:03.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-14T18:30:03.531 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.532 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.534 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-12-14T18:30:03.535 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.536 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-14T18:30:03.537 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2023-12-14T18:30:03.538 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.539 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-14T18:30:03.540 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.541 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.542 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.544 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.545 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2023-12-14T18:30:03.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2023-12-14T18:30:03.547 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.549 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.550 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.551 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.552 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-14T18:30:03.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.554 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.556 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.557 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.558 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.559 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.560 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.561 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.562 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.565 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-12-14T18:30:03.566 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-14T18:30:03.567 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.568 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.570 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.571 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.573 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.574 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.576 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.577 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.578 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.579 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.580 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.581 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.582 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.583 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.584 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.585 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.588 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.589 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.590 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.591 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.592 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.593 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_password": { 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_password", 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web password", 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_web_user": { 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_web_user", 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.596 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus web user", 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-12-14T18:30:03.597 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-14T18:30:03.598 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.599 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.600 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.601 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.602 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.604 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.605 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.606 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.607 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.608 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-12-14T18:30:03.609 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-14T18:30:03.610 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.611 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.612 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.613 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.614 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.616 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.617 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.618 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.619 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.620 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.621 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.622 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.623 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.624 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-12-14T18:30:03.627 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-14T18:30:03.628 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.630 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-14T18:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.633 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.634 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-12-14T18:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.642 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.643 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-14T18:30:03.644 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.646 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.647 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.648 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.649 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.650 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.651 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-14T18:30:03.652 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-14T18:30:03.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.655 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.656 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.657 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.658 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-14T18:30:03.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.660 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.662 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.664 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.666 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.667 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.668 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.671 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-14T18:30:03.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.674 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-14T18:30:03.675 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.676 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.677 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.679 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.680 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.681 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.683 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.684 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-14T18:30:03.686 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-14T18:30:03.688 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.689 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.690 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.691 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.695 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-12-14T18:30:03.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.698 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-14T18:30:03.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.700 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.701 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.702 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-14T18:30:03.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.705 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.708 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.708 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-12-14T18:30:03.710 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.711 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.712 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.714 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.716 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.717 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.723 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-12-14T18:30:03.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-12-14T18:30:03.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:03.731 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T18:30:03.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.737 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T18:30:03.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.739 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.740 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.741 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-12-14T18:30:03.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.744 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.745 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.749 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-12-14T18:30:03.754 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.756 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-12-14T18:30:03.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.764 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.765 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.766 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.767 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.769 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-12-14T18:30:03.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.775 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.777 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.778 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-12-14T18:30:03.779 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-12-14T18:30:03.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-14T18:30:03.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-12-14T18:30:03.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.787 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.788 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.789 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.790 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.791 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.792 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.794 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.795 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-12-14T18:30:03.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.797 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.797 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-12-14T18:30:03.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-12-14T18:30:03.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-12-14T18:30:03.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.805 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.811 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.813 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-12-14T18:30:03.814 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.816 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.817 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.818 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.819 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.820 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.821 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2023-12-14T18:30:03.823 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.824 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.825 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.827 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.832 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-12-14T18:30:03.835 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-12-14T18:30:03.836 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.837 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.838 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.841 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.842 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.843 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.845 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.846 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.846 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.846 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-12-14T18:30:03.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-12-14T18:30:03.846 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-12-14T18:30:03.847 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.851 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.852 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.853 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.854 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.856 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.857 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.858 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.860 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.861 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.862 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.863 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.864 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.865 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.866 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.867 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.868 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.869 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.870 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.871 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.872 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.874 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.875 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.876 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.877 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.878 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.879 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.880 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.881 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2023-12-14T18:30:03.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.883 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.884 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.885 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.889 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.890 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-12-14T18:30:03.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.893 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.894 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.896 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.898 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.899 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.900 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.901 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-12-14T18:30:03.903 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.905 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.906 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.908 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.910 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.910 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.910 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.910 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.912 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.912 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.912 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.912 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.912 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.915 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.916 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.919 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.920 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.921 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "noautoscale": { 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "noautoscale", 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.922 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "global autoscale flag", 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:03.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-12-14T18:30:03.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-12-14T18:30:03.926 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.927 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.929 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.930 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.933 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.934 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.935 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.936 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.937 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.939 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:03.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.941 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.942 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.943 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.944 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.945 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.946 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.947 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.948 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.950 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.951 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.952 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.953 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.954 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.955 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.956 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.957 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:03.958 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.959 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.960 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-12-14T18:30:03.961 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.962 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.963 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.964 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-12-14T18:30:03.965 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.966 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.967 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.968 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.969 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.970 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.971 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.972 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.974 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.975 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.976 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.977 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-12-14T18:30:03.978 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.980 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.981 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-12-14T18:30:03.982 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.983 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.984 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.985 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.986 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.987 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:03.988 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.989 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.990 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.991 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.992 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-12-14T18:30:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.994 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:03.995 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.996 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:03.997 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:03.998 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:03.999 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.000 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.001 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.004 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.005 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.006 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.007 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.008 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.009 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.010 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.011 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.012 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.013 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.014 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.015 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.016 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.017 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.018 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.019 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.020 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.021 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.022 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.023 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.024 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.025 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.026 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.027 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.028 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.029 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.030 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.031 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.032 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.033 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.034 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.037 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.038 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.039 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.040 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.041 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.042 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.043 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.044 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.045 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.046 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.047 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.049 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.050 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.051 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.052 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.053 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.054 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.055 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.056 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.057 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.058 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.059 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.060 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.061 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.062 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.063 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.064 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.065 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.066 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.067 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.068 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.069 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.070 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:04.071 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.072 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.073 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.074 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.075 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.076 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.077 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.078 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.080 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.081 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.082 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.083 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.084 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.085 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.086 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-14T18:30:04.087 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.088 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-12-14T18:30:04.089 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.090 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-12-14T18:30:04.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-12-14T18:30:04.094 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.095 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.096 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.097 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.099 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.100 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.101 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.102 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.103 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.104 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.105 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.107 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.108 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.110 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.111 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.112 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.113 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.114 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.115 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.116 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.117 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.118 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.119 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.120 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.121 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.122 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.123 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.124 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.126 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-12-14T18:30:04.127 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-12-14T18:30:04.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.129 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-12-14T18:30:04.130 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.131 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.132 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-12-14T18:30:04.133 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.134 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.136 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.137 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.138 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-12-14T18:30:04.139 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-12-14T18:30:04.140 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.141 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-12-14T18:30:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.144 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-12-14T18:30:04.145 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: "services": { 2023-12-14T18:30:04.146 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard": "https://172.21.15.69:8443/" 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "always_on_modules": { 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "octopus": [ 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T18:30:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "pacific": [ 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T18:30:04.148 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "quincy": [ 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T18:30:04.149 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "reef": [ 2023-12-14T18:30:04.150 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-12-14T18:30:04.151 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "last_failure_osd_epoch": 3, 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "active_clients": [ 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T18:30:04.152 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 346919526 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "libcephsqlite", 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T18:30:04.153 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2894623169 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T18:30:04.154 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3277684028 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-12-14T18:30:04.155 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-12-14T18:30:04.156 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1321641025 2023-12-14T18:30:04.156 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.156 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:04.156 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:04.156 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-12-14T18:30:04.156 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:30:04.158 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:02 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1997636380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:04.158 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:02 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3359203367' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-14T18:30:04.158 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:03 smithi091 ceph-mon[43601]: pgmap v419: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-14T18:30:04.158 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:02 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1997636380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:04.158 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:02 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3359203367' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-14T18:30:04.158 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:03 smithi119 ceph-mon[43973]: pgmap v419: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-14T18:30:04.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef800a1150 msgr2=0x7fef800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:04.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef800a1150 0x7fef800a3600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef900098e0 tx=0x7fef90004740 comp rx=0 tx=0).stop 2023-12-14T18:30:04.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 msgr2=0x7fef94195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:04.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 0x7fef94195f90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef8400e970 tx=0x7fef8400ec80 comp rx=0 tx=0).stop 2023-12-14T18:30:04.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 shutdown_connections 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef800a1150 0x7fef800a3600 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef94101dc0 0x7fef9419d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef94100240 0x7fef94195f90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 --2- 172.21.15.69:0/3359203367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef94101430 0x7fef941964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 >> 172.21.15.69:0/3359203367 conn(0x7fef940fb820 msgr2=0x7fef94104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 shutdown_connections 2023-12-14T18:30:04.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:02.195+0000 7fef9c55c700 1 -- 172.21.15.69:0/3359203367 wait complete. 2023-12-14T18:30:04.166 DEBUG:tasks.check_counter:Getting stats from a 2023-12-14T18:30:04.167 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.a perf dump 2023-12-14T18:30:04.167 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:02 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1997636380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:04.167 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:02 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3359203367' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-14T18:30:04.167 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:03 smithi069 ceph-mon[42047]: pgmap v419: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-14T18:30:04.489 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:30:05.560 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:30:05.561 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:05.561 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 4, 2023-12-14T18:30:05.561 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 4, 2023-12-14T18:30:05.561 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 2960, 2023-12-14T18:30:05.561 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 448, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001760373, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000044223, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000724323, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:05.562 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:05.563 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3, 2023-12-14T18:30:05.563 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000797074, 2023-12-14T18:30:05.563 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000265691 2023-12-14T18:30:05.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.563 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:05.563 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:05.564 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:05.564 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:05.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.564 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-12-14T18:30:05.564 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 448 2023-12-14T18:30:05.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.565 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:05.565 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1, 2023-12-14T18:30:05.565 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 84, 2023-12-14T18:30:05.565 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 160, 2023-12-14T18:30:05.565 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 90512, 2023-12-14T18:30:05.565 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 3, 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.006049165, 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.004118167, 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001186529, 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:05.566 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 82, 2023-12-14T18:30:05.567 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.002976287, 2023-12-14T18:30:05.567 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000036296 2023-12-14T18:30:05.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:05.567 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:05.567 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:05.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:05.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:05.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 90512 2023-12-14T18:30:05.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.568 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:05.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 113, 2023-12-14T18:30:05.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 110, 2023-12-14T18:30:05.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 441424, 2023-12-14T18:30:05.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 62208, 2023-12-14T18:30:05.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T18:30:05.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T18:30:05.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.015887518, 2023-12-14T18:30:05.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.005939346, 2023-12-14T18:30:05.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.008919649, 2023-12-14T18:30:05.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.002120832, 2023-12-14T18:30:05.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:05.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 109, 2023-12-14T18:30:05.571 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.004311967, 2023-12-14T18:30:05.571 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000039559 2023-12-14T18:30:05.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.571 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:05.571 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:05.571 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 441424, 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 62208 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T18:30:05.572 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:05.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:05.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:05.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:05.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:05.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:05.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:05.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:05.575 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:05.576 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:05.577 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:05.577 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:05.577 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:05.577 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:05.577 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:05.577 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:05.578 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148823, 2023-12-14T18:30:05.579 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 27, 2023-12-14T18:30:05.579 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:05.579 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:05.579 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T18:30:05.579 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T18:30:05.579 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:05.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:05.581 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:05.581 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T18:30:05.581 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T18:30:05.581 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T18:30:05.581 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:05.581 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T18:30:05.582 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 114, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 425471, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 114, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T18:30:05.583 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 114, 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 425471, 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:05.584 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:05.585 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:30:05.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:05 smithi069 ceph-mon[42047]: pgmap v420: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:05.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:05 smithi119 ceph-mon[43973]: pgmap v420: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:05.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:05 smithi091 ceph-mon[43601]: pgmap v420: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:05.932 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-12-14T18:30:05.932 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-12-14T18:30:05.932 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-12-14T18:30:05.932 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-12-14T18:30:05.932 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2023-12-14T18:30:05.932 DEBUG:tasks.check_counter:Getting stats from d 2023-12-14T18:30:05.933 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.d perf dump 2023-12-14T18:30:06.245 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:30:07.212 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:30:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 4, 2023-12-14T18:30:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 4, 2023-12-14T18:30:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 2960, 2023-12-14T18:30:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 448, 2023-12-14T18:30:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T18:30:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T18:30:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001758443, 2023-12-14T18:30:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000046542, 2023-12-14T18:30:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000704118, 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3, 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000929839, 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000309946 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-12-14T18:30:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 448 2023-12-14T18:30:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1, 2023-12-14T18:30:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 87, 2023-12-14T18:30:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 160, 2023-12-14T18:30:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 91040, 2023-12-14T18:30:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 3, 2023-12-14T18:30:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2023-12-14T18:30:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.005985565, 2023-12-14T18:30:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.004144368, 2023-12-14T18:30:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001088462, 2023-12-14T18:30:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 85, 2023-12-14T18:30:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.008205468, 2023-12-14T18:30:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000096534 2023-12-14T18:30:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 91040 2023-12-14T18:30:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 117, 2023-12-14T18:30:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 114, 2023-12-14T18:30:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 442512, 2023-12-14T18:30:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 64576, 2023-12-14T18:30:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T18:30:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T18:30:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.016230077, 2023-12-14T18:30:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.005809926, 2023-12-14T18:30:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.009524867, 2023-12-14T18:30:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.002237050, 2023-12-14T18:30:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 113, 2023-12-14T18:30:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.005360869, 2023-12-14T18:30:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000047441 2023-12-14T18:30:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 442512, 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 64576 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T18:30:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T18:30:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T18:30:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T18:30:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148823, 2023-12-14T18:30:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 27, 2023-12-14T18:30:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T18:30:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T18:30:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T18:30:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T18:30:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T18:30:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T18:30:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T18:30:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T18:30:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T18:30:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T18:30:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T18:30:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T18:30:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 118, 2023-12-14T18:30:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 425991, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 118, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 118, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 425991, 2023-12-14T18:30:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T18:30:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:07.237 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:30:07.574 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-12-14T18:30:07.574 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-12-14T18:30:07.575 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-12-14T18:30:07.575 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-12-14T18:30:07.575 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-12-14T18:30:07.575 DEBUG:tasks.check_counter:Getting stats from g 2023-12-14T18:30:07.575 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.g perf dump 2023-12-14T18:30:07.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:07 smithi069 ceph-mon[42047]: pgmap v421: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:07.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:07 smithi119 ceph-mon[43973]: pgmap v421: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:07.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:07 smithi091 ceph-mon[43601]: pgmap v421: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:07.890 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:30:08.819 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 115, 2023-12-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 112, 2023-12-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 441968, 2023-12-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 63392, 2023-12-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.017349940, 2023-12-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.005859605, 2023-12-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.009907748, 2023-12-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.002229594, 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 111, 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.004560903, 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000041089 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 441968, 2023-12-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 63392 2023-12-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1, 2023-12-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 85, 2023-12-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 160, 2023-12-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 90688, 2023-12-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 3, 2023-12-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2023-12-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.005489418, 2023-12-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.003752672, 2023-12-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001003430, 2023-12-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 83, 2023-12-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.008234176, 2023-12-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000099206 2023-12-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 90688 2023-12-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 4, 2023-12-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 4, 2023-12-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 2960, 2023-12-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 448, 2023-12-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.000779357, 2023-12-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000034358, 2023-12-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000589304, 2023-12-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3, 2023-12-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000792431, 2023-12-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000264143 2023-12-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 448 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148903, 2023-12-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 29, 2023-12-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 116, 2023-12-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 425731, 2023-12-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 116, 2023-12-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 116, 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 425731, 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:08.844 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:08.844 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:08.844 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:30:09.190 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-12-14T18:30:09.190 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-12-14T18:30:09.191 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-12-14T18:30:09.191 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-12-14T18:30:09.191 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2023-12-14T18:30:09.191 DEBUG:tasks.check_counter:Getting stats from j 2023-12-14T18:30:09.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.j perf dump 2023-12-14T18:30:09.508 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.a/config 2023-12-14T18:30:09.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:09 smithi119 ceph-mon[43973]: pgmap v422: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:09.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:09 smithi091 ceph-mon[43601]: pgmap v422: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:09.897 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:09 smithi069 ceph-mon[42047]: pgmap v422: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:10.643 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2023-12-14T18:30:10.644 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2023-12-14T18:30:10.645 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001299806, 2023-12-14T18:30:10.645 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T18:30:10.645 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000296868, 2023-12-14T18:30:10.645 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:10.645 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:10.645 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:10.646 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1, 2023-12-14T18:30:10.647 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 88, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 160, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 91216, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 3, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.006497785, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.004596597, 2023-12-14T18:30:10.648 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001063103, 2023-12-14T18:30:10.649 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:10.649 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:10.649 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 86, 2023-12-14T18:30:10.649 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.003854193, 2023-12-14T18:30:10.649 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000044816 2023-12-14T18:30:10.649 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:10.650 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 91216 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 122, 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 117, 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 445744, 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 65616, 2023-12-14T18:30:10.651 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2023-12-14T18:30:10.652 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2023-12-14T18:30:10.652 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.016405285, 2023-12-14T18:30:10.652 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.005839633, 2023-12-14T18:30:10.652 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.009605807, 2023-12-14T18:30:10.652 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.002178858, 2023-12-14T18:30:10.652 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:10.653 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 117, 2023-12-14T18:30:10.653 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.004997966, 2023-12-14T18:30:10.653 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000042717 2023-12-14T18:30:10.653 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.653 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:10.653 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 445744, 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 65616 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.654 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:10.655 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:10.656 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:10.656 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:10.656 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:10.656 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:10.656 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:10.656 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:10.657 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:10.657 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:10.657 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:10.657 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:10.657 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:10.657 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:10.658 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:10.658 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:10.658 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:10.658 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:10.658 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:10.658 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:10.659 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:10.660 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148903, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 29, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-12-14T18:30:10.661 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:10.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-12-14T18:30:10.663 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:10.664 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-12-14T18:30:10.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-12-14T18:30:10.664 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:10.664 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-12-14T18:30:10.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-12-14T18:30:10.664 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-12-14T18:30:10.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 119, 2023-12-14T18:30:10.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 426121, 2023-12-14T18:30:10.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:10.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 119, 2023-12-14T18:30:10.665 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-12-14T18:30:10.665 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 119, 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 426121, 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:10.666 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-12-14T18:30:10.667 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-12-14T18:30:10.982 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-12-14T18:30:10.982 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-12-14T18:30:10.983 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-12-14T18:30:10.983 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-12-14T18:30:10.983 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-12-14T18:30:10.983 DEBUG:tasks.check_counter:Getting stats from b 2023-12-14T18:30:10.983 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.b perf dump 2023-12-14T18:30:11.319 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:30:11.801 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:11 smithi091 ceph-mon[43601]: pgmap v423: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:11.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:11 smithi119 ceph-mon[43973]: pgmap v423: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:11.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:11 smithi069 ceph-mon[42047]: pgmap v423: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:12.375 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-14T18:30:12.375 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:12.375 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 43581, 2023-12-14T18:30:12.375 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 34219, 2023-12-14T18:30:12.376 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 14836330, 2023-12-14T18:30:12.376 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 95970214, 2023-12-14T18:30:12.376 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 13, 2023-12-14T18:30:12.376 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 4, 2023-12-14T18:30:12.376 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 2.193189605, 2023-12-14T18:30:12.376 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 0.989606861, 2023-12-14T18:30:12.377 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 1.314339326, 2023-12-14T18:30:12.377 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.170482253, 2023-12-14T18:30:12.377 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:12.377 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 34220, 2023-12-14T18:30:12.377 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 2.282718981, 2023-12-14T18:30:12.378 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000066707 2023-12-14T18:30:12.378 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.378 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:12.378 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 63084, 2023-12-14T18:30:12.378 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.009030663, 2023-12-14T18:30:12.379 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000143 2023-12-14T18:30:12.379 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.379 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 495200, 2023-12-14T18:30:12.379 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 74000 2023-12-14T18:30:12.379 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.379 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:12.380 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 143710, 2023-12-14T18:30:12.380 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 135189, 2023-12-14T18:30:12.380 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 59858082, 2023-12-14T18:30:12.380 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 149005050, 2023-12-14T18:30:12.380 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 8, 2023-12-14T18:30:12.380 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 5, 2023-12-14T18:30:12.381 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 6.907551018, 2023-12-14T18:30:12.381 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 3.108166963, 2023-12-14T18:30:12.381 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 4.619638175, 2023-12-14T18:30:12.381 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.220140901, 2023-12-14T18:30:12.381 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:12.382 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 135191, 2023-12-14T18:30:12.382 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 4.390513364, 2023-12-14T18:30:12.382 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000032476 2023-12-14T18:30:12.382 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.382 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:12.383 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 258931, 2023-12-14T18:30:12.383 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.035618905, 2023-12-14T18:30:12.383 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000137 2023-12-14T18:30:12.383 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.383 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:12.383 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 227584 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 136888, 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 226658, 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 42490849, 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 139512526, 2023-12-14T18:30:12.384 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 54, 2023-12-14T18:30:12.385 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 10, 2023-12-14T18:30:12.385 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 7.713690995, 2023-12-14T18:30:12.385 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 3.293724468, 2023-12-14T18:30:12.385 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 4.771788139, 2023-12-14T18:30:12.385 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.188916524, 2023-12-14T18:30:12.385 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 226651, 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 6.931053603, 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000030580 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 337673, 2023-12-14T18:30:12.386 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.052830536, 2023-12-14T18:30:12.387 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000156 2023-12-14T18:30:12.387 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.387 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 58896, 2023-12-14T18:30:12.387 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 32992 2023-12-14T18:30:12.387 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.387 INFO:teuthology.orchestra.run.smithi091.stdout: "cct": { 2023-12-14T18:30:12.388 INFO:teuthology.orchestra.run.smithi091.stdout: "total_workers": 1, 2023-12-14T18:30:12.388 INFO:teuthology.orchestra.run.smithi091.stdout: "unhealthy_workers": 0 2023-12-14T18:30:12.388 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.388 INFO:teuthology.orchestra.run.smithi091.stdout: "finisher-MDSRank": { 2023-12-14T18:30:12.388 INFO:teuthology.orchestra.run.smithi091.stdout: "queue_len": 0, 2023-12-14T18:30:12.388 INFO:teuthology.orchestra.run.smithi091.stdout: "complete_latency": { 2023-12-14T18:30:12.389 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 6936, 2023-12-14T18:30:12.389 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 49.143910628, 2023-12-14T18:30:12.389 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.007085338 2023-12-14T18:30:12.389 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.389 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.389 INFO:teuthology.orchestra.run.smithi091.stdout: "finisher-PurgeQueue": { 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: "queue_len": 0, 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: "complete_latency": { 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 9437, 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 3.446648365, 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000365227 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.390 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.391 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": { 2023-12-14T18:30:12.391 INFO:teuthology.orchestra.run.smithi091.stdout: "request": 106079, 2023-12-14T18:30:12.391 INFO:teuthology.orchestra.run.smithi091.stdout: "reply": 62609, 2023-12-14T18:30:12.391 INFO:teuthology.orchestra.run.smithi091.stdout: "reply_latency": { 2023-12-14T18:30:12.391 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 62609, 2023-12-14T18:30:12.391 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 217.135752382, 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.003468123 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: "slow_reply": 0, 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: "forward": 43470, 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_fetch_complete": 0, 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_fetch_keys": 0, 2023-12-14T18:30:12.392 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_commit": 1256, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_split": 149, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_merge": 47, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes": 109, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_top": 53, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_bottom": 33, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_pin_tail": 23, 2023-12-14T18:30:12.393 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_pinned": 32, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_expired": 53784, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_with_caps": 7, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": 7, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "subtrees": 5, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse": 135407, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_hit": 48107, 2023-12-14T18:30:12.394 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_forward": 41757, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_discover": 0, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_dir_fetch": 0, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_remote_ino": 0, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_lock": 0, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "load_cent": 103, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "q": 0, 2023-12-14T18:30:12.395 INFO:teuthology.orchestra.run.smithi091.stdout: "exported": 651, 2023-12-14T18:30:12.396 INFO:teuthology.orchestra.run.smithi091.stdout: "exported_inodes": 48213, 2023-12-14T18:30:12.396 INFO:teuthology.orchestra.run.smithi091.stdout: "imported": 876, 2023-12-14T18:30:12.396 INFO:teuthology.orchestra.run.smithi091.stdout: "imported_inodes": 0, 2023-12-14T18:30:12.396 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_dir_fetch": 0, 2023-12-14T18:30:12.396 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_backtrace_fetch": 7258, 2023-12-14T18:30:12.396 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_peer_discover": 0, 2023-12-14T18:30:12.397 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rfiles": 7, 2023-12-14T18:30:12.397 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rbytes": 246, 2023-12-14T18:30:12.397 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rsnaps": 0, 2023-12-14T18:30:12.397 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_backtrace_fetch": 7258, 2023-12-14T18:30:12.397 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_set_tag": 0, 2023-12-14T18:30:12.397 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T18:30:12.398 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_inotable_repaired": 0, 2023-12-14T18:30:12.398 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dir_inodes": 36, 2023-12-14T18:30:12.398 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dir_base_inodes": 4, 2023-12-14T18:30:12.398 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dirfrag_rstats": 32, 2023-12-14T18:30:12.398 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_file_inodes": 7222, 2023-12-14T18:30:12.398 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_inode_file_caps": 0, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_revoke": 278, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_grant": 32462, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_trunc": 1, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_caps": 25939, 2023-12-14T18:30:12.399 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_caps_dirty": 25668, 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_cap_release": 76, 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: "process_request_cap_release": 40377 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_cache": { 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_update": 1780, 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_update_receipt": 0, 2023-12-14T18:30:12.400 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_try_discover": 0, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_send_discover": 0, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_handle_discover": 2037, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays": 5, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays_delayed": 0, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays_enqueuing": 0, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_created": 6753, 2023-12-14T18:30:12.401 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_enqueued": 6748, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_reintegrated": 0, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_migrated": 0, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_processing": 0, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_enqueued": 0, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_prioritized": 0, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "recovery_started": 0, 2023-12-14T18:30:12.402 INFO:teuthology.orchestra.run.smithi091.stdout: "recovery_completed": 0, 2023-12-14T18:30:12.403 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_enqueue_scrub": 4, 2023-12-14T18:30:12.403 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_exportdir": 660, 2023-12-14T18:30:12.403 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_flush": 0, 2023-12-14T18:30:12.403 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_fragmentdir": 200, 2023-12-14T18:30:12.403 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_fragstats": 0, 2023-12-14T18:30:12.403 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_inodestats": 0 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_log": { 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: "evadd": 66523, 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: "evex": 0, 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: "evtrm": 0, 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: "ev": 66523, 2023-12-14T18:30:12.404 INFO:teuthology.orchestra.run.smithi091.stdout: "evexg": 0, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "evexd": 0, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "segadd": 95, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "segex": 0, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "segtrm": 0, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "seg": 95, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "segexg": 0, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "segexd": 0, 2023-12-14T18:30:12.405 INFO:teuthology.orchestra.run.smithi091.stdout: "expos": 4194304, 2023-12-14T18:30:12.406 INFO:teuthology.orchestra.run.smithi091.stdout: "wrpos": 176495549, 2023-12-14T18:30:12.406 INFO:teuthology.orchestra.run.smithi091.stdout: "rdpos": 0, 2023-12-14T18:30:12.406 INFO:teuthology.orchestra.run.smithi091.stdout: "jlat": { 2023-12-14T18:30:12.406 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 2549, 2023-12-14T18:30:12.406 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 91.787116296, 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.036009068 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: "replayed": 0 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_mem": { 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: "ino": 37, 2023-12-14T18:30:12.407 INFO:teuthology.orchestra.run.smithi091.stdout: "ino+": 29001, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "ino-": 28964, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "dir": 35, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "dir+": 3148, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "dir-": 3113, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "dn": 109, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "dn+": 64071, 2023-12-14T18:30:12.408 INFO:teuthology.orchestra.run.smithi091.stdout: "dn-": 63962, 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: "cap": 7, 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: "cap+": 29318, 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: "cap-": 29311, 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: "rss": 164092, 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: "heap": 207156 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.409 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_server": { 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "dispatch_client_request": 107325, 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "dispatch_server_request": 329, 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_request": 106079, 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_session": 495, 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_peer_request": 669, 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "req_create_latency": { 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 25700, 2023-12-14T18:30:12.410 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 110.393698805, 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.004295474 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getattr_latency": { 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 222, 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.055404272, 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000249568 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.411 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getfilelock_latency": { 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: "req_link_latency": { 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.412 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookup_latency": { 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 28824, 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 59.007206049, 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002047155 2023-12-14T18:30:12.413 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookuphash_latency": { 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupino_latency": { 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.414 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupname_latency": { 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.415 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupparent_latency": { 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupsnap_latency": { 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.416 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lssnap_latency": { 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.417 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mkdir_latency": { 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 28, 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.031102506, 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.001110803 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mknod_latency": { 2023-12-14T18:30:12.418 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mksnap_latency": { 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.419 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: "req_open_latency": { 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 5, 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.016751064, 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.003350212 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: "req_readdir_latency": { 2023-12-14T18:30:12.420 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 994, 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 10.413641813, 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.010476500 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rename_latency": { 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 4, 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.007810037, 2023-12-14T18:30:12.421 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.001952509 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: "req_renamesnap_latency": { 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.422 INFO:teuthology.orchestra.run.smithi091.stdout: "req_snapdiff_latency": { 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmdir_latency": { 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 15, 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.133617193, 2023-12-14T18:30:12.423 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.008907812 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmsnap_latency": { 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmxattr_latency": { 2023-12-14T18:30:12.424 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 21, 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.026687268, 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.001270822 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setattr_latency": { 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 3, 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.006864345, 2023-12-14T18:30:12.425 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002288115 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setdirlayout_latency": { 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setfilelock_latency": { 2023-12-14T18:30:12.426 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 22, 2023-12-14T18:30:12.427 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 10.017172060, 2023-12-14T18:30:12.427 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.455326002 2023-12-14T18:30:12.427 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.427 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setlayout_latency": { 2023-12-14T18:30:12.427 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.427 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setxattr_latency": { 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 32, 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.076129541, 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002379048 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.428 INFO:teuthology.orchestra.run.smithi091.stdout: "req_symlink_latency": { 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "req_unlink_latency": { 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 6737, 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 26.949351315, 2023-12-14T18:30:12.429 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.004000200 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: "cap_revoke_eviction": 0, 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: "cap_acquisition_throttle": 0, 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getvxattr_latency": { 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 2, 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000316114, 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000158057 2023-12-14T18:30:12.430 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_sessions": { 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "session_count": 1, 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "session_add": 2, 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "session_remove": 1, 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "sessions_open": 1, 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "sessions_stale": 0, 2023-12-14T18:30:12.431 INFO:teuthology.orchestra.run.smithi091.stdout: "total_load": 9859, 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "average_load": 9859, 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "avg_session_uptime": 327 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "mempool": { 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:12.432 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:12.433 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:12.434 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:12.435 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_items": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:12.436 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_bytes": 297449, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_items": 110, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_bytes": 0, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_items": 0, 2023-12-14T18:30:12.437 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_bytes": 7528, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_items": 158, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:12.438 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_items": 0, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_bytes": 211656, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_items": 1902, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_items": 0, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_items": 0 2023-12-14T18:30:12.439 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "objecter": { 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "op_active": 0, 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "op_laggy": 0, 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "op_send": 19867, 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "op_send_bytes": 185195224, 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "op_resend": 30, 2023-12-14T18:30:12.440 INFO:teuthology.orchestra.run.smithi091.stdout: "op_reply": 19867, 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "op_latency": { 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 19867, 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 63.404405302, 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.003191443 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "op_inflight": 0, 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "oplen_avg": { 2023-12-14T18:30:12.441 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 19867, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 21179 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "op": 19867, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "op_r": 7414, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "op_w": 12453, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "op_rmw": 0, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "op_pg": 0, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_stat": 0, 2023-12-14T18:30:12.442 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_create": 11, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_read": 152, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_write": 2697, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_writefull": 90, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_writesame": 0, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_append": 0, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_zero": 0, 2023-12-14T18:30:12.443 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_truncate": 5, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_delete": 8337, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_mapext": 0, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_sparse_read": 0, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_clonerange": 0, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_getxattr": 7262, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_setxattr": 22, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_cmpxattr": 0, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_rmxattr": 0, 2023-12-14T18:30:12.444 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_resetxattrs": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_call": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_watch": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_notify": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_pgls": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_pgls_filter": 0, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_other": 1, 2023-12-14T18:30:12.445 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_active": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_send": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_resend": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_ping": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_active": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_send": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_resend": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_active": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_send": 0, 2023-12-14T18:30:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_resend": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_active": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_send": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_resend": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "command_active": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "command_send": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "command_resend": 0, 2023-12-14T18:30:12.447 INFO:teuthology.orchestra.run.smithi091.stdout: "map_epoch": 81, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "map_full": 0, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "map_inc": 3, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_sessions": 12, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_session_open": 12, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_session_close": 0, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_laggy": 0, 2023-12-14T18:30:12.448 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_wr": 2554, 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_rd": 0, 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_del": 48 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "oft": { 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_objs": 1, 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_kv_pairs": 0, 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_updates": 0, 2023-12-14T18:30:12.449 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_removes": 0 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: "osd-slow-ops": { 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: "slow_ops_count": 107277 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: "purge_queue": { 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_ops": 0, 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_ops_high_water": 10, 2023-12-14T18:30:12.450 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing": 0, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_high_water": 10, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executed": 6748, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_item_in_journal": 0 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:12.451 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 324175, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 87991786, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 324175, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 324175, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 87991786, 2023-12-14T18:30:12.452 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-objecter_bytes": { 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:12.453 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 0, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 0, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 19867, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 185876772, 2023-12-14T18:30:12.454 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 19867, 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 185876772, 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.455 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-objecter_ops": { 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 1024, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 0, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 0, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 19867, 2023-12-14T18:30:12.456 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 19867, 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 19867, 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 19867, 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.457 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-write_buf_throttle": { 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 3758096384, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 6748, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 681548, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:12.458 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 6748, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 148, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 681548, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.459 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-write_buf_throttle-0x562c8ea6a0a0": { 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 3758096384, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 66523, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 172301245, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:12.460 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 66523, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 2549, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 172301245, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:12.461 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:12.462 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.462 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:12.462 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-14T18:30:12.746 INFO:tasks.check_counter:Daemon mds.b mds.exported=651 2023-12-14T18:30:12.747 INFO:tasks.check_counter:Daemon mds.b mds.imported=876 2023-12-14T18:30:12.747 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1780 2023-12-14T18:30:12.747 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2023-12-14T18:30:12.747 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=149 2023-12-14T18:30:12.747 DEBUG:tasks.check_counter:Getting stats from e 2023-12-14T18:30:12.747 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.e perf dump 2023-12-14T18:30:13.055 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:30:13.850 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:13 smithi091 ceph-mon[43601]: pgmap v424: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T18:30:13.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:13 smithi119 ceph-mon[43973]: pgmap v424: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T18:30:13.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:13 smithi069 ceph-mon[42047]: pgmap v424: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T18:30:14.067 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-14T18:30:14.067 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:14.067 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 10462, 2023-12-14T18:30:14.067 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 10464, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 2665148, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 94014873, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 19, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 4, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 0.919825729, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 0.318109038, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 0.146818975, 2023-12-14T18:30:14.068 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.411329267, 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 10462, 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 1.602955956, 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000153216 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 19, 2023-12-14T18:30:14.069 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000002020, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000106 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 1536, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 1392 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 68808, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 69028, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 22970329, 2023-12-14T18:30:14.070 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 115514537, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 8, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 6, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 3.660012049, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 1.558166806, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 2.104608210, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.394165203, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 69027, 2023-12-14T18:30:14.071 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 3.100679782, 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000044919 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 112046, 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.015779013, 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000140 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 3120, 2023-12-14T18:30:14.072 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 226544 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 237242, 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 341951, 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 104292307, 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 188458721, 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 11, 2023-12-14T18:30:14.073 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 6, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 13.110300061, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 5.819168695, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 8.401967101, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.314838814, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 341950, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 13.251001577, 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000038751 2023-12-14T18:30:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 518905, 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.083549571, 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000161 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 487792, 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 77488 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.075 INFO:teuthology.orchestra.run.smithi091.stdout: "cct": { 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "total_workers": 1, 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "unhealthy_workers": 0 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "finisher-MDSRank": { 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "queue_len": 0, 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "complete_latency": { 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 4603, 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 61.759524537, 2023-12-14T18:30:14.076 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.013417233 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: "finisher-PurgeQueue": { 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: "queue_len": 0, 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: "complete_latency": { 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 29785, 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 12.331965190, 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000414032 2023-12-14T18:30:14.077 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": { 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: "request": 87369, 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: "reply": 82969, 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: "reply_latency": { 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 82969, 2023-12-14T18:30:14.078 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 191.421019712, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002307139 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "slow_reply": 0, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "forward": 4400, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_fetch_complete": 0, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_fetch_keys": 0, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_commit": 989, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_split": 119, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_merge": 26, 2023-12-14T18:30:14.079 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes": 18, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_top": 1, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_bottom": 7, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_pin_tail": 10, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_pinned": 15, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_expired": 31620, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_with_caps": 0, 2023-12-14T18:30:14.080 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": 0, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "subtrees": 4, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse": 136620, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_hit": 79793, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_forward": 4232, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_discover": 19, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_dir_fetch": 0, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_remote_ino": 0, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_lock": 0, 2023-12-14T18:30:14.081 INFO:teuthology.orchestra.run.smithi091.stdout: "load_cent": 0, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "q": 0, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "exported": 1084, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "exported_inodes": 21798, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "imported": 494, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "imported_inodes": 0, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_dir_fetch": 0, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_backtrace_fetch": 2442, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_peer_discover": 0, 2023-12-14T18:30:14.082 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rfiles": 7, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rbytes": 246, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rsnaps": 0, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_backtrace_fetch": 2442, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_set_tag": 0, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_inotable_repaired": 0, 2023-12-14T18:30:14.083 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dir_inodes": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_file_inodes": 2442, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_inode_file_caps": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_revoke": 782, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_grant": 34661, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T18:30:14.084 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_caps": 14305, 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_caps_dirty": 13699, 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_cap_release": 94, 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "process_request_cap_release": 56257 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_cache": { 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_update": 677, 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_update_receipt": 2655, 2023-12-14T18:30:14.085 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_try_discover": 1331, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_send_discover": 1336, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_handle_discover": 688, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays": 0, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays_delayed": 0, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays_enqueuing": 0, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_created": 21537, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_enqueued": 21537, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_reintegrated": 0, 2023-12-14T18:30:14.086 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_migrated": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_processing": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_enqueued": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_prioritized": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "recovery_started": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "recovery_completed": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_exportdir": 1263, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_flush": 0, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_fragmentdir": 146, 2023-12-14T18:30:14.087 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_fragstats": 0, 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_inodestats": 0 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_log": { 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "evadd": 86038, 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "evex": 0, 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "evtrm": 0, 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "ev": 86038, 2023-12-14T18:30:14.088 INFO:teuthology.orchestra.run.smithi091.stdout: "evexg": 0, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "evexd": 0, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "segadd": 109, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "segex": 0, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "segtrm": 0, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "seg": 109, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "segexg": 0, 2023-12-14T18:30:14.089 INFO:teuthology.orchestra.run.smithi091.stdout: "segexd": 0, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "expos": 4194304, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "wrpos": 194036527, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "rdpos": 0, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "jlat": { 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 2495, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 98.572868366, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.039508163 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: "replayed": 0 2023-12-14T18:30:14.090 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_mem": { 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "ino": 23, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "ino+": 30757, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "ino-": 30734, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "dir": 22, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "dir+": 2901, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "dir-": 2879, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "dn": 18, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "dn+": 54482, 2023-12-14T18:30:14.091 INFO:teuthology.orchestra.run.smithi091.stdout: "dn-": 54464, 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "cap": 0, 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "cap+": 30805, 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "cap-": 30805, 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "rss": 155472, 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "heap": 198964 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_server": { 2023-12-14T18:30:14.092 INFO:teuthology.orchestra.run.smithi091.stdout: "dispatch_client_request": 88529, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "dispatch_server_request": 5, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_request": 87369, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_session": 469, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_peer_request": 516, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "req_create_latency": { 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 13020, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 27.272395674, 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002094654 2023-12-14T18:30:14.093 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getattr_latency": { 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 4, 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000891636, 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000222909 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getfilelock_latency": { 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.094 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "req_link_latency": { 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookup_latency": { 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 47572, 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 72.241222035, 2023-12-14T18:30:14.095 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.001518566 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookuphash_latency": { 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupino_latency": { 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.096 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupname_latency": { 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.097 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupparent_latency": { 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupsnap_latency": { 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.098 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lssnap_latency": { 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mkdir_latency": { 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.099 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mknod_latency": { 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mksnap_latency": { 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.100 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: "req_open_latency": { 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.101 INFO:teuthology.orchestra.run.smithi091.stdout: "req_readdir_latency": { 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 836, 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 8.810953453, 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.010539418 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rename_latency": { 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.102 INFO:teuthology.orchestra.run.smithi091.stdout: "req_renamesnap_latency": { 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "req_snapdiff_latency": { 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.103 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmdir_latency": { 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 1, 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.004759516, 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.004759516 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmsnap_latency": { 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.104 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmxattr_latency": { 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setattr_latency": { 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.105 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setdirlayout_latency": { 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setfilelock_latency": { 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.106 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setlayout_latency": { 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setxattr_latency": { 2023-12-14T18:30:14.107 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.108 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.108 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.108 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.108 INFO:teuthology.orchestra.run.smithi091.stdout: "req_symlink_latency": { 2023-12-14T18:30:14.108 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.108 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "req_unlink_latency": { 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 21536, 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 83.090797398, 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.003858227 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "cap_revoke_eviction": 0, 2023-12-14T18:30:14.109 INFO:teuthology.orchestra.run.smithi091.stdout: "cap_acquisition_throttle": 0, 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getvxattr_latency": { 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_sessions": { 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "session_count": 1, 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "session_add": 2, 2023-12-14T18:30:14.110 INFO:teuthology.orchestra.run.smithi091.stdout: "session_remove": 1, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "sessions_open": 1, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "sessions_stale": 0, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "total_load": 31431, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "average_load": 31431, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "avg_session_uptime": 329 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "mempool": { 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:14.111 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:14.112 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:14.113 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:14.114 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_items": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:14.115 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_bytes": 291611, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_items": 113, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_bytes": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_items": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:14.116 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_bytes": 7528, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_items": 158, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_items": 0, 2023-12-14T18:30:14.117 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_bytes": 92541, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_items": 469, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_items": 0, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_items": 0 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "objecter": { 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "op_active": 0, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "op_laggy": 0, 2023-12-14T18:30:14.118 INFO:teuthology.orchestra.run.smithi091.stdout: "op_send": 28812, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "op_send_bytes": 200386283, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "op_resend": 33, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "op_reply": 28812, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "op_latency": { 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 28812, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 90.786719166, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.003151003 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "op_inflight": 0, 2023-12-14T18:30:14.119 INFO:teuthology.orchestra.run.smithi091.stdout: "oplen_avg": { 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 28812, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 29860 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "op": 28812, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "op_r": 2678, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "op_w": 26134, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "op_rmw": 0, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "op_pg": 0, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_stat": 0, 2023-12-14T18:30:14.120 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_create": 10, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_read": 236, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_write": 2731, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_writefull": 103, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_writesame": 0, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_append": 0, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_zero": 0, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_truncate": 0, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_delete": 22259, 2023-12-14T18:30:14.121 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_mapext": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_sparse_read": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_clonerange": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_getxattr": 2442, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_setxattr": 20, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_cmpxattr": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_rmxattr": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_resetxattrs": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_call": 0, 2023-12-14T18:30:14.122 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_watch": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_notify": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_pgls": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_pgls_filter": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_other": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_active": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_send": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_resend": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_ping": 0, 2023-12-14T18:30:14.123 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_active": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_send": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_resend": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_active": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_send": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_resend": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_active": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_send": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_resend": 0, 2023-12-14T18:30:14.124 INFO:teuthology.orchestra.run.smithi091.stdout: "command_active": 0, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "command_send": 0, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "command_resend": 0, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "map_epoch": 81, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "map_full": 0, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "map_inc": 2, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_sessions": 12, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_session_open": 12, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_session_close": 0, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_laggy": 0, 2023-12-14T18:30:14.125 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_wr": 2021, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_rd": 0, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_del": 38 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "oft": { 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_objs": 1, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_kv_pairs": 0, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_updates": 0, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_removes": 0 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.126 INFO:teuthology.orchestra.run.smithi091.stdout: "osd-slow-ops": { 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "slow_ops_count": 88787 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "purge_queue": { 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_ops": 0, 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_ops_high_water": 10, 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing": 0, 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_high_water": 10, 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executed": 21537, 2023-12-14T18:30:14.127 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_item_in_journal": 0 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 316508, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 101430206, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 316508, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 316508, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 101430206, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.129 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-objecter_bytes": { 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 0, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 0, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:14.130 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 28812, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 202561520, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 28812, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 202561520, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-objecter_ops": { 2023-12-14T18:30:14.131 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 1024, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 0, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 0, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 28812, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 28812, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 28812, 2023-12-14T18:30:14.132 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 28812, 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-write_buf_throttle": { 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:14.133 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 3758096384, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 21537, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 2175237, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 21537, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 236, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 2175237, 2023-12-14T18:30:14.134 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-write_buf_throttle-0x55ded588a0a0": { 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 3758096384, 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 86038, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 189842223, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 86038, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 2495, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 189842223, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:14.136 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:14.137 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:14.137 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.137 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:14.137 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-14T18:30:14.440 INFO:tasks.check_counter:Daemon mds.e mds.exported=1084 2023-12-14T18:30:14.440 INFO:tasks.check_counter:Daemon mds.e mds.imported=494 2023-12-14T18:30:14.440 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=677 2023-12-14T18:30:14.440 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=2655 2023-12-14T18:30:14.440 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=119 2023-12-14T18:30:14.440 DEBUG:tasks.check_counter:Getting stats from h 2023-12-14T18:30:14.441 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.h perf dump 2023-12-14T18:30:14.753 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:30:15.749 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-14T18:30:15.749 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:15.749 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 130962, 2023-12-14T18:30:15.749 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 232531, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 85063134, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 162500140, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 17, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 5, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 8.268781915, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 3.636413711, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 5.035116888, 2023-12-14T18:30:15.750 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.251275145, 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 232530, 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 11.066443188, 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000047591 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 312222, 2023-12-14T18:30:15.751 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.054277994, 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000173 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 448 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 70189, 2023-12-14T18:30:15.752 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 70140, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 48466974, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 88333905, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 9, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 5, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 3.580948799, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 1.584379593, 2023-12-14T18:30:15.753 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 2.094301288, 2023-12-14T18:30:15.756 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.291989737, 2023-12-14T18:30:15.756 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:15.756 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 70138, 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 2.947193070, 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000042019 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 115043, 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.017495079, 2023-12-14T18:30:15.757 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000152 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 227472 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 16000, 2023-12-14T18:30:15.758 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 15990, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 6708668, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 65459681, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 12, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 6, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 1.073514523, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 0.359092125, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 0.221419400, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.431545180, 2023-12-14T18:30:15.759 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 15989, 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 2.026141891, 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000126720 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 11, 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000001367, 2023-12-14T18:30:15.760 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000124 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 491712, 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 76624 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: "cct": { 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: "total_workers": 1, 2023-12-14T18:30:15.761 INFO:teuthology.orchestra.run.smithi091.stdout: "unhealthy_workers": 0 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: "finisher-MDSRank": { 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: "queue_len": 0, 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: "complete_latency": { 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 6739, 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 73.606291460, 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.010922435 2023-12-14T18:30:15.762 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: "finisher-PurgeQueue": { 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: "queue_len": 0, 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: "complete_latency": { 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 29860, 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 16.567659373, 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000554844 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.763 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": { 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "request": 80112, 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "reply": 76293, 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "reply_latency": { 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 76293, 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 222.714269756, 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002919196 2023-12-14T18:30:15.764 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "slow_reply": 0, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "forward": 3819, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_fetch_complete": 0, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_fetch_keys": 0, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_commit": 876, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_split": 97, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_merge": 89, 2023-12-14T18:30:15.765 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes": 52, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_top": 23, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_bottom": 17, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_pin_tail": 12, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_pinned": 20, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_expired": 29780, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "inodes_with_caps": 4, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": 4, 2023-12-14T18:30:15.766 INFO:teuthology.orchestra.run.smithi091.stdout: "subtrees": 5, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse": 124613, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_hit": 78682, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_forward": 3735, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_discover": 19, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_dir_fetch": 0, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_remote_ino": 0, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "traverse_lock": 0, 2023-12-14T18:30:15.767 INFO:teuthology.orchestra.run.smithi091.stdout: "load_cent": 2, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "q": 0, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "exported": 289, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "exported_inodes": 25759, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "imported": 654, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "imported_inodes": 0, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_dir_fetch": 0, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_backtrace_fetch": 10936, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "openino_peer_discover": 0, 2023-12-14T18:30:15.768 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rfiles": 7, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rbytes": 246, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "root_rsnaps": 0, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_backtrace_fetch": 10936, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_set_tag": 0, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_inotable_repaired": 0, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dir_inodes": 4, 2023-12-14T18:30:15.769 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_dirfrag_rstats": 4, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "scrub_file_inodes": 10932, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_inode_file_caps": 4, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_revoke": 845, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_grant": 33147, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T18:30:15.770 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_caps": 13722, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_caps_dirty": 13178, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_cap_release": 116, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "process_request_cap_release": 54800 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_cache": { 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_update": 504, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_update_receipt": 3291, 2023-12-14T18:30:15.771 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_try_discover": 1654, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_send_discover": 1895, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "dir_handle_discover": 506, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays": 2, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays_delayed": 0, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "num_strays_enqueuing": 0, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_created": 21745, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_enqueued": 21743, 2023-12-14T18:30:15.772 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_reintegrated": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "strays_migrated": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_processing": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_enqueued": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "num_recovering_prioritized": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "recovery_started": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "recovery_completed": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T18:30:15.773 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_exportdir": 313, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_flush": 0, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_fragmentdir": 187, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_fragstats": 0, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "ireq_inodestats": 0 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_log": { 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "evadd": 73761, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "evex": 0, 2023-12-14T18:30:15.774 INFO:teuthology.orchestra.run.smithi091.stdout: "evtrm": 0, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "ev": 73761, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "evexg": 0, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "evexd": 0, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "segadd": 90, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "segex": 0, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "segtrm": 0, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "seg": 90, 2023-12-14T18:30:15.775 INFO:teuthology.orchestra.run.smithi091.stdout: "segexg": 0, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "segexd": 0, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "expos": 4194304, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "wrpos": 178766176, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "rdpos": 0, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "jlat": { 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 1800, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 99.465339911, 2023-12-14T18:30:15.776 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.055258522 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: "replayed": 0 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_mem": { 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: "ino": 27, 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: "ino+": 29530, 2023-12-14T18:30:15.777 INFO:teuthology.orchestra.run.smithi091.stdout: "ino-": 29503, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "dir": 165, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "dir+": 3334, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "dir-": 3169, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "dn": 52, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "dn+": 66964, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "dn-": 66912, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "cap": 4, 2023-12-14T18:30:15.778 INFO:teuthology.orchestra.run.smithi091.stdout: "cap+": 29489, 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "cap-": 29485, 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "rss": 145948, 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "heap": 198964 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_server": { 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "dispatch_client_request": 81893, 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "dispatch_server_request": 263, 2023-12-14T18:30:15.779 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_request": 80112, 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_client_session": 51, 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "handle_peer_request": 613, 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "req_create_latency": { 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 11303, 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 28.322208946, 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002505724 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getattr_latency": { 2023-12-14T18:30:15.780 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 21, 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.007301497, 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000347690 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getfilelock_latency": { 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.781 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "req_link_latency": { 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookup_latency": { 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 42284, 2023-12-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 85.372779009, 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002019032 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookuphash_latency": { 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupino_latency": { 2023-12-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupname_latency": { 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupparent_latency": { 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lookupsnap_latency": { 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.785 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: "req_lssnap_latency": { 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mkdir_latency": { 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mknod_latency": { 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: "req_mksnap_latency": { 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi091.stdout: "req_open_latency": { 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "req_readdir_latency": { 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 940, 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 1.953122148, 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002077789 2023-12-14T18:30:15.789 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rename_latency": { 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "req_renamesnap_latency": { 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.790 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: "req_snapdiff_latency": { 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmdir_latency": { 2023-12-14T18:30:15.791 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 3, 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.044041029, 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.014680343 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmsnap_latency": { 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.792 INFO:teuthology.orchestra.run.smithi091.stdout: "req_rmxattr_latency": { 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setattr_latency": { 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.793 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setdirlayout_latency": { 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setfilelock_latency": { 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.794 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setlayout_latency": { 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "req_setxattr_latency": { 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: "req_symlink_latency": { 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.796 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "req_unlink_latency": { 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 21742, 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 107.014817127, 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.004922031 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "cap_revoke_eviction": 0, 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "cap_acquisition_throttle": 0, 2023-12-14T18:30:15.797 INFO:teuthology.orchestra.run.smithi091.stdout: "req_getvxattr_latency": { 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_sessions": { 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "session_count": 1, 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "session_add": 2, 2023-12-14T18:30:15.798 INFO:teuthology.orchestra.run.smithi091.stdout: "session_remove": 1, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "sessions_open": 1, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "sessions_stale": 0, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "total_load": 30776, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "average_load": 30776, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "avg_session_uptime": 330 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "mempool": { 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:15.799 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:15.800 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:15.801 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:15.802 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_items": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:15.803 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_bytes": 297839, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_items": 110, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_bytes": 0, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_items": 0, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:15.804 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_bytes": 7528, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_items": 158, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_items": 0, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_bytes": 342072, 2023-12-14T18:30:15.805 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_items": 2996, 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_items": 0, 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_items": 0 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "objecter": { 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "op_active": 0, 2023-12-14T18:30:15.806 INFO:teuthology.orchestra.run.smithi091.stdout: "op_laggy": 0, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "op_send": 37424, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "op_send_bytes": 183826092, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "op_resend": 33, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "op_reply": 37424, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "op_latency": { 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 37424, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 92.785669479, 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.002479309 2023-12-14T18:30:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "op_inflight": 0, 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "oplen_avg": { 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 37424, 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 38304 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "op": 37424, 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "op_r": 11238, 2023-12-14T18:30:15.808 INFO:teuthology.orchestra.run.smithi091.stdout: "op_w": 26186, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "op_rmw": 0, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "op_pg": 0, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_stat": 0, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_create": 10, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_read": 302, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_write": 2102, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_writefull": 126, 2023-12-14T18:30:15.809 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_writesame": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_append": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_zero": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_truncate": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_delete": 23028, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_mapext": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_sparse_read": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_clonerange": 0, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_getxattr": 10936, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_setxattr": 20, 2023-12-14T18:30:15.810 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_cmpxattr": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_rmxattr": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_resetxattrs": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_call": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_watch": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_notify": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_pgls": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_pgls_filter": 0, 2023-12-14T18:30:15.811 INFO:teuthology.orchestra.run.smithi091.stdout: "osdop_other": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_active": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_send": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_resend": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "linger_ping": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_active": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_send": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "poolop_resend": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_active": 0, 2023-12-14T18:30:15.812 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_send": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "poolstat_resend": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_active": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_send": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "statfs_resend": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "command_active": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "command_send": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "command_resend": 0, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "map_epoch": 81, 2023-12-14T18:30:15.813 INFO:teuthology.orchestra.run.smithi091.stdout: "map_full": 0, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "map_inc": 2, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_sessions": 12, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_session_open": 12, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_session_close": 0, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_laggy": 0, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_wr": 1740, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_rd": 0, 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_del": 40 2023-12-14T18:30:15.814 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "oft": { 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_objs": 1, 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_kv_pairs": 0, 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_updates": 0, 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "omap_total_removes": 0 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "osd-slow-ops": { 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "slow_ops_count": 80878 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.815 INFO:teuthology.orchestra.run.smithi091.stdout: "purge_queue": { 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_ops": 0, 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_ops_high_water": 11, 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing": 0, 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executing_high_water": 10, 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_executed": 21743, 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "pq_item_in_journal": 0 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:15.816 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 217147, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 120683791, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 217147, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:15.817 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 217147, 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 120683791, 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.818 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-objecter_bytes": { 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 0, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 0, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 37424, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 186022207, 2023-12-14T18:30:15.819 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 37424, 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 186022207, 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-objecter_ops": { 2023-12-14T18:30:15.820 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 1024, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 0, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 0, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 37424, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 37424, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 37424, 2023-12-14T18:30:15.821 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 37424, 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-write_buf_throttle": { 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:15.822 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 3758096384, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 21743, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 2196115, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 21743, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 302, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 2196115, 2023-12-14T18:30:15.823 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-write_buf_throttle-0x5598a07ee0a0": { 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 3758096384, 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:15.824 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 73761, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 174571872, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 73761, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 1800, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 174571872, 2023-12-14T18:30:15.825 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:15.826 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:15.826 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:15.826 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:15.826 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.826 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:15.826 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-14T18:30:15.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:15 smithi119 ceph-mon[43973]: pgmap v425: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:15.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:15 smithi091 ceph-mon[43601]: pgmap v425: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:15.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:15 smithi069 ceph-mon[42047]: pgmap v425: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:16.112 INFO:tasks.check_counter:Daemon mds.h mds.exported=289 2023-12-14T18:30:16.112 INFO:tasks.check_counter:Daemon mds.h mds.imported=654 2023-12-14T18:30:16.113 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=504 2023-12-14T18:30:16.113 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=3291 2023-12-14T18:30:16.113 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=97 2023-12-14T18:30:16.113 DEBUG:tasks.check_counter:Getting stats from k 2023-12-14T18:30:16.113 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.k perf dump 2023-12-14T18:30:16.422 INFO:teuthology.orchestra.run.smithi091.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.b/config 2023-12-14T18:30:17.457 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-14T18:30:17.458 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:17.458 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 125, 2023-12-14T18:30:17.458 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 120, 2023-12-14T18:30:17.458 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 446624, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 66960, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 4, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 0, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 0.018884505, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 0.005845006, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 0.011100955, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.002625113, 2023-12-14T18:30:17.459 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 120, 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.009722541, 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000081021 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:17.460 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 446624, 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 66960 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 1, 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 90, 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 160, 2023-12-14T18:30:17.461 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 91568, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 3, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 2, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 0.004996452, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 0.003203178, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 0.000866558, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 88, 2023-12-14T18:30:17.462 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.004606983, 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000052352 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.463 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 91568 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_messages": 0, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages": 2, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_bytes": 0, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_bytes": 0, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_created_connections": 2, 2023-12-14T18:30:17.464 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_active_connections": 1, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_total_time": 0.000501483, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_recv_time": 0.000438353, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:17.465 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T18:30:17.466 INFO:teuthology.orchestra.run.smithi091.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "cct": { 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "total_workers": 0, 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "unhealthy_workers": 0 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "mempool": { 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:17.467 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:17.468 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:17.469 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:17.470 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_items": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:17.471 INFO:teuthology.orchestra.run.smithi091.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_bytes": 149854, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_anon_items": 28, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_bytes": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_items": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:17.472 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_bytes": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_items": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "pgmap_items": 0, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_bytes": 928, 2023-12-14T18:30:17.473 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_co_items": 2, 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_1_items": 0, 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "unittest_2_items": 0 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "val": 0, 2023-12-14T18:30:17.474 INFO:teuthology.orchestra.run.smithi091.stdout: "max": 104857600, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "get_started": 0, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "get": 122, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "get_sum": 426575, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "get_or_fail_success": 122, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "take": 0, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "take_sum": 0, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "put": 122, 2023-12-14T18:30:17.475 INFO:teuthology.orchestra.run.smithi091.stdout: "put_sum": 426575, 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout: "wait": { 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout: "avgcount": 0, 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout: "sum": 0.000000000, 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout: "avgtime": 0.000000000 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-14T18:30:17.476 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-14T18:30:17.829 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-12-14T18:30:17.829 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-12-14T18:30:17.830 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-12-14T18:30:17.830 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-12-14T18:30:17.830 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2023-12-14T18:30:17.830 DEBUG:tasks.check_counter:Getting stats from c 2023-12-14T18:30:17.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.c perf dump 2023-12-14T18:30:17.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:17 smithi119 ceph-mon[43973]: pgmap v426: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:17.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:17 smithi091 ceph-mon[43601]: pgmap v426: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:17.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:17 smithi069 ceph-mon[42047]: pgmap v426: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:18.163 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:30:19.159 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T18:30:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1006, 2023-12-14T18:30:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1008, 2023-12-14T18:30:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 61624307, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 312873, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 8, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.114612573, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.027464714, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.048771447, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.029433571, 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1006, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.040981079, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000040736 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T18:30:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 222, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 307, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 54590626, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 293725, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.053658534, 2023-12-14T18:30:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.007788375, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.037359567, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.005812688, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 306, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.015474223, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000050569 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3120, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 226176 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 386, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 378, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 59495600, 2023-12-14T18:30:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 146098, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.066604841, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.011708777, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.045731948, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.008329343, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 377, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.015920740, 2023-12-14T18:30:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000042230 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 476752, 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 67104 2023-12-14T18:30:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2398, 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.175459638, 2023-12-14T18:30:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000073169 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 28538, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2023-12-14T18:30:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 28538, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 28538, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 15534, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 3, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2023-12-14T18:30:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2023-12-14T18:30:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T18:30:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T18:30:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2023-12-14T18:30:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2023-12-14T18:30:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2023-12-14T18:30:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2023-12-14T18:30:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 90, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 0, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 178766115, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 73761 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 23, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 29504, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 29481, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 161, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1921, 2023-12-14T18:30:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 1760, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 28538, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 76259, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 47721, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 111600, 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2023-12-14T18:30:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2023-12-14T18:30:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2023-12-14T18:30:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 2, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2023-12-14T18:30:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 2663 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 238503, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 74, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7528, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 158, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 20345176, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 112660, 2023-12-14T18:30:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 1477, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2023-12-14T18:30:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 1477, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1477, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.994975174, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000673646 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1477, 2023-12-14T18:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1478 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 1477, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 1477, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 879, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2023-12-14T18:30:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 596, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2023-12-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2023-12-14T18:30:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 81, 2023-12-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 2, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 11, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 11, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2023-12-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 1610, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 175555905, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 1610, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1610, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 175555905, 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:19.216 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:19.217 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1477, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 174820121, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1477, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 174820121, 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:19.218 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:19.219 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1477, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1477, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1477, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1477, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.220 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.222 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55e62e052460": { 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:19.223 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:19.224 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T18:30:19.514 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-12-14T18:30:19.514 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-12-14T18:30:19.514 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-12-14T18:30:19.514 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-12-14T18:30:19.515 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-12-14T18:30:19.515 DEBUG:tasks.check_counter:Getting stats from f 2023-12-14T18:30:19.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.f perf dump 2023-12-14T18:30:19.864 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:30:19.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:19 smithi119 ceph-mon[43973]: pgmap v427: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:19.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:19 smithi091 ceph-mon[43601]: pgmap v427: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:19.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:19 smithi069 ceph-mon[42047]: pgmap v427: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:20.844 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T18:30:20.844 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:20.845 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 467, 2023-12-14T18:30:20.845 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 469, 2023-12-14T18:30:20.845 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 63130197, 2023-12-14T18:30:20.845 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 145301, 2023-12-14T18:30:20.845 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 8, 2023-12-14T18:30:20.845 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2023-12-14T18:30:20.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.070668178, 2023-12-14T18:30:20.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.010824423, 2023-12-14T18:30:20.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.042724053, 2023-12-14T18:30:20.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.012292805, 2023-12-14T18:30:20.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:20.846 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 467, 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.018459921, 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000039528 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T18:30:20.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T18:30:20.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.848 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:20.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 492, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 578, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 85394495, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 377814, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.079640908, 2023-12-14T18:30:20.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.015200707, 2023-12-14T18:30:20.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.047123560, 2023-12-14T18:30:20.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.012655728, 2023-12-14T18:30:20.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:20.850 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 577, 2023-12-14T18:30:20.850 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.022572953, 2023-12-14T18:30:20.850 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000039121 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.851 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3120, 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 226352 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 677, 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 669, 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 42595973, 2023-12-14T18:30:20.852 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 236599, 2023-12-14T18:30:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2023-12-14T18:30:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2023-12-14T18:30:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.098165749, 2023-12-14T18:30:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.023507796, 2023-12-14T18:30:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.048481302, 2023-12-14T18:30:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.021578807, 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 668, 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.034690638, 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000051932 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:20.854 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 476752, 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 67104 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.855 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T18:30:20.856 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2387, 2023-12-14T18:30:20.857 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.067107826, 2023-12-14T18:30:20.857 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000028113 2023-12-14T18:30:20.857 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.857 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2023-12-14T18:30:20.857 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.858 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2023-12-14T18:30:20.860 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2023-12-14T18:30:20.861 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 21547, 2023-12-14T18:30:20.861 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2023-12-14T18:30:20.861 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2023-12-14T18:30:20.861 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 21547, 2023-12-14T18:30:20.861 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 21547, 2023-12-14T18:30:20.861 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 1, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 1, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2023-12-14T18:30:20.862 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2023-12-14T18:30:20.863 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2023-12-14T18:30:20.864 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T18:30:20.865 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T18:30:20.866 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2023-12-14T18:30:20.867 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2023-12-14T18:30:20.868 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2023-12-14T18:30:20.869 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2023-12-14T18:30:20.870 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 0, 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2023-12-14T18:30:20.871 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 109, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2023-12-14T18:30:20.872 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 0, 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 194035389, 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.873 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 86038 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 13, 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 30724, 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 30711, 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 11, 2023-12-14T18:30:20.874 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1807, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 1796, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 21547, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 54667, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 33120, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2023-12-14T18:30:20.875 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 90076, 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2023-12-14T18:30:20.876 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2023-12-14T18:30:20.877 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.879 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.881 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.883 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.884 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.885 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.886 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.888 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.889 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.890 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.891 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2023-12-14T18:30:20.892 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.894 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.895 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.896 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 2, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2023-12-14T18:30:20.897 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 2666 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:20.898 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:20.899 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:20.900 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:20.901 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:20.902 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 230480, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 72, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:20.903 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7528, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 158, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:20.904 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 15211848, 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 86316, 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T18:30:20.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 1499, 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2023-12-14T18:30:20.906 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 1499, 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1499, 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.991975246, 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000661758 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2023-12-14T18:30:20.907 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1499, 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1500 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 1499, 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 1499, 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2023-12-14T18:30:20.908 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 901, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 596, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2023-12-14T18:30:20.909 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2023-12-14T18:30:20.910 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2023-12-14T18:30:20.911 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2023-12-14T18:30:20.912 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 81, 2023-12-14T18:30:20.913 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 2, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 10, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 10, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2023-12-14T18:30:20.914 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.915 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2023-12-14T18:30:20.916 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 1632, 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 190964057, 2023-12-14T18:30:20.917 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 1632, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1632, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 190964057, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.918 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1499, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 190224335, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1499, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 190224335, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.920 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:20.921 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1499, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1499, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1499, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1499, 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:20.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:20.923 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T18:30:20.924 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x558dab82c460": { 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T18:30:20.925 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T18:30:20.926 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:20.927 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:20.927 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:20.927 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:20.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:20.927 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T18:30:21.221 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-12-14T18:30:21.222 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-12-14T18:30:21.222 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-12-14T18:30:21.222 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-12-14T18:30:21.222 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-12-14T18:30:21.222 DEBUG:tasks.check_counter:Getting stats from i 2023-12-14T18:30:21.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.i perf dump 2023-12-14T18:30:21.528 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:30:21.850 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:21 smithi119 ceph-mon[43973]: pgmap v428: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:21.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:21 smithi091 ceph-mon[43601]: pgmap v428: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:21.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:21 smithi069 ceph-mon[42047]: pgmap v428: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:22.566 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T18:30:22.566 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:22.566 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 792, 2023-12-14T18:30:22.567 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 782, 2023-12-14T18:30:22.567 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 44655839, 2023-12-14T18:30:22.567 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 271421, 2023-12-14T18:30:22.567 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2023-12-14T18:30:22.567 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2023-12-14T18:30:22.568 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.111705194, 2023-12-14T18:30:22.568 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.025132026, 2023-12-14T18:30:22.568 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.055949286, 2023-12-14T18:30:22.568 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.023983487, 2023-12-14T18:30:22.568 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:22.569 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 782, 2023-12-14T18:30:22.569 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.035050506, 2023-12-14T18:30:22.569 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000044821 2023-12-14T18:30:22.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.569 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:22.569 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.570 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.570 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.570 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 479872, 2023-12-14T18:30:22.570 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 67712 2023-12-14T18:30:22.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 510, 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 597, 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 84268354, 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 384093, 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2023-12-14T18:30:22.571 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2023-12-14T18:30:22.572 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.081812354, 2023-12-14T18:30:22.572 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.013163506, 2023-12-14T18:30:22.572 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.053916089, 2023-12-14T18:30:22.572 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.010705368, 2023-12-14T18:30:22.572 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:22.572 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 595, 2023-12-14T18:30:22.573 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.026382701, 2023-12-14T18:30:22.573 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000044340 2023-12-14T18:30:22.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.573 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:22.573 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.573 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.574 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.574 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:22.574 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 225728 2023-12-14T18:30:22.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.574 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:22.575 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 447, 2023-12-14T18:30:22.575 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 449, 2023-12-14T18:30:22.575 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 46857317, 2023-12-14T18:30:22.575 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 139024, 2023-12-14T18:30:22.575 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2023-12-14T18:30:22.575 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2023-12-14T18:30:22.576 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.056344246, 2023-12-14T18:30:22.576 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.012182663, 2023-12-14T18:30:22.576 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.029518155, 2023-12-14T18:30:22.576 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.011341978, 2023-12-14T18:30:22.576 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:22.576 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 447, 2023-12-14T18:30:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.021473239, 2023-12-14T18:30:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000048038 2023-12-14T18:30:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.578 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.578 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T18:30:22.578 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T18:30:22.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T18:30:22.579 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T18:30:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2573, 2023-12-14T18:30:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.100805013, 2023-12-14T18:30:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000039178 2023-12-14T18:30:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2023-12-14T18:30:22.581 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2023-12-14T18:30:22.581 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2023-12-14T18:30:22.581 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.581 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.581 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.581 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.582 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2023-12-14T18:30:22.583 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 13170, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 13170, 2023-12-14T18:30:22.584 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 13170, 2023-12-14T18:30:22.585 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 4564, 2023-12-14T18:30:22.585 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2023-12-14T18:30:22.585 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2023-12-14T18:30:22.585 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 3, 2023-12-14T18:30:22.585 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2023-12-14T18:30:22.585 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2023-12-14T18:30:22.586 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2023-12-14T18:30:22.586 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2023-12-14T18:30:22.586 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2023-12-14T18:30:22.586 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2023-12-14T18:30:22.586 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2023-12-14T18:30:22.586 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2023-12-14T18:30:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2023-12-14T18:30:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2023-12-14T18:30:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2023-12-14T18:30:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2023-12-14T18:30:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2023-12-14T18:30:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2023-12-14T18:30:22.588 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2023-12-14T18:30:22.588 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2023-12-14T18:30:22.588 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 7, 2023-12-14T18:30:22.588 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 246, 2023-12-14T18:30:22.588 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2023-12-14T18:30:22.588 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2023-12-14T18:30:22.589 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2023-12-14T18:30:22.589 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2023-12-14T18:30:22.589 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2023-12-14T18:30:22.589 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2023-12-14T18:30:22.589 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2023-12-14T18:30:22.589 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-14T18:30:22.590 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2023-12-14T18:30:22.591 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2023-12-14T18:30:22.592 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2023-12-14T18:30:22.592 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2023-12-14T18:30:22.592 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2023-12-14T18:30:22.592 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2023-12-14T18:30:22.592 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2023-12-14T18:30:22.592 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2023-12-14T18:30:22.593 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2023-12-14T18:30:22.593 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2023-12-14T18:30:22.593 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2023-12-14T18:30:22.593 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2023-12-14T18:30:22.593 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2023-12-14T18:30:22.593 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2023-12-14T18:30:22.594 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2023-12-14T18:30:22.595 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2023-12-14T18:30:22.595 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2023-12-14T18:30:22.595 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2023-12-14T18:30:22.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.595 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2023-12-14T18:30:22.595 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2023-12-14T18:30:22.596 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2023-12-14T18:30:22.596 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2023-12-14T18:30:22.596 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 0, 2023-12-14T18:30:22.596 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2023-12-14T18:30:22.596 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2023-12-14T18:30:22.596 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2023-12-14T18:30:22.597 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2023-12-14T18:30:22.597 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2023-12-14T18:30:22.597 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 95, 2023-12-14T18:30:22.597 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2023-12-14T18:30:22.597 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2023-12-14T18:30:22.597 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2023-12-14T18:30:22.598 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 0, 2023-12-14T18:30:22.598 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 176494411, 2023-12-14T18:30:22.598 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2023-12-14T18:30:22.598 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.598 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.598 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 66523 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 33, 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 29206, 2023-12-14T18:30:22.599 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 29173, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 31, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 2087, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 2056, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 13170, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 64989, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 51819, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2023-12-14T18:30:22.600 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2023-12-14T18:30:22.601 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2023-12-14T18:30:22.601 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 88832, 2023-12-14T18:30:22.601 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2023-12-14T18:30:22.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.601 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2023-12-14T18:30:22.601 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.603 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.604 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2023-12-14T18:30:22.606 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.607 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.608 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2023-12-14T18:30:22.608 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.608 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.608 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2023-12-14T18:30:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2023-12-14T18:30:22.611 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2023-12-14T18:30:22.613 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.615 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2023-12-14T18:30:22.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2023-12-14T18:30:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2023-12-14T18:30:22.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.622 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 2, 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2023-12-14T18:30:22.623 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 2666 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T18:30:22.624 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:22.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 238503, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 74, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7528, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 158, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 9339104, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 47913, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 1611, 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 26, 2023-12-14T18:30:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 4, 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 1611, 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1611, 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.050973778, 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000652373 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2023-12-14T18:30:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1611, 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1612 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 1611, 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 1611, 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2023-12-14T18:30:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 969, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 639, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2023-12-14T18:30:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2023-12-14T18:30:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2023-12-14T18:30:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 2, 2023-12-14T18:30:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2023-12-14T18:30:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2023-12-14T18:30:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2023-12-14T18:30:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2023-12-14T18:30:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2023-12-14T18:30:22.639 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2023-12-14T18:30:22.640 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 81, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2023-12-14T18:30:22.641 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 2, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 11, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 11, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2023-12-14T18:30:22.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2023-12-14T18:30:22.643 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2023-12-14T18:30:22.644 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 1745, 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 175614686, 2023-12-14T18:30:22.645 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 1745, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1745, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 175614686, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:22.647 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1611, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 174856362, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1611, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 174856362, 2023-12-14T18:30:22.648 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:22.649 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1611, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1611, 2023-12-14T18:30:22.650 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1611, 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1611, 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2023-12-14T18:30:22.651 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:22.652 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55981e928460": { 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2023-12-14T18:30:22.654 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:22.655 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.656 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:22.656 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T18:30:22.946 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2023-12-14T18:30:22.947 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2023-12-14T18:30:22.947 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2023-12-14T18:30:22.947 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2023-12-14T18:30:22.947 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2023-12-14T18:30:22.947 DEBUG:tasks.check_counter:Getting stats from l 2023-12-14T18:30:22.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1faa353368ad4f5aeb56d7107b638336f58659ed shell --fsid f1527c12-9aac-11ee-95a5-87774f69a715 -- ceph daemon mds.l perf dump 2023-12-14T18:30:23.257 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/mon.c/config 2023-12-14T18:30:23.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:23 smithi119 ceph-mon[43973]: pgmap v429: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T18:30:23.886 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:23 smithi091 ceph-mon[43601]: pgmap v429: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T18:30:23.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:23 smithi069 ceph-mon[42047]: pgmap v429: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-14T18:30:24.290 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-14T18:30:24.290 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2023-12-14T18:30:24.290 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2023-12-14T18:30:24.290 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2023-12-14T18:30:24.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2023-12-14T18:30:24.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2023-12-14T18:30:24.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2023-12-14T18:30:24.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2023-12-14T18:30:24.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.001153643, 2023-12-14T18:30:24.291 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2023-12-14T18:30:24.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000305506, 2023-12-14T18:30:24.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:24.292 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:24.292 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:24.292 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:24.292 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:24.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.293 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:24.293 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:24.293 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:24.293 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:24.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.294 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-14T18:30:24.294 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2023-12-14T18:30:24.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.294 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2023-12-14T18:30:24.294 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 127, 2023-12-14T18:30:24.294 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 122, 2023-12-14T18:30:24.295 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 447168, 2023-12-14T18:30:24.295 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 68144, 2023-12-14T18:30:24.295 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2023-12-14T18:30:24.295 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2023-12-14T18:30:24.295 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.020501025, 2023-12-14T18:30:24.295 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.006192297, 2023-12-14T18:30:24.296 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.011248229, 2023-12-14T18:30:24.296 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.003544174, 2023-12-14T18:30:24.296 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:24.296 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 122, 2023-12-14T18:30:24.296 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.010082620, 2023-12-14T18:30:24.296 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000082644 2023-12-14T18:30:24.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.297 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:24.297 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:24.297 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:24.297 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:24.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.298 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 447168, 2023-12-14T18:30:24.298 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 68144 2023-12-14T18:30:24.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.298 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2023-12-14T18:30:24.298 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1, 2023-12-14T18:30:24.299 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 91, 2023-12-14T18:30:24.299 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 160, 2023-12-14T18:30:24.299 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 91744, 2023-12-14T18:30:24.299 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 3, 2023-12-14T18:30:24.299 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2023-12-14T18:30:24.300 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.005896769, 2023-12-14T18:30:24.300 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.003851997, 2023-12-14T18:30:24.300 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000867551, 2023-12-14T18:30:24.300 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-14T18:30:24.300 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2023-12-14T18:30:24.300 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 89, 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.005905589, 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000066354 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:24.301 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:24.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.302 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-14T18:30:24.302 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 91744 2023-12-14T18:30:24.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.302 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2023-12-14T18:30:24.302 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2023-12-14T18:30:24.303 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2023-12-14T18:30:24.304 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2023-12-14T18:30:24.305 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2023-12-14T18:30:24.305 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-14T18:30:24.305 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2023-12-14T18:30:24.305 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2023-12-14T18:30:24.305 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2023-12-14T18:30:24.305 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2023-12-14T18:30:24.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2023-12-14T18:30:24.307 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2023-12-14T18:30:24.308 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2023-12-14T18:30:24.308 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2023-12-14T18:30:24.308 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2023-12-14T18:30:24.308 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2023-12-14T18:30:24.308 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2023-12-14T18:30:24.308 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 149871, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 29, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2023-12-14T18:30:24.309 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2023-12-14T18:30:24.310 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2023-12-14T18:30:24.310 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2023-12-14T18:30:24.310 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2023-12-14T18:30:24.310 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2023-12-14T18:30:24.310 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2023-12-14T18:30:24.310 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 928, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2023-12-14T18:30:24.311 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2023-12-14T18:30:24.312 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 124, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 426835, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 124, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 124, 2023-12-14T18:30:24.313 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 426835, 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-12-14T18:30:24.314 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-14T18:30:24.664 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-12-14T18:30:24.664 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-12-14T18:30:24.664 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-12-14T18:30:24.665 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-12-14T18:30:24.665 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2023-12-14T18:30:24.665 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-14T18:30:24.683 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-14T18:30:24.684 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:30:24.684 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-14T18:30:24.709 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:30:24.709 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-14T18:30:24.771 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:30:24.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 -- 172.21.15.69:0/2206887337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 msgr2=0x7f15c4100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 --2- 172.21.15.69:0/2206887337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c4100bd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009990 tx=0x7f15b8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 -- 172.21.15.69:0/2206887337 shutdown_connections 2023-12-14T18:30:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 --2- 172.21.15.69:0/2206887337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40ffdf0 0x7f15c41076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 --2- 172.21.15.69:0/2206887337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c4100bd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 --2- 172.21.15.69:0/2206887337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c40ff460 0x7f15c40ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:24.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 -- 172.21.15.69:0/2206887337 >> 172.21.15.69:0/2206887337 conn(0x7f15c40f9f80 msgr2=0x7f15c40fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 -- 172.21.15.69:0/2206887337 shutdown_connections 2023-12-14T18:30:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 -- 172.21.15.69:0/2206887337 wait complete. 2023-12-14T18:30:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 Processor -- start 2023-12-14T18:30:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.946+0000 7f15cb89d700 1 -- start start 2023-12-14T18:30:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40ff460 0x7f15c40feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:24.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c40ffdf0 0x7f15c419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:24.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:24.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419da40 con 0x7f15c41007c0 2023-12-14T18:30:24.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419dbb0 con 0x7f15c40ffdf0 2023-12-14T18:30:24.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419dd70 con 0x7f15c40ff460 2023-12-14T18:30:24.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:24.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c419d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37610/0 (socket says 172.21.15.69:37610) 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 -- 172.21.15.69:0/1741208160 learned_addr learned my addr 172.21.15.69:0/1741208160 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9639700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40ff460 0x7f15c40feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c8e38700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c40ffdf0 0x7f15c419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 -- 172.21.15.69:0/1741208160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40ff460 msgr2=0x7f15c40feee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40ff460 0x7f15c40feee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 -- 172.21.15.69:0/1741208160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c40ffdf0 msgr2=0x7f15c419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:24.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c40ffdf0 0x7f15c419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 -- 172.21.15.69:0/1741208160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80095f0 con 0x7f15c41007c0 2023-12-14T18:30:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15c9e3a700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c419d270 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ef30 tx=0x7f15bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc018070 con 0x7f15c41007c0 2023-12-14T18:30:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15bc00f040 con 0x7f15c41007c0 2023-12-14T18:30:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c410a990 con 0x7f15c41007c0 2023-12-14T18:30:24.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00cc70 con 0x7f15c41007c0 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.947+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c410a800 con 0x7f15c41007c0 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.948+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4106230 con 0x7f15c41007c0 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.949+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f15bc003a00 con 0x7f15c41007c0 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.950+0000 7f15b67fc700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15b00a1150 0x7f15b00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.950+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f15bc0cca10 con 0x7f15c41007c0 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.950+0000 7f15c9639700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15b00a1150 0x7f15b00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:24.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.950+0000 7f15c9639700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15b00a1150 0x7f15b00a3600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15b8005910 tx=0x7f15b8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:24.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:24.953+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f15bc096200 con 0x7f15c41007c0 2023-12-14T18:30:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.144+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15c402cfe0 con 0x7f15c41007c0 2023-12-14T18:30:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.145+0000 7f15b67fc700 1 -- 172.21.15.69:0/1741208160 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f15bc003cb0 con 0x7f15c41007c0 2023-12-14T18:30:25.147 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:25.147 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:30:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15b00a1150 msgr2=0x7f15b00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15b00a1150 0x7f15b00a3600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15b8005910 tx=0x7f15b8005960 comp rx=0 tx=0).stop 2023-12-14T18:30:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 msgr2=0x7f15c419d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c419d270 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ef30 tx=0x7f15bc00c3a0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 shutdown_connections 2023-12-14T18:30:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15b00a1150 0x7f15b00a3600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15c41007c0 0x7f15c419d270 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40ff460 0x7f15c40feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 --2- 172.21.15.69:0/1741208160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c40ffdf0 0x7f15c419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 >> 172.21.15.69:0/1741208160 conn(0x7f15c40f9f80 msgr2=0x7f15c40fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 shutdown_connections 2023-12-14T18:30:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.147+0000 7f15cb89d700 1 -- 172.21.15.69:0/1741208160 wait complete. 2023-12-14T18:30:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:30:25.162 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:30:25.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 -- 172.21.15.69:0/809486850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc100310 msgr2=0x7f4afc100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 --2- 172.21.15.69:0/809486850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc100310 0x7f4afc100760 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009990 tx=0x7f4aec009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 -- 172.21.15.69:0/809486850 shutdown_connections 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 --2- 172.21.15.69:0/809486850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4afc100ca0 0x7f4afc107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 --2- 172.21.15.69:0/809486850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4afc0ff120 0x7f4afc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 --2- 172.21.15.69:0/809486850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc100310 0x7f4afc100760 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 -- 172.21.15.69:0/809486850 >> 172.21.15.69:0/809486850 conn(0x7f4afc0fa740 msgr2=0x7f4afc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 -- 172.21.15.69:0/809486850 shutdown_connections 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 -- 172.21.15.69:0/809486850 wait complete. 2023-12-14T18:30:25.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 Processor -- start 2023-12-14T18:30:25.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.287+0000 7f4b03de8700 1 -- start start 2023-12-14T18:30:25.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 0x7f4afc194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4afc100310 0x7f4afc195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4afc100ca0 0x7f4afc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc19c9d0 con 0x7f4afc0ff120 2023-12-14T18:30:25.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc19cb10 con 0x7f4afc100ca0 2023-12-14T18:30:25.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc19cca0 con 0x7f4afc100310 2023-12-14T18:30:25.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 0x7f4afc194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 0x7f4afc194e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33782/0 (socket says 172.21.15.69:33782) 2023-12-14T18:30:25.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 -- 172.21.15.69:0/2757419141 learned_addr learned my addr 172.21.15.69:0/2757419141 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:25.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01383700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4afc100310 0x7f4afc195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b02385700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4afc100ca0 0x7f4afc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 -- 172.21.15.69:0/2757419141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4afc100310 msgr2=0x7f4afc195390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4afc100310 0x7f4afc195390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 -- 172.21.15.69:0/2757419141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4afc100ca0 msgr2=0x7f4afc19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4afc100ca0 0x7f4afc19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 -- 172.21.15.69:0/2757419141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0095f0 con 0x7f4afc0ff120 2023-12-14T18:30:25.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b01b84700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 0x7f4afc194e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4af800d980 tx=0x7f4af800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:25.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8004020 con 0x7f4afc0ff120 2023-12-14T18:30:25.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af8009730 con 0x7f4afc0ff120 2023-12-14T18:30:25.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc10a930 con 0x7f4afc0ff120 2023-12-14T18:30:25.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.288+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8003a00 con 0x7f4afc0ff120 2023-12-14T18:30:25.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.289+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc10a7a0 con 0x7f4afc0ff120 2023-12-14T18:30:25.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.289+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc1067e0 con 0x7f4afc0ff120 2023-12-14T18:30:25.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.290+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4af80098a0 con 0x7f4afc0ff120 2023-12-14T18:30:25.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.291+0000 7f4af2ffd700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4ae80a11d0 0x7f4ae80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.291+0000 7f4b01383700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4ae80a11d0 0x7f4ae80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.291+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4af80cc8a0 con 0x7f4afc0ff120 2023-12-14T18:30:25.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.291+0000 7f4b01383700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4ae80a11d0 0x7f4ae80a3680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00c010 tx=0x7f4aec005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:25.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.294+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4af8096080 con 0x7f4afc0ff120 2023-12-14T18:30:25.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.487+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4afc061810 con 0x7f4afc0ff120 2023-12-14T18:30:25.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.487+0000 7f4af2ffd700 1 -- 172.21.15.69:0/2757419141 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4af80170a0 con 0x7f4afc0ff120 2023-12-14T18:30:25.489 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:30:25.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4ae80a11d0 msgr2=0x7f4ae80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4ae80a11d0 0x7f4ae80a3680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00c010 tx=0x7f4aec005960 comp rx=0 tx=0).stop 2023-12-14T18:30:25.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 msgr2=0x7f4afc194e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 0x7f4afc194e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4af800d980 tx=0x7f4af800dc90 comp rx=0 tx=0).stop 2023-12-14T18:30:25.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 shutdown_connections 2023-12-14T18:30:25.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f4ae80a11d0 0x7f4ae80a3680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4afc100ca0 0x7f4afc19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4afc0ff120 0x7f4afc194e50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 --2- 172.21.15.69:0/2757419141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4afc100310 0x7f4afc195390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 >> 172.21.15.69:0/2757419141 conn(0x7f4afc0fa740 msgr2=0x7f4afc103920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:25.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 shutdown_connections 2023-12-14T18:30:25.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.489+0000 7f4b03de8700 1 -- 172.21.15.69:0/2757419141 wait complete. 2023-12-14T18:30:25.503 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:30:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 -- 172.21.15.69:0/1734831608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e81035c0 msgr2=0x7fa1e81059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 --2- 172.21.15.69:0/1734831608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e81035c0 0x7fa1e81059a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009990 tx=0x7fa1d4009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 -- 172.21.15.69:0/1734831608 shutdown_connections 2023-12-14T18:30:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 --2- 172.21.15.69:0/1734831608 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1e8105ee0 0x7fa1e8108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 --2- 172.21.15.69:0/1734831608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 --2- 172.21.15.69:0/1734831608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e81035c0 0x7fa1e81059a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 -- 172.21.15.69:0/1734831608 >> 172.21.15.69:0/1734831608 conn(0x7fa1e80fa740 msgr2=0x7fa1e80fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:25.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 -- 172.21.15.69:0/1734831608 shutdown_connections 2023-12-14T18:30:25.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.629+0000 7fa1eed77700 1 -- 172.21.15.69:0/1734831608 wait complete. 2023-12-14T18:30:25.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 Processor -- start 2023-12-14T18:30:25.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 -- start start 2023-12-14T18:30:25.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1e81035c0 0x7fa1e80fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e8105ee0 0x7fa1e80ff190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80ff930 con 0x7fa1e8100ca0 2023-12-14T18:30:25.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80ffaa0 con 0x7fa1e81035c0 2023-12-14T18:30:25.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1eed77700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e819ff10 con 0x7fa1e8105ee0 2023-12-14T18:30:25.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33790/0 (socket says 172.21.15.69:33790) 2023-12-14T18:30:25.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 -- 172.21.15.69:0/679720846 learned_addr learned my addr 172.21.15.69:0/679720846 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:25.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1e7fff700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1e81035c0 0x7fa1e80fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 -- 172.21.15.69:0/679720846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e8105ee0 msgr2=0x7fa1e80ff190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e8105ee0 0x7fa1e80ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 -- 172.21.15.69:0/679720846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1e81035c0 msgr2=0x7fa1e80fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1e81035c0 0x7fa1e80fec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 -- 172.21.15.69:0/679720846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40095f0 con 0x7fa1e8100ca0 2023-12-14T18:30:25.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1ecb13700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8100610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00d980 tx=0x7fa1dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:25.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc004220 con 0x7fa1e8100ca0 2023-12-14T18:30:25.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.630+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1dc007640 con 0x7fa1e8100ca0 2023-12-14T18:30:25.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.631+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e810ba50 con 0x7fa1e8100ca0 2023-12-14T18:30:25.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.631+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0055e0 con 0x7fa1e8100ca0 2023-12-14T18:30:25.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.631+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e810b8c0 con 0x7fa1e8100ca0 2023-12-14T18:30:25.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.632+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e80fc2b0 con 0x7fa1e8100ca0 2023-12-14T18:30:25.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.633+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa1dc004750 con 0x7fa1e8100ca0 2023-12-14T18:30:25.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.633+0000 7fa1e5ffb700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa1d80a1150 0x7fa1d80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.633+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1dc0cc790 con 0x7fa1e8100ca0 2023-12-14T18:30:25.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.633+0000 7fa1e7fff700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa1d80a1150 0x7fa1d80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.634+0000 7fa1e7fff700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa1d80a1150 0x7fa1d80a3600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400b5c0 tx=0x7fa1d4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:25.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.637+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa1dc095ef0 con 0x7fa1e8100ca0 2023-12-14T18:30:25.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.828+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1e80619b0 con 0x7fa1e8100ca0 2023-12-14T18:30:25.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.828+0000 7fa1e5ffb700 1 -- 172.21.15.69:0/679720846 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1dc016020 con 0x7fa1e8100ca0 2023-12-14T18:30:25.830 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:30:25.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa1d80a1150 msgr2=0x7fa1d80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa1d80a1150 0x7fa1d80a3600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400b5c0 tx=0x7fa1d4005fb0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 msgr2=0x7fa1e8100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8100610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00d980 tx=0x7fa1dc00dc90 comp rx=0 tx=0).stop 2023-12-14T18:30:25.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 shutdown_connections 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fa1d80a1150 0x7fa1d80a3600 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1e8105ee0 0x7fa1e80ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e8100ca0 0x7fa1e8100610 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 --2- 172.21.15.69:0/679720846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1e81035c0 0x7fa1e80fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 >> 172.21.15.69:0/679720846 conn(0x7fa1e80fa740 msgr2=0x7fa1e8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 shutdown_connections 2023-12-14T18:30:25.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.830+0000 7fa1eed77700 1 -- 172.21.15.69:0/679720846 wait complete. 2023-12-14T18:30:25.843 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:25 smithi069 ceph-mon[42047]: pgmap v430: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:25.843 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:25 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1741208160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:25.843 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:25 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2757419141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:25.844 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:30:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:25 smithi119 ceph-mon[43973]: pgmap v430: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:25.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:25 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1741208160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:25.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:25 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2757419141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:25.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:25 smithi091 ceph-mon[43601]: pgmap v430: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-14T18:30:25.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:25 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1741208160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:25.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:25 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2757419141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:25.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 -- 172.21.15.69:0/1266963480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100310 msgr2=0x7fefa0100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 --2- 172.21.15.69:0/1266963480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100310 0x7fefa0100760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef88009990 tx=0x7fef88009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 -- 172.21.15.69:0/1266963480 shutdown_connections 2023-12-14T18:30:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 --2- 172.21.15.69:0/1266963480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100ca0 0x7fefa0107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 --2- 172.21.15.69:0/1266963480 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa00ff120 0x7fefa00ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 --2- 172.21.15.69:0/1266963480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100310 0x7fefa0100760 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 -- 172.21.15.69:0/1266963480 >> 172.21.15.69:0/1266963480 conn(0x7fefa00fa740 msgr2=0x7fefa00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:25.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 -- 172.21.15.69:0/1266963480 shutdown_connections 2023-12-14T18:30:25.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.968+0000 7fefa657d700 1 -- 172.21.15.69:0/1266963480 wait complete. 2023-12-14T18:30:25.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 Processor -- start 2023-12-14T18:30:25.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 -- start start 2023-12-14T18:30:25.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa00ff120 0x7fefa0195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100310 0x7fefa01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 0x7fefa019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa019da10 con 0x7fefa0100ca0 2023-12-14T18:30:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa019db50 con 0x7fefa00ff120 2023-12-14T18:30:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa657d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa019dce0 con 0x7fefa0100310 2023-12-14T18:30:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa4b1a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 0x7fefa019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa4b1a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 0x7fefa019d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33804/0 (socket says 172.21.15.69:33804) 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.969+0000 7fefa4b1a700 1 -- 172.21.15.69:0/3614143659 learned_addr learned my addr 172.21.15.69:0/3614143659 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fef9f7fe700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100310 0x7fefa01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa4b1a700 1 -- 172.21.15.69:0/3614143659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100310 msgr2=0x7fefa01963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa4b1a700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100310 0x7fefa01963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fef9ffff700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa00ff120 0x7fefa0195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa4b1a700 1 -- 172.21.15.69:0/3614143659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa00ff120 msgr2=0x7fefa0195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa4b1a700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa00ff120 0x7fefa0195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:25.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa4b1a700 1 -- 172.21.15.69:0/3614143659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880095f0 con 0x7fefa0100ca0 2023-12-14T18:30:25.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fef9f7fe700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100310 0x7fefa01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-14T18:30:25.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa4b1a700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 0x7fefa019d440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fef9800b970 tx=0x7fef9800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:25.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800c9b0 con 0x7fefa0100ca0 2023-12-14T18:30:25.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef98014440 con 0x7fefa0100ca0 2023-12-14T18:30:25.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa010a9b0 con 0x7fefa0100ca0 2023-12-14T18:30:25.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980075d0 con 0x7fefa0100ca0 2023-12-14T18:30:25.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.970+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa010a820 con 0x7fefa0100ca0 2023-12-14T18:30:25.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.971+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa01071a0 con 0x7fefa0100ca0 2023-12-14T18:30:25.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.972+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fef980145b0 con 0x7fefa0100ca0 2023-12-14T18:30:25.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.973+0000 7fef9d7fa700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef8c0a1150 0x7fef8c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:25.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.973+0000 7fef9ffff700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef8c0a1150 0x7fef8c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:25.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.973+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fef98006e40 con 0x7fefa0100ca0 2023-12-14T18:30:25.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.973+0000 7fef9ffff700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef8c0a1150 0x7fef8c0a3600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fefa0100170 tx=0x7fef90005d70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:25.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:25.976+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fef980960b0 con 0x7fefa0100ca0 2023-12-14T18:30:26.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.163+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefa0067a20 con 0x7fefa0100ca0 2023-12-14T18:30:26.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.164+0000 7fef9d7fa700 1 -- 172.21.15.69:0/3614143659 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef980190a0 con 0x7fefa0100ca0 2023-12-14T18:30:26.165 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:30:26.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef8c0a1150 msgr2=0x7fef8c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef8c0a1150 0x7fef8c0a3600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fefa0100170 tx=0x7fef90005d70 comp rx=0 tx=0).stop 2023-12-14T18:30:26.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 msgr2=0x7fefa019d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 0x7fefa019d440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fef9800b970 tx=0x7fef9800bd30 comp rx=0 tx=0).stop 2023-12-14T18:30:26.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 shutdown_connections 2023-12-14T18:30:26.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fef8c0a1150 0x7fef8c0a3600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefa0100ca0 0x7fefa019d440 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa00ff120 0x7fefa0195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 --2- 172.21.15.69:0/3614143659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefa0100310 0x7fefa01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 >> 172.21.15.69:0/3614143659 conn(0x7fefa00fa740 msgr2=0x7fefa00fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:26.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 shutdown_connections 2023-12-14T18:30:26.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.166+0000 7fefa657d700 1 -- 172.21.15.69:0/3614143659 wait complete. 2023-12-14T18:30:26.180 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-14T18:30:26.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 -- 172.21.15.69:0/3227454870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08400ff140 msgr2=0x7f08400ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 --2- 172.21.15.69:0/3227454870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08400ff140 0x7f08400ff550 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0830009990 tx=0x7f0830009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 -- 172.21.15.69:0/3227454870 shutdown_connections 2023-12-14T18:30:26.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 --2- 172.21.15.69:0/3227454870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0840100cc0 0x7f0840107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 --2- 172.21.15.69:0/3227454870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08400ff140 0x7f08400ff550 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 --2- 172.21.15.69:0/3227454870 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 0x7f0840100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 -- 172.21.15.69:0/3227454870 >> 172.21.15.69:0/3227454870 conn(0x7f08400fa740 msgr2=0x7f08400fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:26.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 -- 172.21.15.69:0/3227454870 shutdown_connections 2023-12-14T18:30:26.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 -- 172.21.15.69:0/3227454870 wait complete. 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.304+0000 7f0847333700 1 Processor -- start 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 -- start start 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08400ff140 0x7f08401030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 0x7f0840101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 0x7f0840101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401023f0 con 0x7f0840100cc0 2023-12-14T18:30:26.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0840102560 con 0x7f0840100330 2023-12-14T18:30:26.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084019ff50 con 0x7f08400ff140 2023-12-14T18:30:26.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 0x7f0840101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 0x7f0840101c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33826/0 (socket says 172.21.15.69:33826) 2023-12-14T18:30:26.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 -- 172.21.15.69:0/2872913440 learned_addr learned my addr 172.21.15.69:0/2872913440 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:26.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08448ce700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 0x7f0840101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08450cf700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08400ff140 0x7f08401030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 -- 172.21.15.69:0/2872913440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08400ff140 msgr2=0x7f08401030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08400ff140 0x7f08401030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 -- 172.21.15.69:0/2872913440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 msgr2=0x7f0840101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 0x7f0840101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 -- 172.21.15.69:0/2872913440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300095f0 con 0x7f0840100cc0 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08448ce700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 0x7f0840101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:30:26.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08458d0700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 0x7f0840101c50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f083800ef30 tx=0x7f083800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:26.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838018070 con 0x7f0840100cc0 2023-12-14T18:30:26.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f083800f040 con 0x7f0840100cc0 2023-12-14T18:30:26.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084010a960 con 0x7f0840100cc0 2023-12-14T18:30:26.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838003d00 con 0x7f0840100cc0 2023-12-14T18:30:26.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.305+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084010a7d0 con 0x7f0840100cc0 2023-12-14T18:30:26.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.306+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08401a0590 con 0x7f0840100cc0 2023-12-14T18:30:26.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.307+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f083800caa0 con 0x7f0840100cc0 2023-12-14T18:30:26.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.308+0000 7f08367fc700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f082c0a11d0 0x7f082c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.308+0000 7f08450cf700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f082c0a11d0 0x7f082c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.308+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08380cd050 con 0x7f0840100cc0 2023-12-14T18:30:26.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.308+0000 7f08450cf700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f082c0a11d0 0x7f082c0a3680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0830006010 tx=0x7f0830005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:26.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.312+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f08380967e0 con 0x7f0840100cc0 2023-12-14T18:30:26.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.519+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f08401a0b40 con 0x7f0840100cc0 2023-12-14T18:30:26.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.520+0000 7f08367fc700 1 -- 172.21.15.69:0/2872913440 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) v1 ==== 81+0+589 (secure 0 0 0) 0x7f0838099e00 con 0x7f0840100cc0 2023-12-14T18:30:26.521 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/3699885016 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:26.521 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/3699885016 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1705055800 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/786686306 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/3801854408 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3054579215 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3468744885 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/778280662 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/904652576 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/3801854408 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f082c0a11d0 msgr2=0x7f082c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f082c0a11d0 0x7f082c0a3680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0830006010 tx=0x7f0830005940 comp rx=0 tx=0).stop 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 msgr2=0x7f0840101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 0x7f0840101c50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f083800ef30 tx=0x7f083800c450 comp rx=0 tx=0).stop 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 shutdown_connections 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f082c0a11d0 0x7f082c0a3680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0840100cc0 0x7f0840101c50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08400ff140 0x7f08401030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 --2- 172.21.15.69:0/2872913440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0840100330 0x7f0840101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 >> 172.21.15.69:0/2872913440 conn(0x7f08400fa740 msgr2=0x7f0840068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:26.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 shutdown_connections 2023-12-14T18:30:26.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.522+0000 7f0847333700 1 -- 172.21.15.69:0/2872913440 wait complete. 2023-12-14T18:30:26.525 INFO:teuthology.orchestra.run.smithi069.stderr:listed 10 entries 2023-12-14T18:30:26.535 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-14T18:30:26.535 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-14T18:30:26.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:30:26.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 -- 172.21.15.69:0/4106893406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c101de0 msgr2=0x7f829c1086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 --2- 172.21.15.69:0/4106893406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c101de0 0x7f829c1086a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f829400b0a0 tx=0x7f829400b3b0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 -- 172.21.15.69:0/4106893406 shutdown_connections 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 --2- 172.21.15.69:0/4106893406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c101de0 0x7f829c1086a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 --2- 172.21.15.69:0/4106893406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c100260 0x7f829c100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 --2- 172.21.15.69:0/4106893406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f829c101450 0x7f829c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 -- 172.21.15.69:0/4106893406 >> 172.21.15.69:0/4106893406 conn(0x7f829c0fb880 msgr2=0x7f829c0fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:26.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 -- 172.21.15.69:0/4106893406 shutdown_connections 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.714+0000 7f82a265f700 1 -- 172.21.15.69:0/4106893406 wait complete. 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 Processor -- start 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 -- start start 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 0x7f829c195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f829c101450 0x7f829c1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c101de0 0x7f829c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c19db30 con 0x7f829c100260 2023-12-14T18:30:26.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c19dc70 con 0x7f829c101de0 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a265f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c19de00 con 0x7f829c101450 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 0x7f829c195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 0x7f829c195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33838/0 (socket says 172.21.15.69:33838) 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829bfff700 1 -- 172.21.15.69:0/1190862061 learned_addr learned my addr 172.21.15.69:0/1190862061 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829b7fe700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f829c101450 0x7f829c1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829bfff700 1 -- 172.21.15.69:0/1190862061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f829c101450 msgr2=0x7f829c1964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829bfff700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f829c101450 0x7f829c1964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f82a0bfc700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c101de0 0x7f829c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.715+0000 7f829bfff700 1 -- 172.21.15.69:0/1190862061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c101de0 msgr2=0x7f829c19d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f829bfff700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c101de0 0x7f829c19d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f829bfff700 1 -- 172.21.15.69:0/1190862061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009d00 con 0x7f829c100260 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f829bfff700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 0x7f829c195fb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f828400d980 tx=0x7f828400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400de60 con 0x7f829c100260 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c10ba90 con 0x7f829c100260 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82840044b0 con 0x7f829c100260 2023-12-14T18:30:26.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284003b40 con 0x7f829c100260 2023-12-14T18:30:26.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.716+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c10b900 con 0x7f829c100260 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.717+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0679f0 con 0x7f829c100260 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.718+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8284004870 con 0x7f829c100260 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.718+0000 7f82997fa700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a1150 0x7f82880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.719+0000 7f829b7fe700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a1150 0x7f82880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.719+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f82840cc9b0 con 0x7f829c100260 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.719+0000 7f829b7fe700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a1150 0x7f82880a3600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f828c005fd0 tx=0x7f828c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:26.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.722+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8284096110 con 0x7f829c100260 2023-12-14T18:30:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:26 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/679720846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:26.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:26 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3614143659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:26.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:26 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2872913440' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T18:30:26.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:26 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/679720846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:26.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:26 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3614143659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:26.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:26 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2872913440' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T18:30:26.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.911+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f829c1070f0 con 0x7f829c100260 2023-12-14T18:30:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.913+0000 7f82997fa700 1 -- 172.21.15.69:0/1190862061 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f8284009940 con 0x7f829c100260 2023-12-14T18:30:26.915 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:26.915 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:30:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a1150 msgr2=0x7f82880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a1150 0x7f82880a3600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f828c005fd0 tx=0x7f828c00a560 comp rx=0 tx=0).stop 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 msgr2=0x7f829c195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 0x7f829c195fb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f828400d980 tx=0x7f828400dd40 comp rx=0 tx=0).stop 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 shutdown_connections 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f82880a1150 0x7f82880a3600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c101de0 0x7f829c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f829c100260 0x7f829c195fb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 --2- 172.21.15.69:0/1190862061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f829c101450 0x7f829c1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:26.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 >> 172.21.15.69:0/1190862061 conn(0x7f829c0fb880 msgr2=0x7f829c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:26.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 shutdown_connections 2023-12-14T18:30:26.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:26.915+0000 7f82a265f700 1 -- 172.21.15.69:0/1190862061 wait complete. 2023-12-14T18:30:26.927 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:26 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/679720846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:26.928 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:26 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3614143659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:26.928 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:26 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2872913440' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T18:30:26.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-14T18:20:16.498219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-14T18:23:27.160683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-14T18:23:28.472244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-14T18:30:26.930 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-14T18:30:27.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 -- 172.21.15.69:0/1996080960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 msgr2=0x7f43841075d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 --2- 172.21.15.69:0/1996080960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f43841075d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f437c00b0a0 tx=0x7f437c00b3b0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 -- 172.21.15.69:0/1996080960 shutdown_connections 2023-12-14T18:30:27.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 --2- 172.21.15.69:0/1996080960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f43841075d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 --2- 172.21.15.69:0/1996080960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384100720 0x7f4384100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 --2- 172.21.15.69:0/1996080960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43840ff370 0x7f43840ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 -- 172.21.15.69:0/1996080960 >> 172.21.15.69:0/1996080960 conn(0x7f43840f9ed0 msgr2=0x7f43840fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 -- 172.21.15.69:0/1996080960 shutdown_connections 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 -- 172.21.15.69:0/1996080960 wait complete. 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 Processor -- start 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 -- start start 2023-12-14T18:30:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.053+0000 7f438b70b700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43840ff370 0x7f4384195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f4384196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384100720 0x7f438419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438419db60 con 0x7f43840ffd20 2023-12-14T18:30:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438419dca0 con 0x7f43840ff370 2023-12-14T18:30:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438419de30 con 0x7f4384100720 2023-12-14T18:30:27.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f4384196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f4384196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33864/0 (socket says 172.21.15.69:33864) 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 -- 172.21.15.69:0/852466378 learned_addr learned my addr 172.21.15.69:0/852466378 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f43894a7700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43840ff370 0x7f4384195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 -- 172.21.15.69:0/852466378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384100720 msgr2=0x7f438419d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4389ca8700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384100720 0x7f438419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384100720 0x7f438419d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 -- 172.21.15.69:0/852466378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43840ff370 msgr2=0x7f4384195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43840ff370 0x7f4384195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 -- 172.21.15.69:0/852466378 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c009d00 con 0x7f43840ffd20 2023-12-14T18:30:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f4388ca6700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f4384196520 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f438000e9a0 tx=0x7f438000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380009790 con 0x7f43840ffd20 2023-12-14T18:30:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f438000cbd0 con 0x7f43840ffd20 2023-12-14T18:30:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438410a950 con 0x7f43840ffd20 2023-12-14T18:30:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380018680 con 0x7f43840ffd20 2023-12-14T18:30:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.054+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438410a7c0 con 0x7f43840ffd20 2023-12-14T18:30:27.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.055+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4384107340 con 0x7f43840ffd20 2023-12-14T18:30:27.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.056+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f438000cd40 con 0x7f43840ffd20 2023-12-14T18:30:27.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.057+0000 7f437a7fc700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43700a1150 0x7f43700a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.057+0000 7f43894a7700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43700a1150 0x7f43700a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.057+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4380014070 con 0x7f43840ffd20 2023-12-14T18:30:27.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.057+0000 7f43894a7700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43700a1150 0x7f43700a3600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4384067bb0 tx=0x7f4374009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:27.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.060+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f43800966c0 con 0x7f43840ffd20 2023-12-14T18:30:27.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.246+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4384067160 con 0x7f43840ffd20 2023-12-14T18:30:27.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.246+0000 7f437a7fc700 1 -- 172.21.15.69:0/852466378 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4380099ce0 con 0x7f43840ffd20 2023-12-14T18:30:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-12-14T18:30:27.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43700a1150 msgr2=0x7f43700a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43700a1150 0x7f43700a3600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4384067bb0 tx=0x7f4374009260 comp rx=0 tx=0).stop 2023-12-14T18:30:27.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 msgr2=0x7f4384196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f4384196520 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f438000e9a0 tx=0x7f438000ecb0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 shutdown_connections 2023-12-14T18:30:27.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f43700a1150 0x7f43700a3600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384100720 0x7f438419d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43840ff370 0x7f4384195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 --2- 172.21.15.69:0/852466378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43840ffd20 0x7f4384196520 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 >> 172.21.15.69:0/852466378 conn(0x7f43840f9ed0 msgr2=0x7f43840fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:27.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 shutdown_connections 2023-12-14T18:30:27.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.248+0000 7f438b70b700 1 -- 172.21.15.69:0/852466378 wait complete. 2023-12-14T18:30:27.262 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-14T18:30:27.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 -- 172.21.15.69:0/2174883825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 msgr2=0x7f1150101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 --2- 172.21.15.69:0/2174883825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150101870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1144009990 tx=0x7f1144009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 -- 172.21.15.69:0/2174883825 shutdown_connections 2023-12-14T18:30:27.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 --2- 172.21.15.69:0/2174883825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1150101db0 0x7f1150108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 --2- 172.21.15.69:0/2174883825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1150100230 0x7f1150100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 --2- 172.21.15.69:0/2174883825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150101870 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 -- 172.21.15.69:0/2174883825 >> 172.21.15.69:0/2174883825 conn(0x7f11500fb850 msgr2=0x7f11500fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:27.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 -- 172.21.15.69:0/2174883825 shutdown_connections 2023-12-14T18:30:27.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.386+0000 7f1156317700 1 -- 172.21.15.69:0/2174883825 wait complete. 2023-12-14T18:30:27.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 Processor -- start 2023-12-14T18:30:27.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 -- start start 2023-12-14T18:30:27.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1150100230 0x7f1150195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1150101db0 0x7f115019d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115019da80 con 0x7f1150101420 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115019dbc0 con 0x7f1150100230 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f1156317700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115019dd50 con 0x7f1150101db0 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f114f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f114f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33870/0 (socket says 172.21.15.69:33870) 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f114f7fe700 1 -- 172.21.15.69:0/1749513317 learned_addr learned my addr 172.21.15.69:0/1749513317 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.387+0000 7f114ffff700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1150100230 0x7f1150195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f11548b4700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1150101db0 0x7f115019d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114f7fe700 1 -- 172.21.15.69:0/1749513317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1150101db0 msgr2=0x7f115019d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114f7fe700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1150101db0 0x7f115019d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114f7fe700 1 -- 172.21.15.69:0/1749513317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1150100230 msgr2=0x7f1150195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114f7fe700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1150100230 0x7f1150195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114f7fe700 1 -- 172.21.15.69:0/1749513317 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440095f0 con 0x7f1150101420 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114f7fe700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150196440 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1144006010 tx=0x7f1144005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:27.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114401d070 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1144004100 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144005290 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115010baa0 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.388+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115010b910 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.389+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115019e260 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.390+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f11440047e0 con 0x7f1150101420 2023-12-14T18:30:27.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.390+0000 7f114d7fa700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11380a11d0 0x7f11380a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.391+0000 7f114ffff700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11380a11d0 0x7f11380a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.391+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f11440cd9c0 con 0x7f1150101420 2023-12-14T18:30:27.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.391+0000 7f114ffff700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11380a11d0 0x7f11380a3680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1140005fd0 tx=0x7f1140005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:27.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.395+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1144097150 con 0x7f1150101420 2023-12-14T18:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.585+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1150107180 con 0x7f1150101420 2023-12-14T18:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.585+0000 7f114d7fa700 1 -- 172.21.15.69:0/1749513317 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f114409a770 con 0x7f1150101420 2023-12-14T18:30:27.587 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-12-14T18:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11380a11d0 msgr2=0x7f11380a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11380a11d0 0x7f11380a3680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1140005fd0 tx=0x7f1140005dd0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 msgr2=0x7f1150196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150196440 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1144006010 tx=0x7f1144005ef0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 shutdown_connections 2023-12-14T18:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f11380a11d0 0x7f11380a3680 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1150101db0 0x7f115019d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1150100230 0x7f1150195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 --2- 172.21.15.69:0/1749513317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1150101420 0x7f1150196440 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 >> 172.21.15.69:0/1749513317 conn(0x7f11500fb850 msgr2=0x7f11500fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 shutdown_connections 2023-12-14T18:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.587+0000 7f1156317700 1 -- 172.21.15.69:0/1749513317 wait complete. 2023-12-14T18:30:27.601 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-14T18:30:27.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 -- 172.21.15.69:0/433127392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 msgr2=0x7fecc81018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 --2- 172.21.15.69:0/433127392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 0x7fecc81018f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009990 tx=0x7fecb8009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 -- 172.21.15.69:0/433127392 shutdown_connections 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 --2- 172.21.15.69:0/433127392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc81086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 --2- 172.21.15.69:0/433127392 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecc80fe4d0 0x7fecc80fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 --2- 172.21.15.69:0/433127392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 0x7fecc81018f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 -- 172.21.15.69:0/433127392 >> 172.21.15.69:0/433127392 conn(0x7fecc80f9ed0 msgr2=0x7fecc80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 -- 172.21.15.69:0/433127392 shutdown_connections 2023-12-14T18:30:27.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.725+0000 7fecce1a3700 1 -- 172.21.15.69:0/433127392 wait complete. 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 Processor -- start 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 -- start start 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecc80fe4d0 0x7fecc8195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 0x7fecc81963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc819d9f0 con 0x7fecc8101e30 2023-12-14T18:30:27.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc819db30 con 0x7fecc80fe4d0 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecce1a3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc819dcc0 con 0x7fecc81014a0 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecc7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecc7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc819d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33886/0 (socket says 172.21.15.69:33886) 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecc7fff700 1 -- 172.21.15.69:0/1730072632 learned_addr learned my addr 172.21.15.69:0/1730072632 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecc6ffd700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 0x7fecc81963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.726+0000 7fecc77fe700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecc80fe4d0 0x7fecc8195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc7fff700 1 -- 172.21.15.69:0/1730072632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 msgr2=0x7fecc81963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc7fff700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 0x7fecc81963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc7fff700 1 -- 172.21.15.69:0/1730072632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecc80fe4d0 msgr2=0x7fecc8195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc7fff700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecc80fe4d0 0x7fecc8195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc7fff700 1 -- 172.21.15.69:0/1730072632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80095f0 con 0x7fecc8101e30 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc7fff700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc819d420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007d70 tx=0x7fecc000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000ac90 con 0x7fecc8101e30 2023-12-14T18:30:27.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecc000adf0 con 0x7fecc8101e30 2023-12-14T18:30:27.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc810ba20 con 0x7fecc8101e30 2023-12-14T18:30:27.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00115e0 con 0x7fecc8101e30 2023-12-14T18:30:27.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.727+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc810b890 con 0x7fecc8101e30 2023-12-14T18:30:27.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.728+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc8067160 con 0x7fecc8101e30 2023-12-14T18:30:27.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.729+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fecc0004ad0 con 0x7fecc8101e30 2023-12-14T18:30:27.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.730+0000 7fecc4ff9700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fecb40a1150 0x7fecb40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:27.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.730+0000 7fecc77fe700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fecb40a1150 0x7fecb40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:27.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.730+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecc00cce60 con 0x7fecc8101e30 2023-12-14T18:30:27.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.730+0000 7fecc77fe700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fecb40a1150 0x7fecb40a3600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fecc8067bd0 tx=0x7fecb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:27.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.733+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fecc0096560 con 0x7fecc8101e30 2023-12-14T18:30:27.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:27 smithi119 ceph-mon[43973]: pgmap v431: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:27.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:27 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1190862061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:27.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:27 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/852466378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:27.876 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:27 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1749513317' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:27 smithi091 ceph-mon[43601]: pgmap v431: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:27 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1190862061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:27 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/852466378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:27.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:27 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1749513317' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:27.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.921+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecc8107250 con 0x7fecc8101e30 2023-12-14T18:30:27.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.922+0000 7fecc4ff9700 1 -- 172.21.15.69:0/1730072632 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecc00160a0 con 0x7fecc8101e30 2023-12-14T18:30:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-12-14T18:30:27.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fecb40a1150 msgr2=0x7fecb40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fecb40a1150 0x7fecb40a3600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fecc8067bd0 tx=0x7fecb0009260 comp rx=0 tx=0).stop 2023-12-14T18:30:27.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 msgr2=0x7fecc819d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:27.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc819d420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007d70 tx=0x7fecc000a340 comp rx=0 tx=0).stop 2023-12-14T18:30:27.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 shutdown_connections 2023-12-14T18:30:27.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fecb40a1150 0x7fecb40a3600 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8101e30 0x7fecc819d420 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecc80fe4d0 0x7fecc8195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 --2- 172.21.15.69:0/1730072632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc81014a0 0x7fecc81963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:27.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 >> 172.21.15.69:0/1730072632 conn(0x7fecc80f9ed0 msgr2=0x7fecc80fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:27.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 shutdown_connections 2023-12-14T18:30:27.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:27.924+0000 7fecce1a3700 1 -- 172.21.15.69:0/1730072632 wait complete. 2023-12-14T18:30:27.936 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:27 smithi069 ceph-mon[42047]: pgmap v431: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-14T18:30:27.937 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:27 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1190862061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:27.937 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:27 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/852466378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-14T18:30:27.937 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:27 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1749513317' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-14T18:30:27.939 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-14T18:30:28.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.059+0000 7f67d6b26700 1 -- 172.21.15.69:0/233409917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d0100ca0 msgr2=0x7f67d0107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:28.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.059+0000 7f67d6b26700 1 --2- 172.21.15.69:0/233409917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d0100ca0 0x7f67d0107560 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b0a0 tx=0x7f67c800b3b0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- 172.21.15.69:0/233409917 shutdown_connections 2023-12-14T18:30:28.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 --2- 172.21.15.69:0/233409917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d0100ca0 0x7f67d0107560 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 --2- 172.21.15.69:0/233409917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67d00ff120 0x7f67d00ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 --2- 172.21.15.69:0/233409917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67d0100310 0x7f67d0100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- 172.21.15.69:0/233409917 >> 172.21.15.69:0/233409917 conn(0x7f67d00fa740 msgr2=0x7f67d00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:28.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- 172.21.15.69:0/233409917 shutdown_connections 2023-12-14T18:30:28.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- 172.21.15.69:0/233409917 wait complete. 2023-12-14T18:30:28.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 Processor -- start 2023-12-14T18:30:28.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- start start 2023-12-14T18:30:28.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 0x7f67d01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:28.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67d0100310 0x7f67d0198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:28.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67d0100ca0 0x7f67d019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:28.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d019fd60 con 0x7f67d00ff120 2023-12-14T18:30:28.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d019fea0 con 0x7f67d0100ca0 2023-12-14T18:30:28.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d6b26700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d01a0030 con 0x7f67d0100310 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d48c2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 0x7f67d01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d48c2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 0x7f67d01981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33896/0 (socket says 172.21.15.69:33896) 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67d48c2700 1 -- 172.21.15.69:0/2109360964 learned_addr learned my addr 172.21.15.69:0/2109360964 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.060+0000 7f67cffff700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67d0100310 0x7f67d0198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d50c3700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67d0100ca0 0x7f67d019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d48c2700 1 -- 172.21.15.69:0/2109360964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67d0100310 msgr2=0x7f67d0198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:28.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d48c2700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67d0100310 0x7f67d0198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d48c2700 1 -- 172.21.15.69:0/2109360964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67d0100ca0 msgr2=0x7f67d019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d48c2700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67d0100ca0 0x7f67d019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d48c2700 1 -- 172.21.15.69:0/2109360964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c8009d00 con 0x7f67d00ff120 2023-12-14T18:30:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d48c2700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 0x7f67d01981e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f67c400d980 tx=0x7f67c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4004020 con 0x7f67d00ff120 2023-12-14T18:30:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67c400f690 con 0x7f67d00ff120 2023-12-14T18:30:28.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d010a940 con 0x7f67d00ff120 2023-12-14T18:30:28.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c40039e0 con 0x7f67d00ff120 2023-12-14T18:30:28.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.061+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d010a7b0 con 0x7f67d00ff120 2023-12-14T18:30:28.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.062+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d01a07d0 con 0x7f67d00ff120 2023-12-14T18:30:28.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.063+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f67c400f800 con 0x7f67d00ff120 2023-12-14T18:30:28.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.064+0000 7f67cdffb700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f67c00a11d0 0x7f67c00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:28.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.064+0000 7f67cffff700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f67c00a11d0 0x7f67c00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:28.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.064+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f67c40cc480 con 0x7f67d00ff120 2023-12-14T18:30:28.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.064+0000 7f67cffff700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f67c00a11d0 0x7f67c00a3680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f67bc005950 tx=0x7f67bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:28.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.068+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f67c4095be0 con 0x7f67d00ff120 2023-12-14T18:30:28.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.271+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67d01a0d80 con 0x7f67d00ff120 2023-12-14T18:30:28.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.272+0000 7f67cdffb700 1 -- 172.21.15.69:0/2109360964 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) v1 ==== 81+0+589 (secure 0 0 0) 0x7f67c4099200 con 0x7f67d00ff120 2023-12-14T18:30:28.273 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/3699885016 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:28.273 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/3699885016 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:28.273 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1705055800 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/786686306 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/3801854408 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3054579215 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3468744885 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/778280662 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/904652576 2023-12-15T18:18:26.173798+0000 2023-12-14T18:30:28.274 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/3801854408 2023-12-15T18:18:03.680568+0000 2023-12-14T18:30:28.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f67c00a11d0 msgr2=0x7f67c00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f67c00a11d0 0x7f67c00a3680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f67bc005950 tx=0x7f67bc00b410 comp rx=0 tx=0).stop 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 msgr2=0x7f67d01981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 0x7f67d01981e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f67c400d980 tx=0x7f67c400dc90 comp rx=0 tx=0).stop 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 shutdown_connections 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f67c00a11d0 0x7f67c00a3680 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67d0100ca0 0x7f67d019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67d00ff120 0x7f67d01981e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 --2- 172.21.15.69:0/2109360964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67d0100310 0x7f67d0198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:28.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 >> 172.21.15.69:0/2109360964 conn(0x7f67d00fa740 msgr2=0x7f67d0067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:28.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 shutdown_connections 2023-12-14T18:30:28.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:28.274+0000 7f67d6b26700 1 -- 172.21.15.69:0/2109360964 wait complete. 2023-12-14T18:30:28.277 INFO:teuthology.orchestra.run.smithi069.stderr:listed 10 entries 2023-12-14T18:30:28.287 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2023-12-14T18:30:28.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:30:28.287 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-14T18:30:28.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[89132]: fuse finished with error 0 and tester_r 0 2023-12-14T18:30:28.332 INFO:teuthology.orchestra.run:waiting for 300 2023-12-14T18:30:28.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:28 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1730072632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:28.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:28 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2109360964' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T18:30:29.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:28 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1730072632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:29.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:28 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2109360964' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T18:30:29.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:28 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1730072632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-14T18:30:29.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:28 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2109360964' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-14T18:30:29.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:29 smithi069 ceph-mon[42047]: pgmap v432: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:30.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:29 smithi119 ceph-mon[43973]: pgmap v432: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:30.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:29 smithi091 ceph-mon[43601]: pgmap v432: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-14T18:30:31.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:31 smithi069 ceph-mon[42047]: pgmap v433: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-14T18:30:32.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:31 smithi119 ceph-mon[43973]: pgmap v433: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-14T18:30:32.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:31 smithi091 ceph-mon[43601]: pgmap v433: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-14T18:30:33.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:33 smithi069 ceph-mon[42047]: pgmap v434: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-14T18:30:34.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:33 smithi119 ceph-mon[43973]: pgmap v434: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-14T18:30:34.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:33 smithi091 ceph-mon[43601]: pgmap v434: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-14T18:30:34.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T18:30:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:30:34.434 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-14T18:30:34.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:30:34.456 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-12-14T18:30:34.517 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-14T18:30:34.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:30:34.517 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-14T18:30:34.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-14T18:30:34.602 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-12-14T18:30:34.672 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-14T18:30:34.685 INFO:tasks.cephadm:Teardown begin 2023-12-14T18:30:34.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-14T18:30:34.686 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 -- 172.21.15.69:0/2426465717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 msgr2=0x7f1574100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 --2- 172.21.15.69:0/2426465717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f1574100640 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1564009990 tx=0x7f1564009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 -- 172.21.15.69:0/2426465717 shutdown_connections 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 --2- 172.21.15.69:0/2426465717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1574101db0 0x7f1574108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 --2- 172.21.15.69:0/2426465717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f1574100640 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 --2- 172.21.15.69:0/2426465717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1574101420 0x7f1574101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:34.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 -- 172.21.15.69:0/2426465717 >> 172.21.15.69:0/2426465717 conn(0x7f15740fb810 msgr2=0x7f15740fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 -- 172.21.15.69:0/2426465717 shutdown_connections 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.811+0000 7f1579958700 1 -- 172.21.15.69:0/2426465717 wait complete. 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 Processor -- start 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 -- start start 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f15740748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1574101420 0x7f1574072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1574101db0 0x7f1574073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:34.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574073bc0 con 0x7f1574100230 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574073d30 con 0x7f1574101db0 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1579958700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157419ffb0 con 0x7f1574101420 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f15740748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f15740748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33910/0 (socket says 172.21.15.69:33910) 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 -- 172.21.15.69:0/1287953447 learned_addr learned my addr 172.21.15.69:0/1287953447 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f15727fc700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1574101420 0x7f1574072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f15737fe700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1574101db0 0x7f1574073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 -- 172.21.15.69:0/1287953447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1574101420 msgr2=0x7f1574072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:34.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1574101420 0x7f1574072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 -- 172.21.15.69:0/1287953447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1574101db0 msgr2=0x7f1574073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1574101db0 0x7f1574073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 -- 172.21.15.69:0/1287953447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640095f0 con 0x7f1574100230 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.812+0000 7f1572ffd700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f15740748a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1564004730 tx=0x7f1564009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.813+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156401d070 con 0x7f1574100230 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.813+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1564004ca0 con 0x7f1574100230 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.813+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157410ba90 con 0x7f1574100230 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.813+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564003af0 con 0x7f1574100230 2023-12-14T18:30:34.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.813+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157410b900 con 0x7f1574100230 2023-12-14T18:30:34.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.814+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15741077c0 con 0x7f1574100230 2023-12-14T18:30:34.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.815+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1564005000 con 0x7f1574100230 2023-12-14T18:30:34.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.816+0000 7f1578956700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15600a1150 0x7f15600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.816+0000 7f15727fc700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15600a1150 0x7f15600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.816+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f15640cdcf0 con 0x7f1574100230 2023-12-14T18:30:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.816+0000 7f15727fc700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15600a1150 0x7f15600a3600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f155c00ac50 tx=0x7f155c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:34.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:34.819+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f15640974e0 con 0x7f1574100230 2023-12-14T18:30:35.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.051+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15740618b0 con 0x7f1574100230 2023-12-14T18:30:35.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.052+0000 7f1578956700 1 -- 172.21.15.69:0/1287953447 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10801 (secure 0 0 0) 0x7f156409ab00 con 0x7f1574100230 2023-12-14T18:30:35.053 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:35.054 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:27:06.542050+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:30:35.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15600a1150 msgr2=0x7f15600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15600a1150 0x7f15600a3600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f155c00ac50 tx=0x7f155c00a380 comp rx=0 tx=0).stop 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 msgr2=0x7f15740748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f15740748a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1564004730 tx=0x7f1564009580 comp rx=0 tx=0).stop 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 shutdown_connections 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f15600a1150 0x7f15600a3600 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1574101db0 0x7f1574073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1574100230 0x7f15740748a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 --2- 172.21.15.69:0/1287953447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1574101420 0x7f1574072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 >> 172.21.15.69:0/1287953447 conn(0x7f15740fb810 msgr2=0x7f1574104900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:35.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 shutdown_connections 2023-12-14T18:30:35.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.054+0000 7f1579958700 1 -- 172.21.15.69:0/1287953447 wait complete. 2023-12-14T18:30:35.058 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 27 2023-12-14T18:30:35.068 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-14T18:30:35.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 -- 172.21.15.69:0/2016493123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff754100700 msgr2=0x7ff754100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/2016493123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff754100700 0x7ff754100b10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff750009990 tx=0x7ff750009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 -- 172.21.15.69:0/2016493123 shutdown_connections 2023-12-14T18:30:35.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/2016493123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7540ffd30 0x7ff754107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/2016493123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff754100700 0x7ff754100b10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/2016493123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7540ff3a0 0x7ff7540ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 -- 172.21.15.69:0/2016493123 >> 172.21.15.69:0/2016493123 conn(0x7ff7540f9e80 msgr2=0x7ff7540fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:35.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 -- 172.21.15.69:0/2016493123 shutdown_connections 2023-12-14T18:30:35.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.188+0000 7ff75b5c2700 1 -- 172.21.15.69:0/2016493123 wait complete. 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 Processor -- start 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 -- start start 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7540ff3a0 0x7ff754195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 0x7ff754196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff754100700 0x7ff75419d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75419da90 con 0x7ff7540ffd30 2023-12-14T18:30:35.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75419dbd0 con 0x7ff7540ff3a0 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75b5c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75419dd60 con 0x7ff754100700 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 0x7ff754196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 0x7ff754196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33926/0 (socket says 172.21.15.69:33926) 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 -- 172.21.15.69:0/1329821763 learned_addr learned my addr 172.21.15.69:0/1329821763 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff75935e700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7540ff3a0 0x7ff754195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 -- 172.21.15.69:0/1329821763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff754100700 msgr2=0x7ff75419d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff759b5f700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff754100700 0x7ff75419d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff754100700 0x7ff75419d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 -- 172.21.15.69:0/1329821763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7540ff3a0 msgr2=0x7ff754195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7540ff3a0 0x7ff754195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.189+0000 7ff758b5d700 1 -- 172.21.15.69:0/1329821763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7500095f0 con 0x7ff7540ffd30 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.190+0000 7ff758b5d700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 0x7ff754196450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff74400e9a0 tx=0x7ff74400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.190+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744009790 con 0x7ff7540ffd30 2023-12-14T18:30:35.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.190+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff74400cbd0 con 0x7ff7540ffd30 2023-12-14T18:30:35.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.190+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75410a930 con 0x7ff7540ffd30 2023-12-14T18:30:35.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.190+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744018680 con 0x7ff7540ffd30 2023-12-14T18:30:35.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.190+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75410a7a0 con 0x7ff7540ffd30 2023-12-14T18:30:35.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.191+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75419e390 con 0x7ff7540ffd30 2023-12-14T18:30:35.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.192+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff74400cd40 con 0x7ff7540ffd30 2023-12-14T18:30:35.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.192+0000 7ff74a7fc700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7400a1150 0x7ff7400a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.192+0000 7ff75935e700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7400a1150 0x7ff7400a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.192+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff744014070 con 0x7ff7540ffd30 2023-12-14T18:30:35.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.193+0000 7ff75935e700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7400a1150 0x7ff7400a3600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff750005910 tx=0x7ff75000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:35.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.196+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff744051730 con 0x7ff7540ffd30 2023-12-14T18:30:35.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.428+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff75419e940 con 0x7ff7540ffd30 2023-12-14T18:30:35.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.429+0000 7ff74a7fc700 1 -- 172.21.15.69:0/1329821763 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10801 (secure 0 0 0) 0x7ff744096380 con 0x7ff7540ffd30 2023-12-14T18:30:35.430 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:35.431 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/4104371233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":4104371233},{"type":"v1","addr":"172.21.15.119:6833","nonce":4104371233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":14559,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/4151675388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":4151675388},{"type":"v1","addr":"172.21.15.69:6835","nonce":4151675388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1672922586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":1672922586},{"type":"v1","addr":"172.21.15.69:6837","nonce":1672922586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3763863482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3763863482},{"type":"v1","addr":"172.21.15.69:6839","nonce":3763863482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3629482996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3629482996},{"type":"v1","addr":"172.21.15.69:6841","nonce":3629482996}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6833/653738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":653738912},{"type":"v1","addr":"172.21.15.91:6833","nonce":653738912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-14T18:23:29.291233+0000","modified":"2023-12-14T18:27:06.542050+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/1476188818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1476188818},{"type":"v1","addr":"172.21.15.119:6835","nonce":1476188818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24442":{"gid":24442,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3442609233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3442609233},{"type":"v1","addr":"172.21.15.119:6837","nonce":3442609233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6839/771447970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":771447970},{"type":"v1","addr":"172.21.15.119:6839","nonce":771447970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6835/426473742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":426473742},{"type":"v1","addr":"172.21.15.91:6835","nonce":426473742}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.91:6837/3727199285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3727199285},{"type":"v1","addr":"172.21.15.91:6837","nonce":3727199285}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6839/311589557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":311589557},{"type":"v1","addr":"172.21.15.91:6839","nonce":311589557}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-14T18:30:35.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7400a1150 msgr2=0x7ff7400a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7400a1150 0x7ff7400a3600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff750005910 tx=0x7ff75000b260 comp rx=0 tx=0).stop 2023-12-14T18:30:35.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 msgr2=0x7ff754196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 0x7ff754196450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff74400e9a0 tx=0x7ff74400ed60 comp rx=0 tx=0).stop 2023-12-14T18:30:35.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 shutdown_connections 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7ff7400a1150 0x7ff7400a3600 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff754100700 0x7ff75419d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7540ff3a0 0x7ff754195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 --2- 172.21.15.69:0/1329821763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7540ffd30 0x7ff754196450 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 >> 172.21.15.69:0/1329821763 conn(0x7ff7540f9e80 msgr2=0x7ff7540fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 shutdown_connections 2023-12-14T18:30:35.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.431+0000 7ff75b5c2700 1 -- 172.21.15.69:0/1329821763 wait complete. 2023-12-14T18:30:35.435 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 27 2023-12-14T18:30:35.445 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-14T18:30:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2060101972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f98100d80 msgr2=0x7f1f98103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2060101972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f98100d80 0x7f1f98103160 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009990 tx=0x7f1f88009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2060101972 shutdown_connections 2023-12-14T18:30:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2060101972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f98105fc0 0x7f1f981083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2060101972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f98100d80 0x7f1f98103160 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2060101972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f981036a0 0x7f1f98105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2060101972 >> 172.21.15.69:0/2060101972 conn(0x7f1f980fa740 msgr2=0x7f1f980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2060101972 shutdown_connections 2023-12-14T18:30:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2060101972 wait complete. 2023-12-14T18:30:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 Processor -- start 2023-12-14T18:30:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.578+0000 7f1f9d5df700 1 -- start start 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f98100d80 0x7f1f98195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 0x7f1f98196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f98105fc0 0x7f1f9819d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9819da40 con 0x7f1f981036a0 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9819db80 con 0x7f1f98100d80 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9819dd10 con 0x7f1f98105fc0 2023-12-14T18:30:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 0x7f1f98196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f96ffd700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f98100d80 0x7f1f98195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 0x7f1f98196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58790/0 (socket says 172.21.15.69:58790) 2023-12-14T18:30:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 -- 172.21.15.69:0/2138946920 learned_addr learned my addr 172.21.15.69:0/2138946920 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f977fe700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f98105fc0 0x7f1f9819d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 -- 172.21.15.69:0/2138946920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f98105fc0 msgr2=0x7f1f9819d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f98105fc0 0x7f1f9819d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 -- 172.21.15.69:0/2138946920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f98100d80 msgr2=0x7f1f98195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f98100d80 0x7f1f98195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 -- 172.21.15.69:0/2138946920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009520 con 0x7f1f981036a0 2023-12-14T18:30:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f96ffd700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f98100d80 0x7f1f98195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-14T18:30:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f967fc700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 0x7f1f98196400 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00eb30 tx=0x7f1f8c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c009880 con 0x7f1f981036a0 2023-12-14T18:30:35.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f880095f0 con 0x7f1f981036a0 2023-12-14T18:30:35.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f8c0044b0 con 0x7f1f981036a0 2023-12-14T18:30:35.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.579+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c003ce0 con 0x7f1f981036a0 2023-12-14T18:30:35.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.580+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9810ba70 con 0x7f1f981036a0 2023-12-14T18:30:35.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.580+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f980fc2b0 con 0x7f1f981036a0 2023-12-14T18:30:35.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.582+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1f8c003e40 con 0x7f1f981036a0 2023-12-14T18:30:35.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.583+0000 7f1f7ffff700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f800a1150 0x7f1f800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.583+0000 7f1f96ffd700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f800a1150 0x7f1f800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.583+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1f8c014070 con 0x7f1f981036a0 2023-12-14T18:30:35.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.583+0000 7f1f96ffd700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f800a1150 0x7f1f800a3600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1f88006010 tx=0x7f1f88005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:35.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.586+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1f8c096660 con 0x7f1f981036a0 2023-12-14T18:30:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:35 smithi069 ceph-mon[42047]: pgmap v435: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2023-12-14T18:30:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1287953447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:35 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1329821763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:35.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:35 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:30:35.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.804+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f98067160 con 0x7f1f981036a0 2023-12-14T18:30:35.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.805+0000 7f1f7ffff700 1 -- 172.21.15.69:0/2138946920 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22516 (secure 0 0 0) 0x7f1f8c099c80 con 0x7f1f981036a0 2023-12-14T18:30:35.807 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-14T18:30:35.807 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"fsid":"f1527c12-9aac-11ee-95a5-87774f69a715","created":"2023-12-14T18:17:40.156489+0000","modified":"2023-12-14T18:24:27.525352+0000","last_up_change":"2023-12-14T18:22:55.618327+0000","last_in_change":"2023-12-14T18:22:39.278324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-14T18:20:16.498219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-14T18:23:27.160683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-14T18:23:28.472244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56f72c81-c108-4731-8724-00763a3933d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6803","nonce":1311409675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6805","nonce":1311409675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6809","nonce":1311409675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1311409675},{"type":"v1","addr":"172.21.15.69:6807","nonce":1311409675}]},"public_addr":"172.21.15.69:6803/1311409675","cluster_addr":"172.21.15.69:6805/1311409675","heartbeat_back_addr":"172.21.15.69:6809/1311409675","heartbeat_front_addr":"172.21.15.69:6807/1311409675","state":["exists","up"]},{"osd":1,"uuid":"3f983667-4671-4b3b-9ae7-6f87d8fc3e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6801","nonce":3579777020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6803","nonce":3579777020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6807","nonce":3579777020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3579777020},{"type":"v1","addr":"172.21.15.91:6805","nonce":3579777020}]},"public_addr":"172.21.15.91:6801/3579777020","cluster_addr":"172.21.15.91:6803/3579777020","heartbeat_back_addr":"172.21.15.91:6807/3579777020","heartbeat_front_addr":"172.21.15.91:6805/3579777020","state":["exists","up"]},{"osd":2,"uuid":"6bd26b89-5342-4e8a-8365-c47ce87f298d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6801","nonce":1861543624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6803","nonce":1861543624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6807","nonce":1861543624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1861543624},{"type":"v1","addr":"172.21.15.119:6805","nonce":1861543624}]},"public_addr":"172.21.15.119:6801/1861543624","cluster_addr":"172.21.15.119:6803/1861543624","heartbeat_back_addr":"172.21.15.119:6807/1861543624","heartbeat_front_addr":"172.21.15.119:6805/1861543624","state":["exists","up"]},{"osd":3,"uuid":"5f23d99f-7851-4905-8583-6cdd9fb6f75f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6811","nonce":3948335762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6813","nonce":3948335762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6817","nonce":3948335762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":3948335762},{"type":"v1","addr":"172.21.15.69:6815","nonce":3948335762}]},"public_addr":"172.21.15.69:6811/3948335762","cluster_addr":"172.21.15.69:6813/3948335762","heartbeat_back_addr":"172.21.15.69:6817/3948335762","heartbeat_front_addr":"172.21.15.69:6815/3948335762","state":["exists","up"]},{"osd":4,"uuid":"ad340870-d572-419a-9812-e22954c498b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6809","nonce":3884359011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6811","nonce":3884359011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6815","nonce":3884359011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":3884359011},{"type":"v1","addr":"172.21.15.91:6813","nonce":3884359011}]},"public_addr":"172.21.15.91:6809/3884359011","cluster_addr":"172.21.15.91:6811/3884359011","heartbeat_back_addr":"172.21.15.91:6815/3884359011","heartbeat_front_addr":"172.21.15.91:6813/3884359011","state":["exists","up"]},{"osd":5,"uuid":"6ebe12f3-7661-4ca7-a325-44590e2cbe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6809","nonce":3766790322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6811","nonce":3766790322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6815","nonce":3766790322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3766790322},{"type":"v1","addr":"172.21.15.119:6813","nonce":3766790322}]},"public_addr":"172.21.15.119:6809/3766790322","cluster_addr":"172.21.15.119:6811/3766790322","heartbeat_back_addr":"172.21.15.119:6815/3766790322","heartbeat_front_addr":"172.21.15.119:6813/3766790322","state":["exists","up"]},{"osd":6,"uuid":"bc1bee25-8cfc-47b3-bee5-df0c011fb92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6819","nonce":2145059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6821","nonce":2145059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6825","nonce":2145059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2145059445},{"type":"v1","addr":"172.21.15.69:6823","nonce":2145059445}]},"public_addr":"172.21.15.69:6819/2145059445","cluster_addr":"172.21.15.69:6821/2145059445","heartbeat_back_addr":"172.21.15.69:6825/2145059445","heartbeat_front_addr":"172.21.15.69:6823/2145059445","state":["exists","up"]},{"osd":7,"uuid":"1a855d88-a81c-4556-9e92-30d841fbc57d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6817","nonce":3612368750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6819","nonce":3612368750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6823","nonce":3612368750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3612368750},{"type":"v1","addr":"172.21.15.91:6821","nonce":3612368750}]},"public_addr":"172.21.15.91:6817/3612368750","cluster_addr":"172.21.15.91:6819/3612368750","heartbeat_back_addr":"172.21.15.91:6823/3612368750","heartbeat_front_addr":"172.21.15.91:6821/3612368750","state":["exists","up"]},{"osd":8,"uuid":"b512b899-9be2-4fc9-a305-589642b320e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6817","nonce":1350490441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6819","nonce":1350490441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6823","nonce":1350490441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1350490441},{"type":"v1","addr":"172.21.15.119:6821","nonce":1350490441}]},"public_addr":"172.21.15.119:6817/1350490441","cluster_addr":"172.21.15.119:6819/1350490441","heartbeat_back_addr":"172.21.15.119:6823/1350490441","heartbeat_front_addr":"172.21.15.119:6821/1350490441","state":["exists","up"]},{"osd":9,"uuid":"60a4dcf1-ae9c-46b7-8e15-d657b9ec91c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6827","nonce":242196071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6829","nonce":242196071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6833","nonce":242196071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":242196071},{"type":"v1","addr":"172.21.15.69:6831","nonce":242196071}]},"public_addr":"172.21.15.69:6827/242196071","cluster_addr":"172.21.15.69:6829/242196071","heartbeat_back_addr":"172.21.15.69:6833/242196071","heartbeat_front_addr":"172.21.15.69:6831/242196071","state":["exists","up"]},{"osd":10,"uuid":"17daa9d6-173d-42ba-99d5-bf6b9e235efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6825","nonce":687412463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6827","nonce":687412463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6831","nonce":687412463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":687412463},{"type":"v1","addr":"172.21.15.91:6829","nonce":687412463}]},"public_addr":"172.21.15.91:6825/687412463","cluster_addr":"172.21.15.91:6827/687412463","heartbeat_back_addr":"172.21.15.91:6831/687412463","heartbeat_front_addr":"172.21.15.91:6829/687412463","state":["exists","up"]},{"osd":11,"uuid":"22a093d7-7882-4043-bbd4-396c85352b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6825","nonce":1392075929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6827","nonce":1392075929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6831","nonce":1392075929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1392075929},{"type":"v1","addr":"172.21.15.119:6829","nonce":1392075929}]},"public_addr":"172.21.15.119:6825/1392075929","cluster_addr":"172.21.15.119:6827/1392075929","heartbeat_back_addr":"172.21.15.119:6831/1392075929","heartbeat_front_addr":"172.21.15.119:6829/1392075929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:38.403873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:19:56.446674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:14.227295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:31.989102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:20:49.795147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:07.330868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:25.181476+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:21:42.945432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:00.990268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:18.519519+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:36.359859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-14T18:22:54.239497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3699885016":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/1705055800":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/786686306":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6801/3801854408":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3054579215":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/3468744885":"2023-12-15T18:18:03.680568+0000","172.21.15.69:0/778280662":"2023-12-15T18:18:26.173798+0000","172.21.15.69:0/904652576":"2023-12-15T18:18:26.173798+0000","172.21.15.69:6800/3801854408":"2023-12-15T18:18:03.680568+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-14T18:30:35.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f800a1150 msgr2=0x7f1f800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f800a1150 0x7f1f800a3600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1f88006010 tx=0x7f1f88005960 comp rx=0 tx=0).stop 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 msgr2=0x7f1f98196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 0x7f1f98196400 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00eb30 tx=0x7f1f8c00ee40 comp rx=0 tx=0).stop 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 shutdown_connections 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f1f800a1150 0x7f1f800a3600 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f98105fc0 0x7f1f9819d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1f98100d80 0x7f1f98195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 --2- 172.21.15.69:0/2138946920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f981036a0 0x7f1f98196400 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 >> 172.21.15.69:0/2138946920 conn(0x7f1f980fa740 msgr2=0x7f1f981019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:35.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 shutdown_connections 2023-12-14T18:30:35.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.808+0000 7f1f9d5df700 1 -- 172.21.15.69:0/2138946920 wait complete. 2023-12-14T18:30:35.823 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-14T18:30:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 -- 172.21.15.69:0/2190648078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 msgr2=0x7f9058108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 --2- 172.21.15.69:0/2190648078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f9058108360 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f905000b0a0 tx=0x7f905000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 -- 172.21.15.69:0/2190648078 shutdown_connections 2023-12-14T18:30:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 --2- 172.21.15.69:0/2190648078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f9058108360 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 --2- 172.21.15.69:0/2190648078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058100cc0 0x7f90581030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 --2- 172.21.15.69:0/2190648078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90581035e0 0x7f90581059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 -- 172.21.15.69:0/2190648078 >> 172.21.15.69:0/2190648078 conn(0x7f90580fa740 msgr2=0x7f90580fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:35.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 -- 172.21.15.69:0/2190648078 shutdown_connections 2023-12-14T18:30:35.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.973+0000 7f906055f700 1 -- 172.21.15.69:0/2190648078 wait complete. 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 Processor -- start 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 -- start start 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058100cc0 0x7f9058198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90581035e0 0x7f90581986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f905819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905819fce0 con 0x7f9058105f00 2023-12-14T18:30:35.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905819fe20 con 0x7f90581035e0 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f906055f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905819ffb0 con 0x7f9058100cc0 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f905819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f905819f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58802/0 (socket says 172.21.15.69:58802) 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 -- 172.21.15.69:0/1033931214 learned_addr learned my addr 172.21.15.69:0/1033931214 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905e2fb700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058100cc0 0x7f9058198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905dafa700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90581035e0 0x7f90581986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 -- 172.21.15.69:0/1033931214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058100cc0 msgr2=0x7f9058198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058100cc0 0x7f9058198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 -- 172.21.15.69:0/1033931214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90581035e0 msgr2=0x7f90581986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90581035e0 0x7f90581986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 -- 172.21.15.69:0/1033931214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9050009d00 con 0x7f9058105f00 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.974+0000 7f905eafc700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f905819f710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90500062a0 tx=0x7f9050004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.975+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000e040 con 0x7f9058105f00 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.975+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f905001db20 con 0x7f9058105f00 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.975+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905001bac0 con 0x7f9058105f00 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.975+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905810bab0 con 0x7f9058105f00 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.975+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905810b920 con 0x7f9058105f00 2023-12-14T18:30:35.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.976+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058107a70 con 0x7f9058105f00 2023-12-14T18:30:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.977+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f905001dc90 con 0x7f9058105f00 2023-12-14T18:30:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.977+0000 7f904f7fe700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90440a11d0 0x7f90440a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.977+0000 7f905e2fb700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90440a11d0 0x7f90440a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.977+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f90500ce8b0 con 0x7f9058105f00 2023-12-14T18:30:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.978+0000 7f905e2fb700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90440a11d0 0x7f90440a3680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9054005950 tx=0x7f905400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:35.981+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f90500980a0 con 0x7f9058105f00 2023-12-14T18:30:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:35 smithi119 ceph-mon[43973]: pgmap v435: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2023-12-14T18:30:36.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1287953447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:35 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1329821763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:35 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:35 smithi091 ceph-mon[43601]: pgmap v435: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2023-12-14T18:30:36.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1287953447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:35 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1329821763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:35 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:36.223+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9058061900 con 0x7f9058105f00 2023-12-14T18:30:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/2138946920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:30:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:30:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:36 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:30:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:36 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1033931214' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-14T18:30:36.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:36 smithi069 ceph-mon[42047]: osdmap e82: 12 total, 12 up, 12 in 2023-12-14T18:30:37.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.068+0000 7f904f7fe700 1 -- 172.21.15.69:0/1033931214 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f905009b6c0 con 0x7f9058105f00 2023-12-14T18:30:37.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90440a11d0 msgr2=0x7f90440a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:37.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90440a11d0 0x7f90440a3680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9054005950 tx=0x7f905400b410 comp rx=0 tx=0).stop 2023-12-14T18:30:37.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 msgr2=0x7f905819f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:37.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f905819f710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90500062a0 tx=0x7f9050004d00 comp rx=0 tx=0).stop 2023-12-14T18:30:37.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 shutdown_connections 2023-12-14T18:30:37.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f90440a11d0 0x7f90440a3680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9058105f00 0x7f905819f710 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058100cc0 0x7f9058198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 --2- 172.21.15.69:0/1033931214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90581035e0 0x7f90581986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 >> 172.21.15.69:0/1033931214 conn(0x7f90580fa740 msgr2=0x7f90580ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:37.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 shutdown_connections 2023-12-14T18:30:37.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.070+0000 7f906055f700 1 -- 172.21.15.69:0/1033931214 wait complete. 2023-12-14T18:30:37.074 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-14T18:30:37.087 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-14T18:30:37.112 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:36 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/2138946920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:37.112 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:30:37.112 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:30:37.112 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:36 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:30:37.112 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:36 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1033931214' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-14T18:30:37.112 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:36 smithi119 ceph-mon[43973]: osdmap e82: 12 total, 12 up, 12 in 2023-12-14T18:30:37.119 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:36 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/2138946920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-14T18:30:37.119 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-14T18:30:37.119 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-14T18:30:37.119 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:36 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' 2023-12-14T18:30:37.119 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:36 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1033931214' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-14T18:30:37.119 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:36 smithi091 ceph-mon[43601]: osdmap e82: 12 total, 12 up, 12 in 2023-12-14T18:30:37.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 -- 172.21.15.69:0/2632696513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 msgr2=0x7feea0073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:37.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 --2- 172.21.15.69:0/2632696513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0073940 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009990 tx=0x7fee9c009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 -- 172.21.15.69:0/2632696513 shutdown_connections 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 --2- 172.21.15.69:0/2632696513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feea01080e0 0x7feea010a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 --2- 172.21.15.69:0/2632696513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea0074ab0 0x7feea0072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 --2- 172.21.15.69:0/2632696513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0073940 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 -- 172.21.15.69:0/2632696513 >> 172.21.15.69:0/2632696513 conn(0x7feea00fb850 msgr2=0x7feea00fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 -- 172.21.15.69:0/2632696513 shutdown_connections 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 -- 172.21.15.69:0/2632696513 wait complete. 2023-12-14T18:30:37.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 Processor -- start 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.219+0000 7feea79f8700 1 -- start start 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feea0074ab0 0x7feea01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea01080e0 0x7feea019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea019fbf0 con 0x7feea00734d0 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea019fd30 con 0x7feea01080e0 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea019fec0 con 0x7feea0074ab0 2023-12-14T18:30:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58814/0 (socket says 172.21.15.69:58814) 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 -- 172.21.15.69:0/1412761271 learned_addr learned my addr 172.21.15.69:0/1412761271 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5f95700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea01080e0 0x7feea019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea4f93700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feea0074ab0 0x7feea01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 -- 172.21.15.69:0/1412761271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feea0074ab0 msgr2=0x7feea01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feea0074ab0 0x7feea01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 -- 172.21.15.69:0/1412761271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea01080e0 msgr2=0x7feea019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea01080e0 0x7feea019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 -- 172.21.15.69:0/1412761271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0095f0 con 0x7feea00734d0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea5794700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0198070 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fee9000d980 tx=0x7fee9000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90004220 con 0x7feea00734d0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee90007640 con 0x7feea00734d0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea010dc20 con 0x7feea00734d0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90005660 con 0x7feea00734d0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.220+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea010da90 con 0x7feea00734d0 2023-12-14T18:30:37.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.221+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea0106820 con 0x7feea00734d0 2023-12-14T18:30:37.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.222+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fee90004750 con 0x7feea00734d0 2023-12-14T18:30:37.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.223+0000 7fee967fc700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fee8c0a1150 0x7fee8c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:37.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.223+0000 7feea4f93700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fee8c0a1150 0x7fee8c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:37.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.223+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fee900ccd20 con 0x7feea00734d0 2023-12-14T18:30:37.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.224+0000 7feea4f93700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fee8c0a1150 0x7fee8c0a3600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00b5c0 tx=0x7fee9c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:37.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.227+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fee90096320 con 0x7feea00734d0 2023-12-14T18:30:37.375 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c[69645]: ignoring --setuser ceph since I am not root 2023-12-14T18:30:37.375 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c[69645]: ignoring --setgroup ceph since I am not root 2023-12-14T18:30:37.375 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c[69645]: starting mds.c at 2023-12-14T18:30:37.376 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i[69987]: ignoring --setuser ceph since I am not root 2023-12-14T18:30:37.376 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i[69987]: ignoring --setgroup ceph since I am not root 2023-12-14T18:30:37.376 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i[69987]: starting mds.i at 2023-12-14T18:30:37.377 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f[69304]: ignoring --setuser ceph since I am not root 2023-12-14T18:30:37.377 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f[69304]: ignoring --setgroup ceph since I am not root 2023-12-14T18:30:37.377 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mds[69327]: -- 172.21.15.119:0/3039997613 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c9d6957520 con 0x55c9d692cc00 2023-12-14T18:30:37.377 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f[69304]: starting mds.f at 2023-12-14T18:30:37.387 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e[67992]: ignoring --setuser ceph since I am not root 2023-12-14T18:30:37.387 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e[67992]: ignoring --setgroup ceph since I am not root 2023-12-14T18:30:37.387 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e[67992]: starting mds.e at 2023-12-14T18:30:37.387 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: ignoring --setuser ceph since I am not root 2023-12-14T18:30:37.388 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: ignoring --setgroup ceph since I am not root 2023-12-14T18:30:37.388 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mds[68698]: -- 172.21.15.91:0/2757009100 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b6afb27520 con 0x55b6afafc800 2023-12-14T18:30:37.388 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: starting mds.b at 2023-12-14T18:30:37.388 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h[68332]: ignoring --setuser ceph since I am not root 2023-12-14T18:30:37.389 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h[68332]: ignoring --setgroup ceph since I am not root 2023-12-14T18:30:37.389 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mds[68355]: -- 172.21.15.91:0/1618700501 <== mon.2 v2:172.21.15.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561a8e685520 con 0x561a8e65ac00 2023-12-14T18:30:37.389 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h[68332]: starting mds.h at 2023-12-14T18:30:37.458 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a[42024]: 2023-12-14T18:30:37.063+0000 7f056dc38700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T18:30:37.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:37.462+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feea00679f0 con 0x7feea00734d0 2023-12-14T18:30:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:30:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: Service mgr has no related daemon already placed. 2023-12-14T18:30:37.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: Service mon has no related daemon already placed. 2023-12-14T18:30:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: Service mds.all has no related daemon already placed. 2023-12-14T18:30:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: pgmap v437: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-14T18:30:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-14T18:30:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T18:30:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1033931214' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-14T18:30:37.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-14T18:30:37.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:37 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1412761271' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:30:38.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.069+0000 7fee967fc700 1 -- 172.21.15.69:0/1412761271 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee900160a0 con 0x7feea00734d0 2023-12-14T18:30:38.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fee8c0a1150 msgr2=0x7fee8c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:38.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fee8c0a1150 0x7fee8c0a3600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00b5c0 tx=0x7fee9c005fb0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 msgr2=0x7feea0198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:38.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0198070 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fee9000d980 tx=0x7fee9000dc90 comp rx=0 tx=0).stop 2023-12-14T18:30:38.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 shutdown_connections 2023-12-14T18:30:38.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fee8c0a1150 0x7fee8c0a3600 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea01080e0 0x7feea019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feea00734d0 0x7feea0198070 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 --2- 172.21.15.69:0/1412761271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feea0074ab0 0x7feea01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 >> 172.21.15.69:0/1412761271 conn(0x7feea00fb850 msgr2=0x7feea00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:38.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 shutdown_connections 2023-12-14T18:30:38.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.072+0000 7feea79f8700 1 -- 172.21.15.69:0/1412761271 wait complete. 2023-12-14T18:30:38.088 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-14T18:30:38.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:30:38.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: Service mgr has no related daemon already placed. 2023-12-14T18:30:38.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: Service mon has no related daemon already placed. 2023-12-14T18:30:38.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: Service mds.all has no related daemon already placed. 2023-12-14T18:30:38.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: pgmap v437: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-14T18:30:38.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-14T18:30:38.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T18:30:38.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1033931214' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-14T18:30:38.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-14T18:30:38.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:37 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1412761271' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:30:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:30:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: Service mgr has no related daemon already placed. 2023-12-14T18:30:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: Service mon has no related daemon already placed. 2023-12-14T18:30:38.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: Service mds.all has no related daemon already placed. 2023-12-14T18:30:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: pgmap v437: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-14T18:30:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-14T18:30:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-14T18:30:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1033931214' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-14T18:30:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-14T18:30:38.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:37 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1412761271' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-14T18:30:38.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 -- 172.21.15.69:0/623837610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 msgr2=0x7fad2c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 --2- 172.21.15.69:0/623837610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c0ff7a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fad28009990 tx=0x7fad28009ca0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 -- 172.21.15.69:0/623837610 shutdown_connections 2023-12-14T18:30:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 --2- 172.21.15.69:0/623837610 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c0ffce0 0x7fad2c107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 --2- 172.21.15.69:0/623837610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2c1006e0 0x7fad2c100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 --2- 172.21.15.69:0/623837610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c0ff7a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 -- 172.21.15.69:0/623837610 >> 172.21.15.69:0/623837610 conn(0x7fad2c0f9ed0 msgr2=0x7fad2c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 -- 172.21.15.69:0/623837610 shutdown_connections 2023-12-14T18:30:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.215+0000 7fad33454700 1 -- 172.21.15.69:0/623837610 wait complete. 2023-12-14T18:30:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 Processor -- start 2023-12-14T18:30:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 -- start start 2023-12-14T18:30:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2c0ffce0 0x7fad2c101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c1006e0 0x7fad2c101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c102400 con 0x7fad2c0ff330 2023-12-14T18:30:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c102570 con 0x7fad2c1006e0 2023-12-14T18:30:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad33454700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c19ff40 con 0x7fad2c0ffce0 2023-12-14T18:30:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:38.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c1030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58826/0 (socket says 172.21.15.69:58826) 2023-12-14T18:30:38.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 -- 172.21.15.69:0/3748166992 learned_addr learned my addr 172.21.15.69:0/3748166992 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:38.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad319f1700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c1006e0 0x7fad2c101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:38.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 -- 172.21.15.69:0/3748166992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2c0ffce0 msgr2=0x7fad2c101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:38.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad309ef700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2c0ffce0 0x7fad2c101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:38.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2c0ffce0 0x7fad2c101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 -- 172.21.15.69:0/3748166992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c1006e0 msgr2=0x7fad2c101c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.216+0000 7fad311f0700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c1006e0 0x7fad2c101c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad311f0700 1 -- 172.21.15.69:0/3748166992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280095f0 con 0x7fad2c0ff330 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad319f1700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c1006e0 0x7fad2c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad311f0700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c1030e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00d980 tx=0x7fad1c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00de60 con 0x7fad2c0ff330 2023-12-14T18:30:38.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad1c0044b0 con 0x7fad2c0ff330 2023-12-14T18:30:38.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c10a930 con 0x7fad2c0ff330 2023-12-14T18:30:38.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c003b40 con 0x7fad2c0ff330 2023-12-14T18:30:38.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.217+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c10a7a0 con 0x7fad2c0ff330 2023-12-14T18:30:38.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.218+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c1a06e0 con 0x7fad2c0ff330 2023-12-14T18:30:38.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.220+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fad1c004870 con 0x7fad2c0ff330 2023-12-14T18:30:38.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.220+0000 7fad227fc700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad180a11d0 0x7fad180a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:38.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.220+0000 7fad309ef700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad180a11d0 0x7fad180a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:38.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.220+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fad1c0cc9d0 con 0x7fad2c0ff330 2023-12-14T18:30:38.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.221+0000 7fad309ef700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad180a11d0 0x7fad180a3680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fad28006010 tx=0x7fad28000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:38.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.223+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fad1c0960b0 con 0x7fad2c0ff330 2023-12-14T18:30:38.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:38.413+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad2c1a0c90 con 0x7fad2c0ff330 2023-12-14T18:30:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-14T18:30:38.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-14T18:30:38.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: Cluster is now healthy 2023-12-14T18:30:38.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6834/2044542424,v1:172.21.15.119:6835/2044542424] up:boot 2023-12-14T18:30:38.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6834/3793544153,v1:172.21.15.91:6835/3793544153] up:boot 2023-12-14T18:30:38.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6836/1926798355,v1:172.21.15.119:6837/1926798355] up:boot 2023-12-14T18:30:38.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.119:6838/3662897302,v1:172.21.15.119:6839/3662897302] up:boot 2023-12-14T18:30:38.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6836/4118071481,v1:172.21.15.91:6837/4118071481] up:boot 2023-12-14T18:30:38.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: mds.? [v2:172.21.15.91:6838/2231908715,v1:172.21.15.91:6839/2231908715] up:boot 2023-12-14T18:30:38.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1412761271' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-14T18:30:38.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: fsmap 12 up:standby 2023-12-14T18:30:38.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T18:30:38.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T18:30:38.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T18:30:38.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T18:30:38.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T18:30:38.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T18:30:38.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:38 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3748166992' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T18:30:39.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.074+0000 7fad227fc700 1 -- 172.21.15.69:0/3748166992 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad1c0170d0 con 0x7fad2c0ff330 2023-12-14T18:30:39.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.077+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad180a11d0 msgr2=0x7fad180a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:39.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.077+0000 7fad33454700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad180a11d0 0x7fad180a3680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fad28006010 tx=0x7fad28000bc0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.077+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 msgr2=0x7fad2c1030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:39.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.077+0000 7fad33454700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c1030e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00d980 tx=0x7fad1c00dd40 comp rx=0 tx=0).stop 2023-12-14T18:30:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 shutdown_connections 2023-12-14T18:30:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7fad180a11d0 0x7fad180a3680 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c1006e0 0x7fad2c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c0ff330 0x7fad2c1030e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 --2- 172.21.15.69:0/3748166992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2c0ffce0 0x7fad2c101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 >> 172.21.15.69:0/3748166992 conn(0x7fad2c0f9ed0 msgr2=0x7fad2c0fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 shutdown_connections 2023-12-14T18:30:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.080+0000 7fad33454700 1 -- 172.21.15.69:0/3748166992 wait complete. 2023-12-14T18:30:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2023-12-14T18:30:39.098 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-14T18:30:39.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: Cluster is now healthy 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6834/2044542424,v1:172.21.15.119:6835/2044542424] up:boot 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6834/3793544153,v1:172.21.15.91:6835/3793544153] up:boot 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6836/1926798355,v1:172.21.15.119:6837/1926798355] up:boot 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.119:6838/3662897302,v1:172.21.15.119:6839/3662897302] up:boot 2023-12-14T18:30:39.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6836/4118071481,v1:172.21.15.91:6837/4118071481] up:boot 2023-12-14T18:30:39.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: mds.? [v2:172.21.15.91:6838/2231908715,v1:172.21.15.91:6839/2231908715] up:boot 2023-12-14T18:30:39.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1412761271' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-14T18:30:39.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: fsmap 12 up:standby 2023-12-14T18:30:39.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T18:30:39.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T18:30:39.127 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T18:30:39.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T18:30:39.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T18:30:39.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T18:30:39.128 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:38 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3748166992' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T18:30:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-14T18:30:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-14T18:30:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: Cluster is now healthy 2023-12-14T18:30:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6834/2044542424,v1:172.21.15.119:6835/2044542424] up:boot 2023-12-14T18:30:39.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6834/3793544153,v1:172.21.15.91:6835/3793544153] up:boot 2023-12-14T18:30:39.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6836/1926798355,v1:172.21.15.119:6837/1926798355] up:boot 2023-12-14T18:30:39.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.119:6838/3662897302,v1:172.21.15.119:6839/3662897302] up:boot 2023-12-14T18:30:39.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6836/4118071481,v1:172.21.15.91:6837/4118071481] up:boot 2023-12-14T18:30:39.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: mds.? [v2:172.21.15.91:6838/2231908715,v1:172.21.15.91:6839/2231908715] up:boot 2023-12-14T18:30:39.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1412761271' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-14T18:30:39.138 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: fsmap 12 up:standby 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='mgr.14152 172.21.15.69:0/3306728755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-14T18:30:39.139 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:38 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3748166992' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T18:30:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 -- 172.21.15.69:0/3368767506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe80febf0 msgr2=0x7f2fe81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 --2- 172.21.15.69:0/3368767506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe80febf0 0x7f2fe81087d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b0a0 tx=0x7f2fe000b3b0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 -- 172.21.15.69:0/3368767506 shutdown_connections 2023-12-14T18:30:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 --2- 172.21.15.69:0/3368767506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe80febf0 0x7f2fe81087d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 --2- 172.21.15.69:0/3368767506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe81017f0 0x7f2fe8101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 --2- 172.21.15.69:0/3368767506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fe80fe260 0x7f2fe80fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 -- 172.21.15.69:0/3368767506 >> 172.21.15.69:0/3368767506 conn(0x7f2fe80f9ed0 msgr2=0x7f2fe80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 -- 172.21.15.69:0/3368767506 shutdown_connections 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.224+0000 7f2fee149700 1 -- 172.21.15.69:0/3368767506 wait complete. 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 Processor -- start 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 -- start start 2023-12-14T18:30:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe80fe260 0x7f2fe81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fe80febf0 0x7f2fe8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 0x7f2fe819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe819fd70 con 0x7f2fe81017f0 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe819feb0 con 0x7f2fe80febf0 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fee149700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81a0040 con 0x7f2fe80fe260 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 0x7f2fe819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:39.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 0x7f2fe819f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58840/0 (socket says 172.21.15.69:58840) 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 -- 172.21.15.69:0/1608180161 learned_addr learned my addr 172.21.15.69:0/1608180161 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe77fe700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe80fe260 0x7f2fe81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe6ffd700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fe80febf0 0x7f2fe8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 -- 172.21.15.69:0/1608180161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe80fe260 msgr2=0x7f2fe81981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe80fe260 0x7f2fe81981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 -- 172.21.15.69:0/1608180161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fe80febf0 msgr2=0x7f2fe8198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fe80febf0 0x7f2fe8198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.225+0000 7f2fe7fff700 1 -- 172.21.15.69:0/1608180161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0009d00 con 0x7f2fe81017f0 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.226+0000 7f2fe7fff700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 0x7f2fe819f7a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b780 tx=0x7f2fe000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.226+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000e040 con 0x7f2fe81017f0 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.226+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe810ba00 con 0x7f2fe81017f0 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.226+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fe0004e60 con 0x7f2fe81017f0 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.226+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00052a0 con 0x7f2fe81017f0 2023-12-14T18:30:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.226+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe810b870 con 0x7f2fe81017f0 2023-12-14T18:30:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.227+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe8192720 con 0x7f2fe81017f0 2023-12-14T18:30:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.228+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2fe001d470 con 0x7f2fe81017f0 2023-12-14T18:30:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.228+0000 7f2fe4ff9700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2fd00a1150 0x7f2fd00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-14T18:30:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.228+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7944+0+0 (secure 0 0 0) 0x7f2fe00cdd00 con 0x7f2fe81017f0 2023-12-14T18:30:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.228+0000 7f2fe77fe700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2fd00a1150 0x7f2fd00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-14T18:30:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.229+0000 7f2fe77fe700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2fd00a1150 0x7f2fd00a3600 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8067af0 tx=0x7f2fdc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-14T18:30:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.232+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2fe0097650 con 0x7f2fe81017f0 2023-12-14T18:30:39.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:39.427+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2fe8061910 con 0x7f2fe81017f0 2023-12-14T18:30:39.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:39 smithi069 ceph-mon[42047]: pgmap v438: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-14T18:30:39.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:39 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/3748166992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-14T18:30:39.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:39 smithi069 ceph-mon[42047]: osdmap e83: 12 total, 12 up, 12 in 2023-12-14T18:30:39.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:39 smithi069 ceph-mon[42047]: from='client.? 172.21.15.69:0/1608180161' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T18:30:40.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.082+0000 7f2fe4ff9700 1 -- 172.21.15.69:0/1608180161 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2fe009ac70 con 0x7f2fe81017f0 2023-12-14T18:30:40.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2fd00a1150 msgr2=0x7f2fd00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:40.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2fd00a1150 0x7f2fd00a3600 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8067af0 tx=0x7f2fdc00b410 comp rx=0 tx=0).stop 2023-12-14T18:30:40.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 msgr2=0x7f2fe819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-14T18:30:40.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 0x7f2fe819f7a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b780 tx=0x7f2fe000bd40 comp rx=0 tx=0).stop 2023-12-14T18:30:40.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 shutdown_connections 2023-12-14T18:30:40.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:6800/4294204545,v1:172.21.15.69:6801/4294204545] conn(0x7f2fd00a1150 0x7f2fd00a3600 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:40.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81017f0 0x7f2fe819f7a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:40.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe80fe260 0x7f2fe81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:40.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 --2- 172.21.15.69:0/1608180161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fe80febf0 0x7f2fe8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-14T18:30:40.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.085+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 >> 172.21.15.69:0/1608180161 conn(0x7f2fe80f9ed0 msgr2=0x7f2fe8106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-14T18:30:40.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.087+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 shutdown_connections 2023-12-14T18:30:40.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-14T18:30:40.087+0000 7f2fee149700 1 -- 172.21.15.69:0/1608180161 wait complete. 2023-12-14T18:30:40.089 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2023-12-14T18:30:40.104 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:30:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:39 smithi119 ceph-mon[43973]: pgmap v438: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-14T18:30:40.125 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:39 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/3748166992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-14T18:30:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:39 smithi119 ceph-mon[43973]: osdmap e83: 12 total, 12 up, 12 in 2023-12-14T18:30:40.126 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:39 smithi119 ceph-mon[43973]: from='client.? 172.21.15.69:0/1608180161' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T18:30:40.132 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:30:40.136 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:39 smithi091 ceph-mon[43601]: pgmap v438: 97 pgs: 97 active+clean; 517 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-14T18:30:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:39 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/3748166992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-14T18:30:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:39 smithi091 ceph-mon[43601]: osdmap e83: 12 total, 12 up, 12 in 2023-12-14T18:30:40.137 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:39 smithi091 ceph-mon[43601]: from='client.? 172.21.15.69:0/1608180161' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-14T18:30:40.167 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:30:40.202 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-14T18:30:40.202 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-14T18:30:40.220 DEBUG:teuthology.orchestra.run.smithi091:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-14T18:30:40.239 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-14T18:30:40.261 INFO:tasks.cephadm:Stopping all daemons... 2023-12-14T18:30:40.262 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-12-14T18:30:40.262 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a 2023-12-14T18:30:40.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:40 smithi069 systemd[1]: Stopping Ceph mon.a for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:40.814 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a[42024]: 2023-12-14T18:30:40.494+0000 7f0570c3e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:40.815 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a[42024]: 2023-12-14T18:30:40.494+0000 7f0570c3e700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-12-14T18:30:41.170 INFO:journalctl@ceph.mon.a.smithi069.stdout:Dec 14 18:30:40 smithi069 bash[196536]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-a 2023-12-14T18:30:41.177 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.a.service' 2023-12-14T18:30:41.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:41.226 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-12-14T18:30:41.226 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-12-14T18:30:41.226 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.b 2023-12-14T18:30:41.612 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:41 smithi091 systemd[1]: Stopping Ceph mon.b for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:41.612 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-b[43577]: 2023-12-14T18:30:41.471+0000 7fbadc3e7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:41.612 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-b[43577]: 2023-12-14T18:30:41.471+0000 7fbadc3e7700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-12-14T18:30:41.887 INFO:journalctl@ceph.mon.b.smithi091.stdout:Dec 14 18:30:41 smithi091 bash[72258]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-b 2023-12-14T18:30:42.032 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.b.service' 2023-12-14T18:30:42.084 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:42.084 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-12-14T18:30:42.084 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-12-14T18:30:42.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.c 2023-12-14T18:30:42.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:42 smithi119 systemd[1]: Stopping Ceph mon.c for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:42.375 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-c[43950]: 2023-12-14T18:30:42.323+0000 7f6876c93700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:42.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-c[43950]: 2023-12-14T18:30:42.323+0000 7f6876c93700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-12-14T18:30:42.875 INFO:journalctl@ceph.mon.c.smithi119.stdout:Dec 14 18:30:42 smithi119 bash[74086]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mon-c 2023-12-14T18:30:42.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mon.c.service' 2023-12-14T18:30:43.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:43.025 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-12-14T18:30:43.026 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-12-14T18:30:43.026 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x 2023-12-14T18:30:43.431 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:30:43 smithi069 systemd[1]: Stopping Ceph mgr.x for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:43.431 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:30:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x[42295]: 2023-12-14T18:30:43.265+0000 7f9c87968700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:43.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Dec 14 18:30:43 smithi069 bash[196677]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-x 2023-12-14T18:30:43.733 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.x.service' 2023-12-14T18:30:43.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:43.769 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-12-14T18:30:43.769 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-12-14T18:30:43.770 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.y 2023-12-14T18:30:44.137 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:30:43 smithi091 systemd[1]: Stopping Ceph mgr.y for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:44.624 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:30:44 smithi091 bash[72410]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-y 2023-12-14T18:30:44.624 INFO:journalctl@ceph.mgr.y.smithi091.stdout:Dec 14 18:30:44 smithi091 systemd[1]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-12-14T18:30:44.629 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.y.service' 2023-12-14T18:30:44.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:44.667 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-12-14T18:30:44.667 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-12-14T18:30:44.667 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.z 2023-12-14T18:30:45.005 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:30:44 smithi119 systemd[1]: Stopping Ceph mgr.z for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:45.326 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:30:45 smithi119 bash[74236]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mgr-z 2023-12-14T18:30:45.326 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Dec 14 18:30:45 smithi119 systemd[1]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-12-14T18:30:45.332 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mgr.z.service' 2023-12-14T18:30:45.368 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:45.369 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-12-14T18:30:45.369 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-14T18:30:45.369 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.0 2023-12-14T18:30:45.709 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:30:45 smithi069 systemd[1]: Stopping Ceph osd.0 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:45.709 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:30:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0[54728]: 2023-12-14T18:30:45.606+0000 7fdf4426e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:45.709 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:30:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0[54728]: 2023-12-14T18:30:45.606+0000 7fdf4426e700 -1 osd.0 84 *** Got signal Terminated *** 2023-12-14T18:30:45.709 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:30:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0[54728]: 2023-12-14T18:30:45.606+0000 7fdf4426e700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:30:51.459 INFO:journalctl@ceph.osd.0.smithi069.stdout:Dec 14 18:30:51 smithi069 bash[196819]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-0 2023-12-14T18:30:52.487 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.0.service' 2023-12-14T18:30:52.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:52.528 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-14T18:30:52.528 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-14T18:30:52.528 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.1 2023-12-14T18:30:52.887 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:30:52 smithi091 systemd[1]: Stopping Ceph osd.1 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:52.887 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:30:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1[48546]: 2023-12-14T18:30:52.761+0000 7fcd2029c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:52.887 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:30:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1[48546]: 2023-12-14T18:30:52.761+0000 7fcd2029c700 -1 osd.1 84 *** Got signal Terminated *** 2023-12-14T18:30:52.888 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:30:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1[48546]: 2023-12-14T18:30:52.761+0000 7fcd2029c700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:30:58.637 INFO:journalctl@ceph.osd.1.smithi091.stdout:Dec 14 18:30:58 smithi091 bash[72549]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-1 2023-12-14T18:30:59.483 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.1.service' 2023-12-14T18:30:59.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:30:59.525 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-14T18:30:59.525 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-14T18:30:59.526 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.2 2023-12-14T18:30:59.875 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:30:59 smithi119 systemd[1]: Stopping Ceph osd.2 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:30:59.876 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:30:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2[49785]: 2023-12-14T18:30:59.763+0000 7fc602011700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:30:59.876 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:30:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2[49785]: 2023-12-14T18:30:59.763+0000 7fc602011700 -1 osd.2 84 *** Got signal Terminated *** 2023-12-14T18:30:59.876 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:30:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2[49785]: 2023-12-14T18:30:59.763+0000 7fc602011700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:05.626 INFO:journalctl@ceph.osd.2.smithi119.stdout:Dec 14 18:31:05 smithi119 bash[74388]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-2 2023-12-14T18:31:06.644 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.2.service' 2023-12-14T18:31:06.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:06.685 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-14T18:31:06.685 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-14T18:31:06.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.3 2023-12-14T18:31:07.209 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:31:06 smithi069 systemd[1]: Stopping Ceph osd.3 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:07.210 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:31:06 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3[60253]: 2023-12-14T18:31:06.928+0000 7f2d5e183700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:07.210 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:31:06 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3[60253]: 2023-12-14T18:31:06.928+0000 7f2d5e183700 -1 osd.3 84 *** Got signal Terminated *** 2023-12-14T18:31:07.210 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:31:06 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3[60253]: 2023-12-14T18:31:06.928+0000 7f2d5e183700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:12.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:11 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:11.949+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:12.934 INFO:journalctl@ceph.osd.3.smithi069.stdout:Dec 14 18:31:12 smithi069 bash[197086]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-3 2023-12-14T18:31:13.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:12 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:12.932+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:13.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:13 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:13.023+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:13.876 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:13 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:13.496+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:13.883 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.3.service' 2023-12-14T18:31:13.923 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:13.923 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-14T18:31:13.923 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-14T18:31:13.923 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.4 2023-12-14T18:31:14.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:13 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:13.905+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:14.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:14 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:14.062+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:14.387 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:31:13 smithi091 systemd[1]: Stopping Ceph osd.4 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:14.387 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:31:14 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4[54006]: 2023-12-14T18:31:14.189+0000 7fc616026700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:14.387 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:31:14 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4[54006]: 2023-12-14T18:31:14.189+0000 7fc616026700 -1 osd.4 84 *** Got signal Terminated *** 2023-12-14T18:31:14.387 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:31:14 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4[54006]: 2023-12-14T18:31:14.189+0000 7fc616026700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:14.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:14 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:14.471+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:14.950 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:14 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:14.488+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:15.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:14 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:14.949+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:15.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:15 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:15.069+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:15.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:15 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:15.492+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:15.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:15 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:15.364+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:15.947 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:15 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:15.522+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:16.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:15 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:15.946+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:16.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:16 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:16.115+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:16.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:16 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:16.459+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:16.876 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:16 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:16.392+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:16.950 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:16 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:16.482+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:17.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:16 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:16.949+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:17.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:17 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:17.361+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:17.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:17 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:17.425+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:17.636 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:17 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:17.151+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:17.946 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:17 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:17.488+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:18.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:17 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:17.945+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:18.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:18 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:18.109+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:18.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:18.386+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:18.626 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:18 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:18.367+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:18.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:18 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:18.465+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:19.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:19 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:19.064+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:19.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:19 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:19.064+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:19.459 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:18 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:18.958+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:19.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:19 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:19.369+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:19.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:19 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:19.400+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:19.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:19 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:19.469+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:19.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:19 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:19.469+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:20.079 INFO:journalctl@ceph.osd.4.smithi091.stdout:Dec 14 18:31:19 smithi091 bash[72820]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-4 2023-12-14T18:31:20.341 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:20.076+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:20.341 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:20.076+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:20.459 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:20.005+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:20.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:20 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:20.421+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:20.626 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:20 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:20.350+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:20.803 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:20 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:20.428+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:20.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:20.518+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:20.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:20.518+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:21.011 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.4.service' 2023-12-14T18:31:21.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:21.051 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-14T18:31:21.052 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-14T18:31:21.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.5 2023-12-14T18:31:21.376 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:21 smithi119 systemd[1]: Stopping Ceph osd.5 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:21.376 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:21.292+0000 7f6f2d116700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:21.376 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:21.292+0000 7f6f2d116700 -1 osd.5 84 *** Got signal Terminated *** 2023-12-14T18:31:21.376 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:21.292+0000 7f6f2d116700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:21.376 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:21.325+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:21.377 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:21.100+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:21.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:21.052+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:21.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:21.052+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:21.459 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:20.957+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:21.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:21 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:21.454+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:21.886 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:21 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:21.404+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:21.929 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:21.481+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:21.930 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:21.481+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:22.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:21 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:21.929+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:22.328 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:22 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:22.069+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:22.383 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:22 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:22.022+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:22.383 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:22 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:22.022+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:22.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:22 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:22.326+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:22.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:22 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:22.500+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:22.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:22 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:22.500+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:22.636 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:22 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:22.381+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:22.923 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:22.485+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:22.923 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:22.485+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:23.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:22.923+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:23.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:22 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:22.923+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:23.366 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:23.055+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:23.366 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:23.055+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:23.368 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:23.032+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:23.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:23.366+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:23.625 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:23.366+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:57.040349+0000 front 2023-12-14T18:30:57.040269+0000 (oldest deadline 2023-12-14T18:31:22.940341+0000) 2023-12-14T18:31:23.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:23.545+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:23.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:23.545+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:23.636 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:23 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:23.365+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:23.909 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:23.498+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:23.909 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:23.498+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:24.208 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:23.908+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:24.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:23 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:23.908+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:24.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:23 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:23.986+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:24.382 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:24 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:24.061+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:24.382 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:24 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:24.061+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:24.636 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:24 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:24.381+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:24.875 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:24 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:24.391+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:24.875 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:24 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:24.391+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:57.040349+0000 front 2023-12-14T18:30:57.040269+0000 (oldest deadline 2023-12-14T18:31:22.940341+0000) 2023-12-14T18:31:24.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:24 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:24.555+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:24.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:24 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:24.555+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:24.881 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:24.481+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:24.881 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:24.481+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:25.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:24.880+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:25.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:24 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:24.880+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:25.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:24 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:24.986+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:25.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:25 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:25.058+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:25.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:25 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:25.058+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:25.875 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:25 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:25.418+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.938574+0000 front 2023-12-14T18:30:48.938489+0000 (oldest deadline 2023-12-14T18:31:14.838465+0000) 2023-12-14T18:31:25.875 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:25 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5[55068]: 2023-12-14T18:31:25.418+0000 7f6f2970c700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:57.040349+0000 front 2023-12-14T18:30:57.040269+0000 (oldest deadline 2023-12-14T18:31:22.940341+0000) 2023-12-14T18:31:25.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:25 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:25.561+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:25.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:25 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:25.561+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:25.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:25 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:25.561+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:25.886 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:25 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:25.419+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:25.919 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:25.473+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:25.919 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:25.473+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:26.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:25.918+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:26.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:25 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:25.918+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:26.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:25 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:25.967+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:26.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:26 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:26.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:26.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:26 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:26.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:26.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:26 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:26.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:26.848 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:26 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:26.578+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:26.849 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:26 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:26.578+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:26.849 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:26 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:26.578+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:26.878 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:26 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:26.522+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:26.878 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:26 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:26.522+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:26.886 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:26 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:26.428+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:27.125 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 14 18:31:26 smithi119 bash[74642]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-5 2023-12-14T18:31:27.125 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:26 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:26.961+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:27.125 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:26 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:26.961+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:27.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:26 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:26.877+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:27.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:26 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:26.877+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:27.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:27 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:27.118+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:27.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:27 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:27.118+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:27.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:27 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:27.118+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:27.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:27 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:27.556+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:27.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:27 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:27.556+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:27.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:27 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:27.556+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:27.880 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:27 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:27.564+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:27.881 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:27 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:27.564+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:27.881 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:27 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:27.564+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:27.887 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:27 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:27.427+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:28.041 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:27 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:27.928+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:28.041 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:27 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:27.928+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:28.049 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.5.service' 2023-12-14T18:31:28.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:28.090 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-14T18:31:28.090 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-12-14T18:31:28.090 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.6 2023-12-14T18:31:28.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:27 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:27.879+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:28.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:27 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:27.879+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:28.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:27 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:27.879+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.397806+0000 front 2023-12-14T18:31:02.397789+0000 (oldest deadline 2023-12-14T18:31:27.697691+0000) 2023-12-14T18:31:28.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 systemd[1]: Stopping Ceph osd.6 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:28.384 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:28 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:28.130+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:28.384 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:28 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:28.130+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:28.384 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:28 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:28.130+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:28.637 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:28 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:28.383+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:28.637 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:28 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:28.383+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:28.709 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:28.325+0000 7f3a460e1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:28.709 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:28.325+0000 7f3a460e1700 -1 osd.6 84 *** Got signal Terminated *** 2023-12-14T18:31:28.709 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:28.325+0000 7f3a460e1700 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:28.709 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:28.557+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:28.710 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:28.557+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:28.710 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:28.557+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:28.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:28 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:28.552+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:28.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:28 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:28.552+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:28.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:28 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:28.552+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:29.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:28.861+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:29.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:28.861+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:29.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:28 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:28.861+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.397806+0000 front 2023-12-14T18:31:02.397789+0000 (oldest deadline 2023-12-14T18:31:27.697691+0000) 2023-12-14T18:31:29.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:28 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:28.883+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:29.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:28 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:28.883+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:29.384 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:29.082+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:29.385 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:29.082+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:29.385 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:29.082+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:29.636 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:29.383+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:29.636 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:29.383+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:29.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:29 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:29.572+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:29.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:29 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:29.572+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:29.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:29 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:29.572+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:29.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:29 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:29.822+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:29.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:29 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:29.822+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:29.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:29 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:29.822+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.397806+0000 front 2023-12-14T18:31:02.397789+0000 (oldest deadline 2023-12-14T18:31:27.697691+0000) 2023-12-14T18:31:29.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:29 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:29.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:29.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:29 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:29.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:29.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:29 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:29.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:30.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:29 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:29.898+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:30.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:29 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:29.898+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:30.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:30 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:30.352+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:30.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:30 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:30.352+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:30.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:30 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:30.126+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:30.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:30 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:30.126+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:30.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:30 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:30.126+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:30.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:30 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:30.590+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:30.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:30 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:30.590+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:30.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:30 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:30.590+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:30.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:30.809+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:30.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:30.809+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:30.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:30.809+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.397806+0000 front 2023-12-14T18:31:02.397789+0000 (oldest deadline 2023-12-14T18:31:27.697691+0000) 2023-12-14T18:31:30.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:30.614+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:30.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:30.614+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:30.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:30 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:30.614+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:31.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:30 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:30.947+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:31.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:30 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:30.947+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:31.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:31 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:31.330+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:31.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:31 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:31.330+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:31.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:31 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:31.113+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:31.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:31 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:31.113+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:31.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:31 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:31.113+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:31.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:31 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:31.544+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:31.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:31 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:31.544+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:31.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:31 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:31.544+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:31.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:31 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:31.829+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:31.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:31 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:31.829+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:31.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:31 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:31.829+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.397806+0000 front 2023-12-14T18:31:02.397789+0000 (oldest deadline 2023-12-14T18:31:27.697691+0000) 2023-12-14T18:31:31.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:31 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:31.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:31.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:31 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:31.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:31.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:31 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:31.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:32.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:31 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:31.993+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:32.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:31 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:31.993+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:32.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:32 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:32.306+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:32.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:32 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:32.306+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:32.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:32 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:32.130+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:32.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:32 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:32.130+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:32.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:32 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:32.130+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:32.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:32 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:32.506+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:32.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:32 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:32.506+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:32.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:32 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:32.506+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:32.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:32.783+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:48.896028+0000 front 2023-12-14T18:30:48.896132+0000 (oldest deadline 2023-12-14T18:31:11.196156+0000) 2023-12-14T18:31:32.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:32.783+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.497085+0000 front 2023-12-14T18:30:56.497227+0000 (oldest deadline 2023-12-14T18:31:22.397228+0000) 2023-12-14T18:31:32.959 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6[65745]: 2023-12-14T18:31:32.783+0000 7f3a40ed4700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.397806+0000 front 2023-12-14T18:31:02.397789+0000 (oldest deadline 2023-12-14T18:31:27.697691+0000) 2023-12-14T18:31:32.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:32.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:32.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:32.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:32.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:32 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:32.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:33.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:32 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:32.988+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:33.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:32 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:32.988+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:33.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:32 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:32.988+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:33.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:33.317+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:33.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:33.317+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:33.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:33.104+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:33.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:33.104+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:33.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:33.104+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:33.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:33 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:33.526+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:33.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:33 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:33.526+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:33.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:33 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:33.526+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:33.929 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:33 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:33.664+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:33.929 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:33 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:33.664+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:33.929 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:33 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:33.664+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:34.209 INFO:journalctl@ceph.osd.6.smithi069.stdout:Dec 14 18:31:33 smithi069 bash[197338]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-6 2023-12-14T18:31:34.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:34 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:34.024+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:34.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:34 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:34.024+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:34.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:34 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:34.024+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:34.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:34.276+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:34.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:34.276+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:34.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:34.276+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:34.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:34.107+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:34.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:34.107+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:34.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:34 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:34.107+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:34.709 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:34.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:34.709 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:34.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:34.709 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:34 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:34.625+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:34.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:34 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:34.527+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:34.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:34 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:34.527+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:34.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:34 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:34.527+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:35.189 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.6.service' 2023-12-14T18:31:35.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:35.230 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-12-14T18:31:35.230 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-12-14T18:31:35.230 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.7 2023-12-14T18:31:35.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:35 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:35.023+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:35.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:35 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:35.023+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:35.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:35 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:35.023+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:35.478 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:35.155+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:35.478 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:35.155+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:35.478 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:35.155+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:35.479 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:35.236+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:35.479 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:35.236+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:35.479 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:35.236+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:35.479 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 systemd[1]: Stopping Ceph osd.7 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:35.479 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:35.477+0000 7f2b4e6c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:35.480 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:35.477+0000 7f2b4e6c7700 -1 osd.7 84 *** Got signal Terminated *** 2023-12-14T18:31:35.480 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:35 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:35.477+0000 7f2b4e6c7700 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:35.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:35 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:35.478+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:35.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:35 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:35.478+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:35.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:35 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:35.478+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:35.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:35 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:35.676+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:35.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:35 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:35.676+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:35.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:35 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:35.676+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:35.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:35 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:35.676+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:36.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:36 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:36.026+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:36.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:36 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:36.026+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:36.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:36 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:36.026+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:36.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:36.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:36.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:36.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:36.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:36.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:36.637 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:36.258+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:36.637 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:36.258+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:36.638 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:36 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:36.258+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:36.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:36 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:36.445+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:36.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:36 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:36.445+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:36.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:36 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:36.445+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:36.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:36 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:36.669+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:36.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:36 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:36.669+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:36.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:36 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:36.669+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:36.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:36 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:36.669+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:37.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:37.068+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:37.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:37.068+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:37.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:37.068+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:37.386 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:37.253+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:37.386 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:37.253+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:37.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:37.253+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:37.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:37.100+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:37.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:37.100+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:37.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:37.100+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:37.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:37.100+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:37.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:37.449+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:37.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:37.449+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:37.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:37 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:37.449+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:37.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:37 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:37.674+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:37.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:37 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:37.674+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:37.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:37 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:37.674+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:37.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:37 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:37.674+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:38.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:38 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:38.109+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:38.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:38 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:38.109+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:38.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:38 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:38.109+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:38.386 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:38.212+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:38.386 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:38.212+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:38.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:38.212+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:38.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:38.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:38.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:38.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:38.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:38.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:38.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:38 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:38.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:38.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:38 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:38.486+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:38.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:38 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:38.486+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:38.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:38 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:38.486+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:38.958 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:38 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:38.650+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:38.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:38 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:38.650+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:38.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:38 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:38.650+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:38.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:38 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:38.650+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:39.375 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:39 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:39.098+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:39.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:39 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:39.098+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:39.376 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:39 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:39.098+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:39.386 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:39.239+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:39.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:39.239+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:39.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:39.239+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:39.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:39.114+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:39.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:39.114+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:39.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:39.114+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:39.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:39 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:39.114+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:39.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:39 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:39.480+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:39.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:39 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:39.480+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:39.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:39 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:39.480+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:39.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:39 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:39.618+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:39.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:39 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:39.618+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:39.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:39 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:39.618+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:39.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:39 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:39.618+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:40.386 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:40.271+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:54.879736+0000 front 2023-12-14T18:30:54.879875+0000 (oldest deadline 2023-12-14T18:31:19.579868+0000) 2023-12-14T18:31:40.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:40.271+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.080923+0000 front 2023-12-14T18:31:03.081015+0000 (oldest deadline 2023-12-14T18:31:28.380929+0000) 2023-12-14T18:31:40.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7[59542]: 2023-12-14T18:31:40.271+0000 7f2b474b6700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.882069+0000 front 2023-12-14T18:31:11.882038+0000 (oldest deadline 2023-12-14T18:31:33.582022+0000) 2023-12-14T18:31:40.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:40.095+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:40.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:40.095+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:40.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:40.095+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:40.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:40 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:40.095+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:40.451 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:40.139+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:40.451 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:40.139+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:40.452 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:40.139+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:40.452 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:40.139+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:40.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:40.450+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:40.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:40.450+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:40.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:40 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:40.450+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:40.958 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:40.615+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:40.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:40.615+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:40.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:40.615+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:40.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:40.615+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:40.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:40 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:40.615+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:41.387 INFO:journalctl@ceph.osd.7.smithi091.stdout:Dec 14 18:31:41 smithi091 bash[73078]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-7 2023-12-14T18:31:41.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:41.081+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:41.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:41.081+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:41.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:41.081+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:41.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:41 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:41.081+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:41.457 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:41.134+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:41.457 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:41.134+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:41.457 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:41.134+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:41.457 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:41.134+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:41.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:41.455+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:41.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:41.455+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:41.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:41 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:41.455+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:41.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:41 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:41.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:41.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:41 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:41.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:41.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:41 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:41.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:41.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:41 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:41.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:41.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:41 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:41.602+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:42.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:42 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:42.039+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:42.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:42 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:42.039+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:42.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:42 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:42.039+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:42.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:42 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:42.039+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:42.399 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.7.service' 2023-12-14T18:31:42.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:42.439 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-12-14T18:31:42.440 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-12-14T18:31:42.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.8 2023-12-14T18:31:42.470 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.175+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:42.470 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.175+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:42.470 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.175+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:42.471 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.175+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:42.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:42.479+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:42.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:42.479+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:42.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:42.479+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:42.876 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 systemd[1]: Stopping Ceph osd.8 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:42.876 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.681+0000 7ff85b165700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:42.876 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.681+0000 7ff85b165700 -1 osd.8 84 *** Got signal Terminated *** 2023-12-14T18:31:42.876 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:42.681+0000 7ff85b165700 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:42.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:42 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:42.638+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:42.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:42 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:42.638+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:42.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:42 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:42.638+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:42.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:42 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:42.638+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:42.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:42 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:42.638+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:43.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:43.060+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:43.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:43.060+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:43.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:43.060+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:43.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:43.060+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:43.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:43 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:43.060+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:43.474 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:43.473+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:43.474 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:43.473+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:43.475 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:43.223+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:43.475 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:43.223+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:43.475 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:43.223+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:43.475 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:43.223+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:43.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:43 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:43.473+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:43.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:43.667+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:43.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:43.667+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:43.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:43.667+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:43.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:43.667+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:43.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:43 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:43.667+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:44.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:44 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:44.097+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:44.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:44 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:44.097+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:44.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:44 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:44.097+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:44.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:44 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:44.097+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:44.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:44 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:44.097+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:44.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:44.438+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:44.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:44.438+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:44.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:44.438+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:44.626 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:44.257+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:44.626 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:44.257+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:44.626 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:44.257+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:44.626 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:44 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:44.257+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:45.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:44 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:44.710+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:45.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:44 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:44.710+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:45.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:44 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:44.710+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:45.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:44 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:44.710+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:45.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:44 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:44.710+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:45.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:45 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:45.075+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:45.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:45 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:45.075+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:45.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:45 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:45.075+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:45.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:45 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:45.075+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:45.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:45 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:45.075+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:45.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:45.254+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:45.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:45.254+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:45.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:45.254+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:45.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:45.254+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:45.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:45.414+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:45.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:45.414+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:45.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:45.414+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:45.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:45.414+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:46.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:45.717+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:46.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:45.717+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:46.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:45.717+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:46.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:45.717+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:46.209 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:45 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:45.717+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:46.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:46 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:46.032+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:46.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:46 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:46.032+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:46.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:46 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:46.032+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:46.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:46 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:46.032+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:46.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:46 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:46.032+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:46.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:46.245+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:46.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:46.245+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:46.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:46.245+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:46.626 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:46.245+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:46.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:46.420+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:46.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:46.420+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:46.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:46.420+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:46.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:46 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:46.420+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:46.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:46.673+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:46.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:46.673+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:46.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:46.673+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:46.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:46.673+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:46.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:46 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:46.673+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:47.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:47 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:47.074+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:47.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:47 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:47.074+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:47.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:47 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:47.074+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:47.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:47 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:47.074+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:47.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:47 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:47.074+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:47.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:47.221+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.861413+0000 front 2023-12-14T18:30:56.861383+0000 (oldest deadline 2023-12-14T18:31:20.361393+0000) 2023-12-14T18:31:47.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:47.221+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:02.563301+0000 front 2023-12-14T18:31:02.563331+0000 (oldest deadline 2023-12-14T18:31:26.663435+0000) 2023-12-14T18:31:47.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:47.221+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:08.364830+0000 front 2023-12-14T18:31:08.364920+0000 (oldest deadline 2023-12-14T18:31:32.464807+0000) 2023-12-14T18:31:47.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8[60478]: 2023-12-14T18:31:47.221+0000 7ff853f54700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:14.166173+0000 front 2023-12-14T18:31:14.166131+0000 (oldest deadline 2023-12-14T18:31:40.066200+0000) 2023-12-14T18:31:47.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:47.404+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:47.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:47.404+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:47.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:47.404+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:47.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:47.404+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:47.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:47 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:47.404+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:47.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:47.672+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:47.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:47.672+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:47.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:47.672+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:47.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:47.672+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:47.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:47 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:47.672+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:48.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:48.087+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:48.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:48.087+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:48.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:48.087+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:48.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:48.087+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:48.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:48.087+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:48.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:48 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:48.087+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:48.625 INFO:journalctl@ceph.osd.8.smithi119.stdout:Dec 14 18:31:48 smithi119 bash[74901]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-8 2023-12-14T18:31:48.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:48 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:48.361+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:48.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:48 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:48.361+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:48.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:48 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:48.361+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:48.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:48 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:48.362+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:48.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:48 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:48.362+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:48.958 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:48.671+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:48.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:48.671+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:48.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:48.671+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:48.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:48.671+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:48.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:48 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:48.671+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:49.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:49 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:49.129+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:49.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:49 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:49.129+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:49.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:49 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:49.129+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:49.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:49 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:49.129+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:49.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:49 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:49.129+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:49.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:49 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:49.129+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:49.545 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:49.344+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:49.545 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:49.344+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:49.545 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:49.344+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:49.545 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:49.344+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:49.545 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:49.344+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:49.553 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.8.service' 2023-12-14T18:31:49.633 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:49.633 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-12-14T18:31:49.634 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-12-14T18:31:49.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.9 2023-12-14T18:31:49.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 systemd[1]: Stopping Ceph osd.9 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:49.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.681+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:49.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.681+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:49.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.681+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:49.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.681+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:49.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.681+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:49.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.888+0000 7ff56d262700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:49.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.888+0000 7ff56d262700 -1 osd.9 84 *** Got signal Terminated *** 2023-12-14T18:31:49.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:49 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:49.888+0000 7ff56d262700 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:50.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:50.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:50.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:50.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:50.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:50.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:50.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:50.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:50.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:50.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:50.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:50 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:50.094+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:50.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:50 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:50.309+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:50.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:50 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:50.309+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:50.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:50 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:50.309+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:50.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:50 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:50.309+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:50.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:50 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:50.309+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:50.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:50.661+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:50.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:50.661+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:50.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:50.661+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:50.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:50.661+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:50.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:50 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:50.661+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:51.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:51 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:51.103+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:51.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:51 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:51.103+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:51.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:51 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:51.103+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:51.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:51 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:51.103+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:51.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:51 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:51.103+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:51.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:51 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:51.103+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:51.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:51 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:51.291+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:51.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:51 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:51.291+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:51.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:51 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:51.291+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:51.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:51 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:51.291+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:51.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:51 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:51.291+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:51.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:51.635+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:51.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:51.635+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:51.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:51.635+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:51.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:51.635+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:51.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:51.635+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:51.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:51 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:51.635+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:25.685817+0000 front 2023-12-14T18:31:25.685737+0000 (oldest deadline 2023-12-14T18:31:50.985666+0000) 2023-12-14T18:31:52.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:52 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:52.328+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:52.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:52 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:52.328+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:52.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:52 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:52.328+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:52.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:52 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:52.328+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:52.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:52 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:52.328+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:52.636 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:52.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:52.636 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:52.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:52.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:52.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:52.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:52.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:52.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:52.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:52.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:52 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:52.147+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:52.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:52.592+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:52.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:52.592+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:52.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:52.592+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:52.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:52.592+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:52.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:52.592+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:52.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:52 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:52.592+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:25.685817+0000 front 2023-12-14T18:31:25.685737+0000 (oldest deadline 2023-12-14T18:31:50.985666+0000) 2023-12-14T18:31:53.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:53.327+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:53.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:53.327+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:53.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:53.327+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:53.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:53.327+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:53.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:53.327+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:53.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:53 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:53.152+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:53.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:53 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:53.152+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:53.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:53 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:53.152+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:53.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:53 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:53.152+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:53.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:53 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:53.152+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:53.638 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:53 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:53.152+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:53.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:53 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:53.641+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:53.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:53 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:53.641+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:53.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:53 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:53.641+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:53.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:53 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:53.641+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:53.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:53 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:53.641+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:53.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:53 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:53.641+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:25.685817+0000 front 2023-12-14T18:31:25.685737+0000 (oldest deadline 2023-12-14T18:31:50.985666+0000) 2023-12-14T18:31:54.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:54 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:54.117+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:54.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:54 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:54.117+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:54.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:54 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:54.117+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:54.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:54 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:54.117+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:54.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:54 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:54.117+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:54.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:54 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:54.117+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:54.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:54.317+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:54.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:54.317+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:54.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:54.317+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:54.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:54.317+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:54.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:54 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:54.317+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:54.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:47.279348+0000 front 2023-12-14T18:30:47.279371+0000 (oldest deadline 2023-12-14T18:31:12.579498+0000) 2023-12-14T18:31:54.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:53.080517+0000 front 2023-12-14T18:30:53.080468+0000 (oldest deadline 2023-12-14T18:31:18.980616+0000) 2023-12-14T18:31:54.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:03.582167+0000 front 2023-12-14T18:31:03.582056+0000 (oldest deadline 2023-12-14T18:31:27.082031+0000) 2023-12-14T18:31:54.959 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.782871+0000 front 2023-12-14T18:31:11.783087+0000 (oldest deadline 2023-12-14T18:31:35.283070+0000) 2023-12-14T18:31:54.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.184011+0000 front 2023-12-14T18:31:18.184140+0000 (oldest deadline 2023-12-14T18:31:40.484089+0000) 2023-12-14T18:31:54.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:25.685817+0000 front 2023-12-14T18:31:25.685737+0000 (oldest deadline 2023-12-14T18:31:50.985666+0000) 2023-12-14T18:31:54.960 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:54 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9[71253]: 2023-12-14T18:31:54.645+0000 7ff568055700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:32.686447+0000 front 2023-12-14T18:31:32.686498+0000 (oldest deadline 2023-12-14T18:31:54.386591+0000) 2023-12-14T18:31:55.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:55 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:55.299+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:55.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:55 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:55.299+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:55.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:55 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:55.299+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:55.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:55 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:55.299+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:55.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:55 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:55.299+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:55.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:55 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:55.299+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:31:55.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:55.154+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:55.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:55.154+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:55.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:55.154+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:55.638 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:55.154+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:55.638 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:55.154+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:55.638 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:55 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:55.154+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:55.709 INFO:journalctl@ceph.osd.9.smithi069.stdout:Dec 14 18:31:55 smithi069 bash[197594]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-9 2023-12-14T18:31:56.386 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:56.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:56.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:56.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:56.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:56.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.123+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:56.603 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.9.service' 2023-12-14T18:31:56.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:56 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:56.336+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:56.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:56 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:56.336+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:56.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:56 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:56.336+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:56.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:56 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:56.336+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:56.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:56 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:56.336+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:56.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:56 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:56.336+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:31:56.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:31:56.643 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-12-14T18:31:56.643 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-12-14T18:31:56.644 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.10 2023-12-14T18:31:57.090 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 systemd[1]: Stopping Ceph osd.10 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:31:57.090 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.888+0000 7f107f0b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:31:57.090 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.888+0000 7f107f0b0700 -1 osd.10 84 *** Got signal Terminated *** 2023-12-14T18:31:57.090 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:56 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:56.888+0000 7f107f0b0700 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:31:57.090 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:57.090 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:57.091 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:57.091 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:57.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:57.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:57.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:57 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:57.088+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:30.997672+0000 front 2023-12-14T18:31:30.997621+0000 (oldest deadline 2023-12-14T18:31:56.297609+0000) 2023-12-14T18:31:57.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:57 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:57.376+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:57.875 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:57 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:57.376+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:57.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:57 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:57.376+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:57.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:57 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:57.376+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:57.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:57 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:57.376+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:57.876 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:57 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:57.376+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:31:58.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:58.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:58.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:58.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:58.387 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:58.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:58.388 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:58 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:58.102+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:30.997672+0000 front 2023-12-14T18:31:30.997621+0000 (oldest deadline 2023-12-14T18:31:56.297609+0000) 2023-12-14T18:31:58.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:58 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:58.345+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:58.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:58 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:58.345+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:58.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:58 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:58.345+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:58.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:58 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:58.345+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:58.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:58 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:58.345+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:58.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:58 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:58.345+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:31:59.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:59.298+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:31:59.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:59.298+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:31:59.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:59.298+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:31:59.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:59.298+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:31:59.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:59.298+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:31:59.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:31:59 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:31:59.298+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:31:59.636 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:31:59.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:31:59.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:31:59.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:31:59.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:31:59.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:31:59.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:31:59 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:31:59.136+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:30.997672+0000 front 2023-12-14T18:31:30.997621+0000 (oldest deadline 2023-12-14T18:31:56.297609+0000) 2023-12-14T18:32:00.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:00 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:00.269+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:00.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:00 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:00.269+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:00.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:00 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:00.269+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:00.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:00 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:00.269+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:00.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:00 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:00.269+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:00.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:00 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:00.269+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:32:00.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:00 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:00.180+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:30.997672+0000 front 2023-12-14T18:31:30.997621+0000 (oldest deadline 2023-12-14T18:31:56.297609+0000) 2023-12-14T18:32:01.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:01.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:01.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:01.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:01.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:01.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:01.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:01 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:01.232+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:01.636 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:46.190600+0000 front 2023-12-14T18:30:46.190716+0000 (oldest deadline 2023-12-14T18:31:12.591292+0000) 2023-12-14T18:32:01.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:52.591644+0000 front 2023-12-14T18:30:52.591721+0000 (oldest deadline 2023-12-14T18:31:18.491732+0000) 2023-12-14T18:32:01.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:00.792874+0000 front 2023-12-14T18:31:00.792947+0000 (oldest deadline 2023-12-14T18:31:26.092904+0000) 2023-12-14T18:32:01.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2023-12-14T18:31:11.795098+0000 front 2023-12-14T18:31:11.795016+0000 (oldest deadline 2023-12-14T18:31:36.495053+0000) 2023-12-14T18:32:01.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:16.995889+0000 front 2023-12-14T18:31:16.995848+0000 (oldest deadline 2023-12-14T18:31:42.295956+0000) 2023-12-14T18:32:01.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:22.796710+0000 front 2023-12-14T18:31:22.796765+0000 (oldest deadline 2023-12-14T18:31:47.496769+0000) 2023-12-14T18:32:01.637 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:01 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10[64998]: 2023-12-14T18:32:01.172+0000 7f1077e9f700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:30.997672+0000 front 2023-12-14T18:31:30.997621+0000 (oldest deadline 2023-12-14T18:31:56.297609+0000) 2023-12-14T18:32:02.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:02.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:02.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:02.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:02.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:02.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:02.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:02 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:02.214+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:02.887 INFO:journalctl@ceph.osd.10.smithi091.stdout:Dec 14 18:32:02 smithi091 bash[73341]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-10 2023-12-14T18:32:03.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:03.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:03.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:03.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:03.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:03.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:03.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:03.173+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:03.734 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.10.service' 2023-12-14T18:32:03.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:03.775 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-12-14T18:32:03.775 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-12-14T18:32:03.775 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.11 2023-12-14T18:32:04.125 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:03 smithi119 systemd[1]: Stopping Ceph osd.11 for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:04.126 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.027+0000 7f288552a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:04.126 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.027+0000 7f288552a700 -1 osd.11 84 *** Got signal Terminated *** 2023-12-14T18:32:04.126 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.027+0000 7f288552a700 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-14T18:32:04.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:04.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:04.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:04.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:04.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:04.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:04.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:04 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:04.180+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:05.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:05.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:05.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:05.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:05.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:05.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:05.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:05 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:05.185+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:06.625 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:06.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:06.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:06.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:06.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:06.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:06.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:06 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:06.168+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:07.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:07.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:07.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:07.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:07.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:07.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:07.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:07 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:07.213+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:08.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2023-12-14T18:30:45.490042+0000 front 2023-12-14T18:30:45.490103+0000 (oldest deadline 2023-12-14T18:31:13.690771+0000) 2023-12-14T18:32:08.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6804 osd.1 since back 2023-12-14T18:30:56.592010+0000 front 2023-12-14T18:30:56.592066+0000 (oldest deadline 2023-12-14T18:31:21.892081+0000) 2023-12-14T18:32:08.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2023-12-14T18:31:01.892913+0000 front 2023-12-14T18:31:01.893004+0000 (oldest deadline 2023-12-14T18:31:25.393130+0000) 2023-12-14T18:32:08.626 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6812 osd.4 since back 2023-12-14T18:31:18.895470+0000 front 2023-12-14T18:31:18.895335+0000 (oldest deadline 2023-12-14T18:31:44.795376+0000) 2023-12-14T18:32:08.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2023-12-14T18:31:24.795729+0000 front 2023-12-14T18:31:24.795742+0000 (oldest deadline 2023-12-14T18:31:47.095885+0000) 2023-12-14T18:32:08.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2023-12-14T18:31:27.596861+0000 front 2023-12-14T18:31:27.596813+0000 (oldest deadline 2023-12-14T18:31:54.597001+0000) 2023-12-14T18:32:08.627 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:08 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11[66047]: 2023-12-14T18:32:08.203+0000 7f2882321700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.91:6820 osd.7 since back 2023-12-14T18:31:35.098089+0000 front 2023-12-14T18:31:35.098120+0000 (oldest deadline 2023-12-14T18:32:00.998003+0000) 2023-12-14T18:32:10.125 INFO:journalctl@ceph.osd.11.smithi119.stdout:Dec 14 18:32:09 smithi119 bash[75166]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-osd-11 2023-12-14T18:32:10.890 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@osd.11.service' 2023-12-14T18:32:10.932 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:10.932 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-12-14T18:32:10.932 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-12-14T18:32:10.933 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.a 2023-12-14T18:32:11.459 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:32:10 smithi069 systemd[1]: Stopping Ceph mds.a for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:11.459 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:32:11 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-a[76507]: 2023-12-14T18:32:11.177+0000 7f2029337700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:11.460 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:32:11 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-a[76507]: 2023-12-14T18:32:11.177+0000 7f2029337700 -1 mds.a *** got signal Terminated *** 2023-12-14T18:32:14.459 INFO:journalctl@ceph.mds.a.smithi069.stdout:Dec 14 18:32:14 smithi069 bash[197858]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-a 2023-12-14T18:32:14.489 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.a.service' 2023-12-14T18:32:14.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:14.526 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-12-14T18:32:14.527 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-12-14T18:32:14.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.d 2023-12-14T18:32:14.794 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:32:14 smithi069 systemd[1]: Stopping Ceph mds.d for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:15.209 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:32:14 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-d[75603]: 2023-12-14T18:32:14.791+0000 7f71c73bd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:15.209 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:32:14 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-d[75603]: 2023-12-14T18:32:14.791+0000 7f71c73bd700 -1 mds.d *** got signal Terminated *** 2023-12-14T18:32:17.959 INFO:journalctl@ceph.mds.d.smithi069.stdout:Dec 14 18:32:17 smithi069 bash[197997]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-d 2023-12-14T18:32:17.988 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.d.service' 2023-12-14T18:32:18.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:18.023 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-12-14T18:32:18.023 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-12-14T18:32:18.024 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.g 2023-12-14T18:32:18.286 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:32:18 smithi069 systemd[1]: Stopping Ceph mds.g for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:18.709 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:32:18 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-g[76123]: 2023-12-14T18:32:18.283+0000 7fa010071700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:18.709 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:32:18 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-g[76123]: 2023-12-14T18:32:18.283+0000 7fa010071700 -1 mds.g *** got signal Terminated *** 2023-12-14T18:32:20.646 INFO:journalctl@ceph.mds.g.smithi069.stdout:Dec 14 18:32:20 smithi069 bash[198137]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-g 2023-12-14T18:32:20.652 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.g.service' 2023-12-14T18:32:20.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:20.687 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-12-14T18:32:20.687 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-12-14T18:32:20.687 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.j 2023-12-14T18:32:20.943 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:32:20 smithi069 systemd[1]: Stopping Ceph mds.j for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:21.209 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:32:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-j[75219]: 2023-12-14T18:32:20.940+0000 7f9a56638700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:21.209 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:32:20 smithi069 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-j[75219]: 2023-12-14T18:32:20.940+0000 7f9a56638700 -1 mds.j *** got signal Terminated *** 2023-12-14T18:32:24.209 INFO:journalctl@ceph.mds.j.smithi069.stdout:Dec 14 18:32:23 smithi069 bash[198278]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-j 2023-12-14T18:32:24.227 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.j.service' 2023-12-14T18:32:24.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:24.261 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-12-14T18:32:24.262 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-12-14T18:32:24.262 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.b 2023-12-14T18:32:24.584 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:32:24 smithi091 systemd[1]: Stopping Ceph mds.b for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:24.886 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:32:24 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: 2023-12-14T18:32:24.583+0000 7fc0c9f35700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:24.887 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:32:24 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b[68675]: 2023-12-14T18:32:24.583+0000 7fc0c9f35700 -1 mds.b *** got signal Terminated *** 2023-12-14T18:32:29.074 INFO:journalctl@ceph.mds.b.smithi091.stdout:Dec 14 18:32:28 smithi091 bash[73594]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-b 2023-12-14T18:32:29.080 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.b.service' 2023-12-14T18:32:29.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:29.118 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-12-14T18:32:29.118 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-12-14T18:32:29.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.e 2023-12-14T18:32:29.387 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:32:29 smithi091 systemd[1]: Stopping Ceph mds.e for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:29.887 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:32:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e[67992]: 2023-12-14T18:32:29.436+0000 7f8f9c975700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:29.887 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:32:29 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e[67992]: 2023-12-14T18:32:29.436+0000 7f8f9c975700 -1 mds.e *** got signal Terminated *** 2023-12-14T18:32:33.637 INFO:journalctl@ceph.mds.e.smithi091.stdout:Dec 14 18:32:33 smithi091 bash[73731]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-e 2023-12-14T18:32:33.690 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.e.service' 2023-12-14T18:32:33.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:33.725 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-12-14T18:32:33.725 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-12-14T18:32:33.725 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.h 2023-12-14T18:32:33.990 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:32:33 smithi091 systemd[1]: Stopping Ceph mds.h for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:34.387 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:32:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h[68332]: 2023-12-14T18:32:33.987+0000 7f3883c40700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:34.387 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:32:33 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h[68332]: 2023-12-14T18:32:33.987+0000 7f3883c40700 -1 mds.h *** got signal Terminated *** 2023-12-14T18:32:37.624 INFO:journalctl@ceph.mds.h.smithi091.stdout:Dec 14 18:32:37 smithi091 bash[73870]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-h 2023-12-14T18:32:37.630 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.h.service' 2023-12-14T18:32:37.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:37.662 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-12-14T18:32:37.662 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-12-14T18:32:37.663 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.k 2023-12-14T18:32:37.886 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:32:37 smithi091 systemd[1]: Stopping Ceph mds.k for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:38.387 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:32:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-k[67649]: 2023-12-14T18:32:37.928+0000 7fe652c4c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:38.387 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:32:37 smithi091 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-k[67649]: 2023-12-14T18:32:37.928+0000 7fe652c4c700 -1 mds.k *** got signal Terminated *** 2023-12-14T18:32:42.386 INFO:journalctl@ceph.mds.k.smithi091.stdout:Dec 14 18:32:42 smithi091 bash[74009]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-k 2023-12-14T18:32:42.501 DEBUG:teuthology.orchestra.run.smithi091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.k.service' 2023-12-14T18:32:42.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:42.535 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-12-14T18:32:42.535 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-12-14T18:32:42.535 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.c 2023-12-14T18:32:42.875 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:32:42 smithi119 systemd[1]: Stopping Ceph mds.c for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:42.876 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:32:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c[69645]: 2023-12-14T18:32:42.770+0000 7fceb2ca6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:42.876 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:32:42 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c[69645]: 2023-12-14T18:32:42.770+0000 7fceb2ca6700 -1 mds.c *** got signal Terminated *** 2023-12-14T18:32:45.625 INFO:journalctl@ceph.mds.c.smithi119.stdout:Dec 14 18:32:45 smithi119 bash[75423]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-c 2023-12-14T18:32:45.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.c.service' 2023-12-14T18:32:45.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:45.670 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-12-14T18:32:45.670 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-12-14T18:32:45.670 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.f 2023-12-14T18:32:45.930 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:32:45 smithi119 systemd[1]: Stopping Ceph mds.f for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:46.375 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:32:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f[69304]: 2023-12-14T18:32:45.927+0000 7f48bcd10700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:46.377 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:32:45 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f[69304]: 2023-12-14T18:32:45.927+0000 7f48bcd10700 -1 mds.f *** got signal Terminated *** 2023-12-14T18:32:49.600 INFO:journalctl@ceph.mds.f.smithi119.stdout:Dec 14 18:32:49 smithi119 bash[75563]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-f 2023-12-14T18:32:49.606 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.f.service' 2023-12-14T18:32:49.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:49.640 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-12-14T18:32:49.640 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-12-14T18:32:49.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.i 2023-12-14T18:32:49.875 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:32:49 smithi119 systemd[1]: Stopping Ceph mds.i for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:50.375 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:32:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i[69987]: 2023-12-14T18:32:49.907+0000 7fc9a46fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:50.375 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:32:49 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i[69987]: 2023-12-14T18:32:49.907+0000 7fc9a46fa700 -1 mds.i *** got signal Terminated *** 2023-12-14T18:32:53.613 INFO:journalctl@ceph.mds.i.smithi119.stdout:Dec 14 18:32:53 smithi119 bash[75701]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-i 2023-12-14T18:32:53.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.i.service' 2023-12-14T18:32:53.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:53.653 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-12-14T18:32:53.653 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-12-14T18:32:53.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.l 2023-12-14T18:32:53.875 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:32:53 smithi119 systemd[1]: Stopping Ceph mds.l for f1527c12-9aac-11ee-95a5-87774f69a715... 2023-12-14T18:32:54.375 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:32:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-l[68961]: 2023-12-14T18:32:53.920+0000 7fe1e4607700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-14T18:32:54.376 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:32:53 smithi119 ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-l[68961]: 2023-12-14T18:32:53.920+0000 7fe1e4607700 -1 mds.l *** got signal Terminated *** 2023-12-14T18:32:56.699 INFO:journalctl@ceph.mds.l.smithi119.stdout:Dec 14 18:32:56 smithi119 bash[75840]: ceph-f1527c12-9aac-11ee-95a5-87774f69a715-mds-l 2023-12-14T18:32:56.705 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f1527c12-9aac-11ee-95a5-87774f69a715@mds.l.service' 2023-12-14T18:32:56.738 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-14T18:32:56.738 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-12-14T18:32:56.738 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-14T18:32:58.412 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-14T18:33:00.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-14T18:33:01.730 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:33:01.769 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:33:01.805 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-14T18:33:01.835 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-14T18:33:01.837 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi069/crash 2023-12-14T18:33:01.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash -- . 2023-12-14T18:33:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:tar: /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-14T18:33:01.888 INFO:teuthology.orchestra.run.smithi069.stderr:tar: Error is not recoverable: exiting now 2023-12-14T18:33:01.890 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi091/crash 2023-12-14T18:33:01.891 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash -- . 2023-12-14T18:33:01.941 INFO:teuthology.orchestra.run.smithi091.stderr:tar: /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-14T18:33:01.941 INFO:teuthology.orchestra.run.smithi091.stderr:tar: Error is not recoverable: exiting now 2023-12-14T18:33:01.943 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi119/crash 2023-12-14T18:33:01.944 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash -- . 2023-12-14T18:33:01.980 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-14T18:33:01.980 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2023-12-14T18:33:01.982 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-14T18:33:01.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-12-14T18:33:02.018 INFO:teuthology.orchestra.run.smithi069.stderr:grep: /var/log/ceph/f1527c12-9aac-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-14T18:33:02.020 INFO:tasks.cephadm:Compressing logs... 2023-12-14T18:33:02.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T18:33:02.063 DEBUG:teuthology.orchestra.run.smithi091:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T18:33:02.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T18:33:02.091 INFO:teuthology.orchestra.run.smithi069.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-14T18:33:02.093 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-14T18:33:02.096 INFO:teuthology.orchestra.run.smithi091.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-14T18:37:43.134 INFO:tasks.cephadm:Archiving logs... 2023-12-14T18:37:43.135 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi069/log 2023-12-14T18:37:43.136 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T18:37:49.409 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/log/ceph to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi091/log 2023-12-14T18:37:49.410 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T18:38:18.014 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi119/log 2023-12-14T18:38:18.015 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T18:38:20.950 INFO:tasks.cephadm:Removing cluster... 2023-12-14T18:38:20.950 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --force 2023-12-14T18:38:21.476 DEBUG:teuthology.orchestra.run.smithi091:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --force 2023-12-14T18:38:22.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f1527c12-9aac-11ee-95a5-87774f69a715 --force 2023-12-14T18:38:22.766 INFO:tasks.cephadm:Removing cephadm ... 2023-12-14T18:38:22.766 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-14T18:38:22.787 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-14T18:38:22.807 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-14T18:38:22.825 INFO:tasks.cephadm:Teardown complete 2023-12-14T18:38:22.825 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-14T18:38:22.834 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-14T18:38:22.835 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-14T18:38:22.837 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-14T18:38:22.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-14T18:38:22.958 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-14T18:38:22.967 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-14T18:38:22.967 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T18:38:22.970 DEBUG:teuthology.orchestra.run.smithi091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T18:38:22.972 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-14T18:38:22.986 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-12-14T18:38:22.987 INFO:teuthology.orchestra.run.smithi091.stderr:bash: ntpq: command not found 2023-12-14T18:38:22.987 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-12-14T18:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T18:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:=============================================================================== 2023-12-14T18:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +449us[ +447us] +/- 72ms 2023-12-14T18:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -764us[ -766us] +/- 58ms 2023-12-14T18:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +461us[ +461us] +/- 65ms 2023-12-14T18:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:38:22.993 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T18:38:22.993 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-12-14T18:38:22.993 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +455us[ +476us] +/- 72ms 2023-12-14T18:38:22.993 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -765us[ -745us] +/- 58ms 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +475us[ +495us] +/- 65ms 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +472us[ +472us] +/- 72ms 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -752us[ -733us] +/- 58ms 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +469us[ +488us] +/- 65ms 2023-12-14T18:38:22.994 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-14T18:38:22.995 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-14T18:38:23.018 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-14T18:38:23.018 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-14T18:38:23.028 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-14T18:38:23.106 DEBUG:teuthology.orchestra.run.smithi091:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-14T18:38:23.167 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-14T18:38:23.225 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T18:38:23.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:38:23.258 DEBUG:teuthology.orchestra.run.smithi091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T18:38:23.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:38:23.288 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-14T18:38:23.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:38:23.317 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-14T18:38:23.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-14T18:38:23.339 INFO:teuthology.task.internal:Duration was 1944.106195 seconds 2023-12-14T18:38:23.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-14T18:38:23.368 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-14T18:38:23.368 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-14T18:38:23.370 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-14T18:38:23.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-14T18:38:23.417 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T18:38:23.417 INFO:teuthology.orchestra.run.smithi091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T18:38:23.419 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-14T18:38:23.899 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-14T18:38:23.899 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-12-14T18:38:23.900 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-14T18:38:23.924 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi091.front.sepia.ceph.com 2023-12-14T18:38:23.924 DEBUG:teuthology.orchestra.run.smithi091:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-14T18:38:23.947 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-12-14T18:38:23.947 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-14T18:38:23.968 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-14T18:38:23.968 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T18:38:23.971 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T18:38:23.989 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-14T18:38:24.049 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-14T18:38:24.049 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-14T18:38:24.052 DEBUG:teuthology.orchestra.run.smithi091:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-14T18:38:24.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-14T18:38:24.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-14T18:38:24.171 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-14T18:38:24.171 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-14T18:38:24.198 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-14T18:38:24.225 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-14T18:38:24.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-14T18:38:24.261 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-14T18:38:24.264 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-14T18:38:24.268 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-14T18:38:24.288 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-12-14T18:38:24.292 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = core 2023-12-14T18:38:24.318 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-12-14T18:38:24.364 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-14T18:38:24.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:38:24.380 DEBUG:teuthology.orchestra.run.smithi091:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-14T18:38:24.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:38:24.396 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-14T18:38:24.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-14T18:38:24.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-14T18:38:24.430 INFO:teuthology.task.internal:Transferring archived files... 2023-12-14T18:38:24.431 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi069 2023-12-14T18:38:24.431 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T18:38:24.467 DEBUG:teuthology.misc:Transferring archived files from smithi091:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi091 2023-12-14T18:38:24.467 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T18:38:24.501 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436/remote/smithi119 2023-12-14T18:38:24.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T18:38:24.535 INFO:teuthology.task.internal:Removing archive directory... 2023-12-14T18:38:24.535 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-14T18:38:24.537 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-14T18:38:24.540 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-14T18:38:24.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-14T18:38:24.599 INFO:teuthology.task.internal:Not uploading archives. 2023-12-14T18:38:24.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-14T18:38:24.622 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-14T18:38:24.623 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-14T18:38:24.625 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-14T18:38:24.627 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-14T18:38:24.639 INFO:teuthology.orchestra.run.smithi069.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 14 18:38 /home/ubuntu/cephtest 2023-12-14T18:38:24.641 INFO:teuthology.orchestra.run.smithi091.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 14 18:38 /home/ubuntu/cephtest 2023-12-14T18:38:24.644 INFO:teuthology.orchestra.run.smithi119.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 14 18:38 /home/ubuntu/cephtest 2023-12-14T18:38:24.645 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-14T18:38:24.706 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-14T18:38:24.739 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T18:38:24.762 DEBUG:teuthology.nuke:shortname: smithi069 2023-12-14T18:38:24.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T18:38:24.787 DEBUG:teuthology.nuke:shortname: smithi091 2023-12-14T18:38:24.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T18:38:24.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.864567', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEDuntAOkRfdezS+Lgz8MUDu8Eyivsq1jlYEs6Xy80JdTORtdWi9GR8cn7NyvSg1iYSRfTyJMe7SjVd4luQSli4='} 2023-12-14T18:38:24.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.865977', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRqiZBczV6cpnvgPffu94DpNWh/51zux1wzi6iqxVWsfauj6SLqXrBVQm7/aeB1fCeQxi2dIehzGnU+XJUFxO8='} 2023-12-14T18:38:24.812 DEBUG:teuthology.nuke:shortname: smithi119 2023-12-14T18:38:24.812 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T18:38:24.840 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-14T18:38:24.840 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T18:38:24.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491436', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.867113', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwLVmvB4u8BUKCkE6IVAT9j6fNlLkfparHpzIdVJt6ztQrYvqkSi6vsqQYBfW28yrjtqHpja8zMZOnib1Xxlss='} 2023-12-14T18:38:24.866 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-14T18:38:24.866 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:24.881 INFO:teuthology.orchestra.console.smithi091:Power off 2023-12-14T18:38:24.881 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T18:38:24.891 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-14T18:38:24.902 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-12-14T18:38:24.903 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:24.917 INFO:teuthology.orchestra.console.smithi119:Power off 2023-12-14T18:38:24.918 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T18:38:24.927 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-14T18:38:24.940 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-12-14T18:38:24.940 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:24.961 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-14T18:38:28.893 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:28.928 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:28.962 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:29.005 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-14T18:38:29.039 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-14T18:38:29.073 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-14T18:38:33.011 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:33.039 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:33.073 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T18:38:33.122 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-14T18:38:33.149 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-12-14T18:38:33.183 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-14T18:38:33.223 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-14T18:38:33.250 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-12-14T18:38:33.284 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-12-14T18:38:33.390 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/misc}} duration: 1944.106194972992 failure_reason: 'Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi069 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bf026da9d69000f3d4a9d16360156095d6612a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh''' flavor: default owner: scheduled_choffman@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=255174987f7d49a1805f27c96562fb7c status: fail success: false 2023-12-14T18:38:33.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T18:38:33.484 INFO:teuthology.run:FAIL